That is also an option.

What I usualy do is cut off the leads (cut wires one by one) , recycle the leads and plugs, and "remove" the battery after soaking it in salt water.