Add a dedicated slot for the sledge/pickaxe. Makes it so everyone has destruction and kill options at all times. You're never entirely defenseless, and you've always got options to move around the map destruction wise.
If you were worried about people destroying the whole map, make it so only some classes have access to the sledge specifically. Every class should at least have the pickaxe though.
I'd also settle for a kick button.