So, if you focus slightly on pillars of fortune there are 2 game destroying things:
- Ender dragon egg

- Wither egg

The problem with both of them is that if you're near 10 blocks range of ender dragon spawn point, you got thrown by it in the void. No chances to be alive after hitting from ender dragon and same goes with wither. They are too powerful that just one hit from them can destroy you in game.

After all if you can't remove it then after 5 mins of game give one player ender dragon/wither spawn egg to make game ending faster. So it'll not ruin the experience of game while playing in starting. That's all 

