I hooked up a set of speakers to my Home Assistant Voice PE and the audio quality was poor. The issue ended up being that the 3.5mm jack does not fully protrude through the case.
As a workaround I drilled the hole bigger so the plug would fully seat in the jack. The real solution is that the case needs to be redesigned to push the wall back further so both the 3.5mm jack and USB-C port fully protrude through the case.