e.g. you say "build a snowman" into the mic, and the AI chooses from spheres, cylinders and cubes of the shape, size, color, position, and rotation it thinks best create the requested scene for you using threejs and WebXR.
If anyone else has a Meta Quest 3 and an OpenAI API account you can do this in mixed-reality
Source and hosted page below:
https://github.com/8bitkick/8bitkick.github.io/tree/master/VoxelAstra