When two ghost groups with each a child in the same chunk that have ghost buffer components both get send in the same tick the server overwrites the dynamic data of the first ghost child resulting in client/server baselines getting out of sync resulting in 'random' client data (due to delta compression). Never recovers.
com.unity.netcode: 1.12.0
Patch attached.