did you make sure the RPC gets called

[frosty egret]

the object in question is placed on scene, it doesn't get instantiated. Now that i just checked seems like OnNetworkSpawn gets called sometimes on this object

[lone dagger]

In scene network objects get spawned when the scene loads