After converting most of my safetensors models to Diffusers, I suddenly can't add any VAE to them using the model manager. Previously, I had the VAE separate from the models and used the same VAE for all of them. But now, when I try to assign them, I get an error that says it is not a valid JSON file.
Do Diffusers use a different vae format? How do I convert my vae to that format to get them to work?