#How fast are network volumes?

1 messages · Page 1 of 1 (latest)

sturdy comet
#

Hey, this kind of belongs into here, and also into serverless. For a client we're currently architecting some stuff, and the question we're having is, just exactly how fast are network volumes.
My limited benchmarks make it feel like they add about a minute for an SDXL Model to the execution time, because the Model needs to be loaded to RAM. This seems to be much faster with local storage.
What are your experiences, any pieces of advice? Any gotchas?
Thank you so much 🙂

A confused Devops Engineer who has to handle the customers need for speed.

zenith gullBOT
#

To help others find answers, you can mark your question as solved via Right click solution message -> Apps -> ✅ Mark Solution

fleet echo
#

Local Storage will always be much faster. You have lower latency, higher bandwidth. You can keep Network Storage for sharing between pods, sync to local storage and load from local storage.