#Nineteen
5 messages · Page 1 of 1 (latest)
🤔 what enables them to be so fast?
I'm skeptical from the start of any of the decentralized inference people because of Targon's caching stuff...
Understandable, but give it a try if you like and you’ll see it’s not cached. We also run chutes which is decentralised and not cached - but chutes is ran on the minimal hardware possible to get the results needed
Whereas nineteen use the best and also lots of proprietary tricks and techniques to get the highest t/s