HOSTING AI MODEL PRICING | Learn AI Together | Page 1

uneven kite Nov 25, 2024, 5:23 AM

#

Hi, Did you check the vast.ai? this is the cheap service for cloud GPU like runpod.
And if you let me know this service name, thanks

#

looks good

crystal gulch Nov 25, 2024, 7:09 AM

#

Yeah I just found vast ai. It looks pretty good.

uneven kite Nov 25, 2024, 7:12 AM

#

But in this platform, there is no severless function and you must implement this. lol

crystal gulch Nov 25, 2024, 8:24 PM

#

#

what do you think about this? Apparently free API usage..... 👀

uneven kite Nov 26, 2024, 8:45 AM

#

🤣 There is no free API and these model supported by this platforms are open source model as you know. So to host this model, the GPU is mandatory and it require the money.
https://www.reddit.com/r/LocalLLaMA/comments/1eap9fj/we_made_glhfchat_run_almost_any_opensource_llm/
Currently, they are figure out how to price it and one day, they will require the cost.

Explore this post and more from the LocalLLaMA community

#HOSTING AI MODEL PRICING