Hosted Ollama service? | Home Assistant | Page 1

vale mantle Dec 21, 2024, 7:17 AM

#

I’m looking to integrate an LLM into my smart home setup. I don’t have the hardware to run something like Ollama locally, and using ChatGPT regularly might get expensive. Are there any cloud providers offering access to free or affordable LLMs (like Ollama) where I can pay the provider for the hardware costs?

sleek adder Dec 21, 2024, 8:16 AM

#

There are some free API providers, but most of them have usage limits. https://github.com/marketplace

GitHub

GitHub Marketplace: tools to improve your workflow

Find the tools that help your team build better, together.

#

At X AI, you have $25 in free credits available each month.

#

https://x.ai/

xAI

xAI is an AI company with the mission of advancing scientific discovery and gaining a deeper understanding of our universe.

vale mantle Dec 21, 2024, 11:26 AM

#

Thank you, will check it out. I wonder why there is so little focus on these things. I feel that most people talk about Ollama hosted locally or using OpenAI or Google (expensive) services.

south knoll Dec 21, 2024, 2:05 PM

#

Google isnt expensive at all. You got a trail with more than 200 for several months. I now use it very heavily developing and debugging. 50 euro cents the last 7 days.

I saw a youtube of smarthomejunkie he uses chatgtp its slow and his debugging. (Only lights and standard stuff) was 80 euro cents in a day.

vale mantle Dec 21, 2024, 2:36 PM

#

south knoll Google isnt expensive at all. You got a trail with more than 200 for several mon...

Thank you, I guess I just assumed that Google was in the same ballpark as openai.

south knoll Dec 21, 2024, 2:40 PM

#

If you only gona use it for simple stuff ifs like not even a cent a day.

spice berry Dec 21, 2024, 3:39 PM

#

I use gpt-4o-mini, and using my assistant every day i don't think my bill went past 3-4$ usd in a month, it's very inexpensive for that model and it works very well

regal pebble Dec 21, 2024, 4:24 PM

#

Yup, just use mini for ChatGPT.
I'm curious what you will to pay with for "free" LLM. Because there's nothing really free - someone pays for hardware, maintenance and electricity.

burnt harbor Dec 22, 2024, 2:27 PM

#

Openai isn’t expensive. Be careful with third parties, there is often a hidden cost; I just about lost it when I saw my best friend had installed an app posing as if they were openai, requesting permission to everything on his phone. The value add was a couple of tools that were slick, much more “free” tokens, all for the low cost of his privacy and information 😬

Seriously though evaluate openai’s costs. 4o is dirt cheap, and 4o mini is even cheaper.

#Hosted Ollama service?