#Which Ollama model..

1 messages · Page 1 of 1 (latest)

fierce acorn Dec 20, 2024, 12:42 PM

Hello very new to the world of LLM and wanted to give it a go since I just ordered the new Home Assistant Voice Preview Edition :). I am planning to run Ollama on a standalone PC core i5 with a 10708gb and 16gb of ram. Which Ollama model would be best for me to use with HA

Thanks

subtle otter Dec 20, 2024, 2:53 PM

8GB will probably be enough for llama3.2 7B model. Did you look into Jetson Nano Super, that costs 250$? It will be better than 1070.