I feel like I have attempted everything possible but I am unable to get ollama to recognize the 3060. I want this gpu to be dedicated to making my home assistant and voice assistants as fast as possible. I am using an i7-8700T on an Nvme with the 3060 installed directly onto the asus b365m-plus with 16GB of ram. My end goal is to have Ollama running as efficiently and fast as possible while keeping everything contained within this case. Am I doing something wrong or is this just not compatible? Should I switch to a different os?
#3060 Ollama HA OS on bare metal
1 messages · Page 1 of 1 (latest)
I recommend Proxmox VE but please share lspci -nnk.
you cant get it to work with HAOS
your options would be to:
virtualise, running haos in 1 vm and running ollama seperatly with either a vm or lxc setup.
regular distro and have ha running in a container install alongside ollama running in a seperate container.