#Local Indexing

13 messages ยท Page 1 of 1 (latest)

sick vector
#

Omg... how to setup local indexing on my homelab server ? i connect via ssh to server configure everything etc and always have this info on screen, on my local pc its fine i don't do nothing and it worked i can change all indexing setting.

round arrow
#

All you need to have is an API key for OpenRouter or OpenAI, pick an embedding model (I use Qwen 8B on OR) and you can use LanceDB (no setup - free) or Qdrant (local Docker setup - free) for the vector database.

Any questions I am around

sick vector
#

anyway it worked ๐Ÿ˜„

#

thx for answer ๐Ÿ™‚

#

ps. im not programmer just trying new things that's why this was hard for me ๐Ÿ˜„

round arrow
#

NP... we are a friendly bunch here. Ask all the questions you want! kilo โค๏ธ

olive bear
olive bear
round arrow
round arrow
#

And remmber you need an embedding model. A normal LLM will not work very well at all.

olive bear