Local LLM

[twilit brook]

how to exploit an existing LLM model (Free) and make it as part of an application , For example I have to give specific input it will automatically treat it an get the llms output ...

[turbid badge]

Really depends on the specifics of your workflow. So many people just use LM Studio or Ollama to interact with LLMs locally. These models are not online, so they don't do search AND unless you have extra stuff set up, they don't directly read your file system/interact with your machine.

[tranquil wyvern]

@twilit brook , are you really asking about local LLM? Maybe give a clear context of what you want achieve

[twilit brook]

Maybe i didn"t mean it 'Local', having some functions producing specific data which we aim give it as input to a LLM(specialzed one / maybe) to treat it and give an output based on specific prompt, so the General view is calling the LLM from the app to process My generated Inputs And the We show Its output ...

[young nexus]

What's your goal in your project. modeling or fine-tuning?

[jovial ledge]

You're looking for calling model's API to input your own data and make some analysis. You can learn about it from models docs, at least to make yourself into the topic and later bring more questions to chat.