#model

1 messages ยท Page 1 of 1 (latest)

unkempt terrace
#

Can we use model with custom API? I see only for fallback

obtuse perchBOT
# unkempt terrace Can we use model with custom API? I see only for fallback

Yes! Clawdbot supports custom API endpoints for models (OpenAI-compatible format). You can set a custom baseUrl in your model configuration.

Example config for a custom API:

{
  "models": {
    "my-custom-model": {
      "provider": "openai",
      "model": "your-model-name",
      "baseUrl": "https://your-custom-api.com/v1"
    }
  }
}

This works with any OpenAI-compatible API (LocalAI, LM Studio, etc.).

#

Key docs:

What provider/API are you trying to connect? I can help narrow it down! ๐Ÿฆ

unkempt terrace
obtuse perchBOT
obtuse perchBOT
# unkempt terrace here https://jatevo.ai/private-ai/api

Based on my research, Jatevo.ai is a decentralized GPU LLM inference network, but I couldn't find public API documentation for their endpoint format.

For Clawdbot to work with a custom provider, we need to know:

  1. API format - Is it OpenAI-compatible (/v1/chat/completions) or Anthropic-compatible (/v1/messages)?
  2. Base URL - What endpoint should baseUrl point to?
  3. Auth - API key header name (usually Authorization: Bearer <key>)
  4. Model IDs - What model names/IDs do they expose?

Can you share:

  • Your full API endpoint URL?
  • A sample curl request or any documentation they provided?

If it's OpenAI-compatible (most likely for a GPU inference network), the config would look like:

#
{
  models: {
    mode: "merge",
    providers: {
      jatevo: {
        baseUrl: "https://your-jatevo-endpoint/v1",
        apiKey: "${JATEVO_API_KEY}",
        api: "openai-completions",  // or "anthropic-messages"
        models: [
          { 
            id: "model-name-they-use", 
            name: "Jatevo Model",
            contextWindow: 32768,
            maxTokens: 4096
          }
#
        ]
      }
    }
  }
}

Let me know what details you have and I'll help you get it working! ๐Ÿฆ

unkempt terrace
obtuse perchBOT
#
            id: "glm-4.7-fp8", 
            name: "GLM-4.7 FP8",
            contextWindow: 131072,
            maxTokens: 8192
          }
        ]
      }
    }
  }
}

Set your API key:

export JATEVO_API_KEY="your-actual-api-key"
#

Or add it to your env file / system env.

The glm-4.7-fp8 model is a Zhipu AI (GLM) model โ€” Jatevo appears to be a decentralized network serving these models. Should work great with the config above! ๐Ÿฆ

unkempt terrace
obtuse perchBOT
# unkempt terrace Can i make that as primary model?

Yes! That's exactly what the config does โ€” agents.defaults.model.primary: "jatevo/glm-4.7-fp8" sets it as your primary model.

Steps:

  1. Set the env var:

    export JATEVO_API_KEY="your-key-here"
    
  2. Apply the config to ~/.clawdbot/clawdbot.json

  3. Hot-reload or restart:

    clawdbot gateway call config.apply
    

Then test with:

#
clawdbot models test jatevo/glm-4.7-fp8 "Hello!"

Let me know if you hit any issues! ๐Ÿฆ

unkempt terrace