Chat template | Nomic AI | Page 1

Hi @boreal mulch. I'm kapa.ai, your friendly support bot. I will try to answer your question by searching through the knowledge base. :wave:

I'm sorry, but the knowledge sources do not contain a specific chat template for the MLewdBoros-L2-13B-GGUF model.

However, you can find or create a chat template for models that do not include one by following these steps:

Find the original model's HuggingFace repository: The authoritative source for a model's chat template is usually the HuggingFace repo for the original (non-GGUF) model. If you have the model file, try searching for its name online or check the page where you downloaded the GGUF model. The README may provide the template or reference a standard one (e.g., ChatML, Alpaca, Vicuna) How do I find a chat template?.
Extract the chat template:
- Download the tokenizer_config.json from the model's HuggingFace repo and use jq to extract the template:
```
jq -r ".chat_template" tokenizer_config.json
```
- Or, use Python with the transformers library:
```
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained('MODEL_ID')
print(tokenizer.get_chat_template())
```
  Replace 'MODEL_ID' with the actual HuggingFace model ID.
If no template is provided: You may need to create your own, referencing templates from similar models or community resources. The Advanced: How do I make a chat template? section provides guidance on this process.

If you need further help, you can also ask the Discord community for assistance.

In summary, there is no ready-made chat template for MLewdBoros-L2-13B-GGUF in the provided documentation, but you can extract or create one using the steps above.