I just updated to v3.6.1, but I do not know what the new "chat template" is, and I cannot find any sample templates on github and google search.
#This new "chat template"
glossy cave
limpid galeBOT
Hi @glossy cave. I'm kapa.ai, your friendly support bot. I will try to answer your question by searching through the knowledge base. :wave:
The new "chat template" feature in GPT4All v3.5 and later versions (including v3.6.1) is an important change in how conversations are formatted for the model. Here's what you need to know:
-
Chat templates are now using Jinja syntax instead of simple placeholders GPT4All Documentation (https://docs.gpt4all.io/gpt4all_desktop/chat_templates.html#what-changed-in-gpt4all-v35).
-
The chat template now formats an entire conversation rather than just a single pair of messages GPT4All Documentation (https://docs.gpt4all.io/gpt4all_desktop/chat_templates.html#what-changed-in-gpt4all-v35).
-
If you're looking for sample templates, you can find them in a few ways:
a. Check the model's HuggingFace repository. The chat template is usually in the
tokenizer_config.jsonfile GPT4All Documentation (https://docs.gpt4all.io/gpt4all_desktop/chat_templates.html#how-do-i-find-a-chat-template).b. You can use Python or command-line tools to extract the chat template from the model files GPT4All Documentation (https://docs.gpt4all.io/gpt4all_desktop/chat_templates.html#how-do-i-find-a-chat-template).
-
If you need to create a custom chat template, you can start by modifying an existing one. The GPT4All documentation provides guidance on how to do this GPT4All Documentation (https://docs.gpt4all.io/gpt4all_desktop/chat_templates.html#advanced-how-do-i-make-a-chat-template).
-
To customize the chat template for a specific model, go to Settings > Model in the GPT4All interface GPT4All Documentation (https://docs.gpt4all.io/gpt4all_desktop/chat_templates.html#how-do-i-customize-the-chat-template-or-system-message).