Hi @jovial owl. I'm kapa.ai, your friendly support bot. I will try to answer your question by searching through the knowledge base. :wave:
#What is prompt template, system prompt
hazy lindenBOT
In the context of GPT4All, a system_prompt and prompt_template are used to guide the AI model's responses during a chat session.
-
system_prompt: This is an initial instruction given to the model. It sets the context or role for the AI model. For example, you might set the system prompt as "You are a cyber security expert who can find vulnerabilities in source code". This instructs the model to behave as a cyber security expert during the chat session. -
prompt_template: This is a template for the prompts where{0}is replaced by the user message. It helps in structuring the conversation with the AI model.
The words with 3 pound signs in front of them are used to format the prompts and responses in the chat session. For example, ### User:\n%1\n### Response:\n is a prompt template where %1 is replaced by the user's message and the AI model's response is appended after ### Response:\n.
Here is an example of how to use them:
from gpt4all import GPT4All
model = GPT4All("nous-hermes-llama2-13b.Q4_0.gguf")
with model.chat_session("You are a cyber security expert who can find vulnerabilities in source code"):
response = model.generate('who are you?', temp=0)
print(response)
In this example, the system prompt is "You are a cyber security expert who can find vulnerabilities in source code", which sets the role for the AI model. The user's message 'who are you?' is inserted into the prompt template to generate the AI model's response.
Sources:
- GPT4All Python Generation API Documentation (https://docs.gpt4all.io/gpt4all_python.html#gpt4all.gpt4all.GPT4All.chat_session)
- GPT4All GitHub Issue (https://github.com/nomic-ai/gpt4all/issues/1799)
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
jovial owl
@hazy linden I dont understand the pyton terms, can you please rephrase this in terms of the GUI application?
hazy lindenBOT
Let me check the knowledge base for you. One moment! :books:
Sure, I can explain these terms in a more general context.
-
system_prompt: This is like an initial instruction or context you give to the AI. It's like telling the AI what role it should play or what the conversation is about. For example, if you're using an AI chatbot, the system prompt might be something like "You are a helpful assistant." -
prompt_template: This is a format or structure for the conversation. It's like a script where certain parts get filled in with the actual conversation. For example, in a chatbot, the prompt template might be "User: {user's message} \n Assistant: {assistant's response}". The parts in the curly braces get replaced with the actual messages in the conversation.
The words with 3 pound signs in front of them (###) are used in some models to indicate different parts of the conversation, like the user's message and the assistant's response. It's a way of structuring the conversation so the AI knows who is "speaking".
In terms of a GUI application, you might not see these terms directly, but they would be used behind the scenes to guide the AI's responses. The system prompt would be set when the chat session starts, and the prompt template would be used to format each message in the conversation.
I hope this helps! Let me know if you have any other questions.
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
jovial owl
@hazy linden should i put the setting of the roleplay in the system prompt or the prompt template
hazy lindenBOT
Let me check the knowledge base for you. One moment! :books:
The setting of the roleplay should be put in the system_prompt. The system_prompt is used to set the context or role for the AI model. For example, if you want the AI to roleplay as a historian, your system prompt could be "You are a historian specializing in ancient civilizations."
On the other hand, the prompt_template is used to structure the conversation and doesn't typically contain specific roleplay or context information. It's more about the format of the conversation, like "User: {{user's message}} \n Assistant: {{assistant's response}}".
So, in a roleplay scenario, you would use the system_prompt to set the role or context, and the prompt_template to structure the conversation.
Sources:
- GPT4All Python Generation API Documentation (https://docs.gpt4all.io/gpt4all_python.html#gpt4all.gpt4all.GPT4All.chat_session)
- GPT4All GitHub Issue (https://github.com/nomic-ai/gpt4all/issues/1799)
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
jovial owl
@hazy linden how do i use prompt template to structure the beginning dialogue between the hero and the villain?
hazy lindenBOT
Let me check the knowledge base for you. One moment! :books:
In the context of a GUI application like GPT4All, you can structure the beginning dialogue between the hero and the villain using the system_prompt and prompt_template.
The system_prompt can be used to set the context of the conversation. For example, you could set the system prompt as "A dialogue between a hero and a villain."
The prompt_template is used to structure the conversation. For example, you could set the prompt template as "Hero: {0}\nVillain: " where {0} will be replaced by the user's input.
When you start a conversation, you would input the hero's dialogue, and the AI, role-playing as the villain based on the system prompt, would respond accordingly.
Please note that the exact way to set the system_prompt and prompt_template may vary depending on the specific GUI application you are using. You should refer to the application's documentation or help resources for specific instructions.
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
jovial owl
@hazy linden why would the prompt template have defaulted with "### Human:"? what do the three pound signs do?
hazy lindenBOT
Let me check the knowledge base for you. One moment! :books:
The "### Human:" in the prompt_template is a way to structure and format the conversation in the AI model. The three pound signs "###" are used as delimiters or markers to indicate different parts of the conversation.
In this case, "### Human:" is used to indicate the start of the user's input. This helps the AI model to understand and differentiate between the user's input and its own responses.
Similarly, you might see "### Assistant:" used to indicate the start of the AI model's response.
These markers are particularly useful when the conversation history is long or complex, as they help to clearly separate each part of the conversation.
Source: GPT4All Python Generation API Documentation (https://docs.gpt4all.io/gpt4all_python.html#without-online-connectivity)
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
jovial owl
@hazy linden what does "### Input" mean in the system prompt? I see the default "### System" as well
hazy lindenBOT
Let me check the knowledge base for you. One moment! :books:
The "### Input" and "### System" in the system prompt are used as markers to structure and format the conversation in the AI model.
-
"### Input": This is used to indicate the start of the user's input. It helps the AI model to understand and differentiate between the user's input and its own responses.
-
"### System": This is used to indicate the system's instructions or context-setting information for the AI model. It helps the AI model understand the context or role it should play in the conversation.
These markers are particularly useful when the conversation history is long or complex, as they help to clearly separate each part of the conversation.
Source: GPT4All Python Generation API Documentation (https://docs.gpt4all.io/gpt4all_python.html#without-online-connectivity)
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
jovial owl
@hazy linden I dont understand how a prompt template works at all. Can you give me an example of a slightly detailed one? Its a roleplay between a hero and a villain, I want to be the villain and for the AI to only talk once as the hero
hazy lindenBOT
Let me check the knowledge base for you. One moment! :books:
Sure, I can provide an example of how a prompt template might work in a roleplay scenario between a hero and a villain, where you want to be the villain and for the AI to only talk once as the hero.
In this case, you could set the system_prompt to provide the context for the AI. For example, your system prompt could be "You are a hero confronting a villain."
The prompt_template is used to structure the conversation. Given your scenario, you could set the prompt template as follows:
### System:
You are a hero confronting a villain.
### Hero:
{0}
### Villain:
In this template, {0} will be replaced by the AI's response. When you start the conversation, you would input the villain's dialogue, and the AI, role-playing as the hero based on the system prompt, would respond accordingly.
Please note that the exact way to set the system_prompt and prompt_template may vary depending on the specific GUI application you are using. You should refer to the application's documentation or help resources for specific instructions.
Source: GPT4All Python Generation API Documentation (https://docs.gpt4all.io/gpt4all_python.html#without-online-connectivity)
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
jovial owl
@hazy linden where should i put the characteristics of the character the ai is roleplaying?
hazy lindenBOT
Let me check the knowledge base for you. One moment! :books:
The characteristics of the character the AI is roleplaying should be put in the system_prompt. The system_prompt is used to set the context or role for the AI model. For example, if you want the AI to roleplay as a brave and noble hero, your system prompt could be "You are a brave and noble hero."
This way, the AI model will have the context it needs to generate responses that are in line with the character's traits.
Source: GPT4All Python Generation API Documentation (https://docs.gpt4all.io/gpt4all_python.html#gpt4all.gpt4all.GPT4All.chat_session)
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
jovial owl
@hazy linden can you please write me a detailed system prompt and a prompt template where a girlfriend, the ai, is returning home to a horny boyfriend, the user. The ai should not talk as the user or say their actions. make up more details too
hazy lindenBOT
Let me check the knowledge base for you. One moment! :books:
Sure, I can provide an example of a system prompt and a prompt template for this scenario.
For the system_prompt, you could provide the context and characteristics of the AI's role. For example:
You are a loving and understanding girlfriend returning home after a long day at work. You find your boyfriend in a particularly amorous mood. Remember to maintain a respectful and considerate conversation.
The prompt_template is used to structure the conversation. Given your scenario, you could set the prompt template as follows:
### System:
You are a loving and understanding girlfriend returning home after a long day at work. You find your boyfriend in a particularly amorous mood. Remember to maintain a respectful and considerate conversation.
### Boyfriend:
{{0}}
### Girlfriend:
In this template, {{0}} will be replaced by the user's input. When you start the conversation, you would input the boyfriend's dialogue, and the AI, role-playing as the girlfriend based on the system prompt, would respond accordingly.
Please note that the exact way to set the system_prompt and prompt_template may vary depending on the specific GUI application you are using. You should refer to the application's documentation or help resources for specific instructions.