#All about gpt4o with canvas and context length
1 messages · Page 1 of 1 (latest)
Hi @hollow flax. I'm kapa.ai, your friendly support bot. I will try to answer your question by searching through the knowledge base. :wave:
GPT-4o, denoted as "o" for "omni", is OpenAI's most advanced model. It is multimodal, meaning it can accept both text and image inputs and output text. It has the same high intelligence as GPT-4 Turbo but is much more efficient—it generates text 2x faster and is 50% cheaper. GPT-4o also has the best vision and performance across non-English languages of any of OpenAI's models. It is available in the OpenAI API to paying customers source (https://platform.openai.com/docs/models).
The context window for GPT-4o is 128,000 tokens. The maximum output tokens for the model are 4,096 tokens. The training data for the model is up to October 2023 source (https://platform.openai.com/docs/models).
In terms of tokens, text generation and embeddings models process text in chunks called tokens. Tokens represent commonly occurring sequences of characters. For example, the string " tokenization" is decomposed as " token" and "ization", while a short and common word like " the" is represented as a single token. As a rough rule of thumb, 1 token is approximately 4 characters or 0.75 words for English text. One limitation to keep in mind is that for a text generation model the prompt and the generated output combined must be no more than the model's maximum context length source (https://platform.openai.com/docs/concepts/tokens).
In terms of usage, GPT-4o and GPT-4o mini are available to anyone with an OpenAI API account, and you can use the models in the Chat Completions API, Assistants API, and Batch API. Function calling and JSON mode are also supported source (https://help.openai.com/en/articles/7102672-how-can-i-access-gpt-4-gpt-4-turbo-gpt-4o-and-gpt-4o-mini#h_f472fd7cbc).
Please note that the context window of the underlying model is 128k, RAG pipelines and other methods used by Microsoft's AI search system are used to choose which data is included in the prompt up to that maximum 128k source (https://community.openai.com/t/761439).
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
@hollow flax kapa.ai is still learning and improving, please let us know how it did by reacting below