I developed an agent using the OpenAI assistant file search feature. I use vector store to upload my files, but I have questions about the fee. I know that the first GB is free, only the number of tokens used by the GPT-4o model during output is charged, right? I would be very happy if someone could help me out on this issue.
#GPT Assistant Vector Store
rare timber
foggy forgeBOT
Hi @rare timber. I'm kapa.ai, your friendly support bot. I will try to answer your question by searching through the knowledge base. :wave:
The pricing for the File Search feature in OpenAI's API is based on the size of the vector store storage you use. The first GB of storage is free, and beyond that, it costs $0.10 per GB per day. The size of the vector store is determined by the size of the vector store once your file is parsed, chunked, and embedded. This is separate from the number of tokens used by the GPT model during output, which is a different aspect of the API usage and is billed separately.
If your vector store was created before the release of the v2 API (April 17, 2024), it will be free to use until the end of 2024. After that, it will be billed at the current rates if it has been used at least once in a Run created after April 17, 2024. If it hasn't been used in a single Run between April 17, 2024, and December 31, 2024, it will be deleted to avoid billing you for vector stores you may have created but never used.
For the latest pricing information, you can refer to OpenAI's pricing page (https://openai.com/pricing).
Sources:
- OpenAI Migration Guide (https://platform.openai.com/docs/assistants/migration)
- OpenAI Help Article (https://help.openai.com/en/articles/8550641-assistants-api-v2-faq#h_3cb7daf8ac)
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
rare timber
This means that if I use the gpt-4o model and create, say, 1 million outputs in the process, I will only be charged $15. I understood correctly, didn't I? @foggy forge
This means that if I use the gpt-4o model and create, say, 1 million outputs in the process, I will only be charged $15. I understood correctly, didn't I? @foggy forge
foggy forgeBOT
Let me check the knowledge base for you. One moment! :books:
Yes, you understood correctly. For the GPT-4o model, the cost is $5 per 1 million input tokens and $15 per 1 million output tokens. So, if you generate 1 million output tokens, you would be charged $15 for those output tokens. Please note that this is separate from any charges for input tokens or other API usage.
Here is the relevant information from the OpenAI Pricing page (https://openai.com/pricing):
- GPT-4o: $5 per 1 million input tokens, $15 per 1 million output tokens
Remember that these costs are for the tokens used in the model's input and output. Other costs, such as storage or additional API features, may also apply.
Source: OpenAI Help Article (https://help.openai.com/en/articles/7102672-how-can-i-access-gpt-4-gpt-4-turbo-and-gpt-4o#h_fe7285909c)
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
rare timber
@foggy forge Eğer 5 farklı python dosyamda 5 farklı vector store oluşturursam ama yine de 1 GB'dan az veri kullanmış olursam ücretsiz sayılır mı ? yoksa vector store oluşturmanın limiti var mı ?
@foggy forge Eğer 5 farklı python dosyamda 5 farklı vector store oluşturursam ama yine de 1 GB'dan az veri kullanmış olursam ücretsiz sayılır mı ? yoksa vector store oluşturmanın limiti var mı ?
foggy forgeBOT
Let me check the knowledge base for you. One moment! :books:
Evet, 1 GB'dan az veri kullanıyorsanız, bu ücretsiz sayılır. Bu, kaç tane vector store oluşturduğunuzdan bağımsızdır. Ancak, her bir asistan veya thread için sadece bir vector store oluşturabilirsiniz ve bir org için toplam depolama sınırı 100 GB'dir. Ayrıca, bir vector store'da en fazla 10.000 dosya bulunabilir.
İşte ilgili bilgiler:
- Dosya başına 512 MB
- Dosya başına 5M token
- Vector store başına 10k dosya
- Asistan başına 1 vector store
- Thread başına 1 vector store
- Bir org için genel depolama sınırı 100 GB ile sınırlıdır.