Looking for fast LLM to use via API -- must be as good as GPT-4 or close | Learn AI Together | Page 1

civic flower Mar 20, 2024, 1:37 AM

#

I need a fast LLM as good as GPT-4 via an API. I can't use GPT-4 via OpenAI because it's too slow, takes >3 seconds for 100 tokens. Are there any faster LLMs that are still as good as GPT-4?

tepid girder Mar 20, 2024, 1:30 PM

#

https://pbs.twimg.com/media/GD-GvESbAAAS24Y?format=jpg&name=4096x4096

3.5 turbo you can go with but right now, no model is closer to GPT4 and can try Azure API

https://gptforwork.com/tools/openai-api-and-other-llm-apis-response-time-tracker

OpenAI API and other LLM APIs response time tracker

The 3 charts below track the response times of the main large language model APIs: OpenAI and Azure OpenAI (GPT-4, GPT-3.5, GPT-3), Anthropic Claude and Google PaLM.

surreal crescent Mar 20, 2024, 1:51 PM

#

civic flower I need a fast LLM as good as GPT-4 via an API. I can't use GPT-4 via OpenAI beca...

What tier are you in?
Higher tiers have faster inference.

#Looking for fast LLM to use via API -- must be as good as GPT-4 or close