#embeddings api is absurdly slow

6 messages · Page 1 of 1 (latest)

cosmic turret
#

I'm using model "text-embedding-ada-002" and the response time is ridicilous. am I the only one? I'm processing 20K rows of 8000 character text. It's been running for hours

haughty halo
cosmic turret
haughty halo
#

What endpoint/API are you using exactly?

cosmic turret
#

from openai.embeddings_utils import (
get_embedding
)

constants

EMBEDDING_MODEL = "text-embedding-ada-002"

haughty halo
#

So is it stuck on get_embedding?