API lantency? | Google Developer Community | Page 1

mortal storm Jun 3, 2024, 2:22 PM

#

I'm not using streaming

void prawn Jun 3, 2024, 2:22 PM

#

What model are you using?

#

And how big is your prompt?

mortal storm Jun 3, 2024, 2:22 PM

#

1.5-pro-latest

void prawn Jun 3, 2024, 2:23 PM

#

Ok, I wouldn't be too surprised by those kinds of numbers from 1.5 Pro. You may want to see if 1.5 Flash meets your needs. (Faster and cheaper.)

#API lantency?