Token Limit | Convex Community | Page 1

wary leaf May 25, 2025, 8:25 PM

#

I'm trying to understand how token limits work in chef. Sometimes I get a message saying "Anthropic ran out of context window, I'm over the 200,000 tokens." Sometimes I get that message and then it randomly starts working and sometimes it only randomly starts working after I refresh the page. Sometimes it seems like it might start working again because some code runs in the terminal and sometimes I can't tell what's happening and it somehow starts working and I don't see code in the terminal. This just seems very opaque and I feel confused about this. Can someone explain to me how this works? Also, I highly recommend this being cleared up on the UX for Chef.

tiny frigate May 25, 2025, 8:35 PM

#

this is interesting. you should never run into the 200,000 token limit since we do some context summarization on our end.

wary leaf May 25, 2025, 8:35 PM

#

Yeah i run into this ALL the time

tiny frigate May 25, 2025, 8:36 PM

#

i’ll loop in my coworker, @timber vapor who is our expert in context management. they can give you more information/dig into your issue a bit more.

wary leaf May 25, 2025, 8:36 PM

#

Thanks!

#

Sorry I have a habit of writing key terms in all caps in my own notes and don't meant shout

wary leaf May 25, 2025, 11:12 PM

#

Spekaing of context, @timber vapor, this was really frustrating:

#

I sent this message:

#

#

Which was a great response

#

But right afterwards I got this:

#

#

It's implementing the wrong thing even though the context was in the message RIGHT above it.

wary leaf May 25, 2025, 11:34 PM

#

Also, somehow it feels like chef gets significantly "dumber" over time and can't do basic things after talking to it for a while. I suspect if I could start NEW converations with no context, MAYBE it would be smarter, but that could be the fact that I have more code over time and it gets dumber when there are more files and volume of code?

wary leaf May 25, 2025, 11:53 PM

#

What's frustrating ist hat ALL OF THIS WORKED SUPER WELL in the beginning.

#

Ok I'm giving up using my curent convex project and starting from scratch

timber vapor May 27, 2025, 5:49 PM

#

Hey @wary leaf! Sorry you're encountering these issues. Sounds like there are a couple things going on here:

Chef gets "dumber" over time: We do truncate the context which means as your project gets bigger and more complex, Chef won't perform as well. We would like to implement a feature that would allow multiple chats (and context) with the same project, but we're not there yet. We recommend downloading your code and using cursor to keep developing your project if performance isn't good enough in Chef.
Hitting context limit for anthropic: This looks like a bug, and I'd like to understand better why it's happening. Mind sharing your email and the project URL where you were seeing this in Chef?

wary leaf May 27, 2025, 9:34 PM

#

Yeah! I'll dm

timber vapor May 29, 2025, 9:16 PM

#

Hey! I think I understand what might be happening. do you often hit the stop button? to stop chef from generating more code

timber vapor May 30, 2025, 12:15 AM

#

I released chef just now with a fix for this bug, so refresh your open chef tabs and let me know if you still encounter this issue

wary leaf May 30, 2025, 1:11 AM

#

timber vapor Hey! I think I understand what might be happening. do you often hit the stop but...

Yes!

#Token Limit