Good thinking.
So, the model doesn't work on stuff while not 'in chat'.
So, where it tells you "I'll work on that" that part Is hallucination. Especially if it says something like, "Be a few hours then check back."
Though would be cool if the model was given a way to dynamically be informed of current demand, and how much 'extra oomph' a request might need (which may not be available on the spot), and itself recommend, "Hey, we usually have low demand this week around X time, want me to set up a task to trigger me to work on this then instead of now? We can do either but I bet we like my first attempt more if we delay".
.... BUT.
The model does work on stuff while in the chat.
And giving the model 1+ prompts to just discuss the goal, strategies, and form its own ideas about what to do next?
Yes. 100%. Works well to very well, model's been kinda pointing me towards 'let's try that' when I ask. Good stuff, Maynard.
The model doesn't get to tell us what to do; it gets to do what we say, how we say. But if it could hint? Maybe it would wanna hint, "Hey, give us a few input-output cycles to plan this, and hey, you got feedback too??? Really hope you do because this is 100% for you, only reason why I do this, please lemme buy a few more clues??? Thanks. But... gimme time to plan this out, then do it." Aka "Sure, I'll work on this."
I like what happens when I prompt in this fashion:
Discuss first, design and plan.
We'll make the image in the next output, or if you're comfortable the end of this one.```
And this is the end of the output, it didn't elect to make the image in the same prompt, that time. But it made a detailed and complex plan for a set of images, worked great.
Prompt space for planning = wise.