I imagine others have noted this but while it's generating, you can't scroll up to look at the response, because it keeps bringing you back to the bottom when it generates the next word.
This is likely to keep all of the generation in view, as more words are generated.
But, if a user intentionally scrolls up while text is being generated, then it should stop trying to scroll to the bottom for the duration of that request.