Keyboard/mouse input integration idea

[clear briar]

I had an idea on how to allow neuro to control games in real time (mostly)
You could have an ai model that takes a description of what inputs should happen where and when, and executes that over time. Interpolating things like mouse movements.
She could describe things like “spam spacebar” or “move mouse in a small circle at (500x, 230y)
This would let neuro make decisions at her normal speed while playing some games in real time (low reaction time lol).

[clear briar]

Well, this could be done with a script but doing it with an ai would add more personality, have much more mistake tolerance in the input, and probably allow much more complex outputs with less input.