red silo
GPT + MusicGen + Digital Piano
Bring your Piano and become an artist.
The flow is as follows:
- Record MIDI events from your MIDI device as you play.
- Convert the information to ABC format, which is then passed to GPT.
- GPT creates a prompt for the MusicGen model. This is an important step because it means that GPT can reason about the music you just played.
- MusicGen to generate the music given the prompt and what you played, which is used for guidance.
- Meanwhile, GPT generates a creative review as if it was written by "The Rolling Stones Magazine." Think of it as a very creative loading spinner.
fair gale