Like do I put in my prompt the character models of the (recent) player character model and the scene they're in then the scenario then pull it then play the clip? Because, I'm new to simply putting it in the game as a cutscene and Don't know how to start that process
#How to input Sora 2 into my game for custom cutscenes
exotic plinth
vast sandal
Well, this is not really a thing yet. I don't thing anyone has ever implemented something like that. So you'll need to be the first one. Good luck with the research.
Shouldn't be that hard though. You just need to figure out a way to make requests to the sora2 web api(if it exists), and figure out a way to convert the video to a format unity accepts.
azure gust
It uses the regular OpenAI API
https://platform.openai.com/docs/api-reference/videos/create
Sora spits out mp4s so no conversions needed. But you wouldn't call this from a client unless you are having users pay for their own cutscenes. There also seem to be limits to the length and number of videos you can generate. Something like 30 8 sec videos per day.
exotic plinth
It uses the regular OpenAI API
https://platform.openai.com/docs/api-reference/vi...
So have them, essentially opt into the service? And have it be used sparingly
azure gust
The only feasible way this works is if you are running your video generator locally on your servers. Cloud services have API limits and costs that quickly spiral out of control at any kind of scale. You really can't expect your players to provide their own API keys
vast sandal
Yeah, should provide players a choice. Use personal api key and pay yourself, or fallback to a poor local solution.
I don't think this gonna be scalable for video get for maybe tens more years. But text get can already be run on consumer hardware decently. Well, depends on the task I guess...
exotic plinth
The scalability is probably lacking but for what it is... It's a proof of concept so I was able to make it work but there's definitely no drive to use it because I can't just automate it and make a cameo without using code to make the prompt line up and I can only use the player character from my beta testing