OpenAI Unity Integration

[thorn ginkgo]

Hey everyone! I'm excited to share my latest project: an OpenAI API integration with Unity! This powerful tool brings the power of OpenAI's models right into your Unity projects, unlocking a wide range of possibilities for your games and applications.

Preview Video: https://www.youtube.com/watch?v=3CiwgmEpzYI

Check out some of the incredible features I've implemented:

🎨 Image Generation Features:

• Generate stunning images based on your prompts
• Automatically expand image bounds to avoid cutoffs
• Create various image variants for diverse visual experiences

📝 Text Completion Features:

• Support for most text models, including the powerful GPT-4
• Both prompt and chat formatting available for versatile text generation
• Stream support for real-time text generation

Coding Features:

• Auto generate Unity components with the click of a button
• Edit scripts with a prompt
• Syntax highlighted preview of code generation

🕹️** Unity Features:**

• Automatically replace sprite renderers, mesh renderers, or UI images in-game
• Flexible scripting interface for building your own OpenAI applications
• User-friendly UI for previewing sample scripts in the editor

This integration is a fantastic addition to any Unity project, opening up countless opportunities for creating immersive and dynamic experiences. Don't miss out on the chance to harness the full potential of OpenAI's models within Unity! 🚀

If you made it this far you might want to check out this longer video with a deeper dive on all of the features:
https://www.youtube.com/watch?v=Qafv81J4l84

[lament echo]

Wow this is cool

Code generation for unity while being comprehensive of the context of the project will be crazy

[thorn ginkgo]

It's tough with the current token limits but some form of this is totally achievable. Like sending a slimmed down representation of the hierarchy, and info about all script public functions.

Or, maybe before each request you ask give gpt some high level context and ask it what would potentially be useful to have more information about to solve its current coding task, then shoot it those details with the current task.

For example, just you could give it the directory tree and it could day it would like EnemySpawner.cs to finish its projectile script.

Lots of people out there trying to solve problems this way with pretty cool solutions. Really just want a high or unlimited token limit.

[thorn ginkgo]

Your project looks neat but seems inappropriate to post it on this project page. These project pages are all examples of different ways to implement this amazing technology. This project does some things better than yours but it would be really weird for me to try to advertise that on your page.

Again, cool stuff, just seems a little needless. If anyone finds their way here they would have seen your project too.

[verbal wind]

I just felt like it was inappropriate to charge for something like this, which is why I cross posted. It's a public forum.

[thorn ginkgo]

It's worth downloading and checking out because it offers many useful features beyond being a mere wrapper. I apologize if you feel it's inappropriate to sell, but I've invested a considerable amount of time developing it and believe it provides genuine value to users. Furthermore, I enjoy supporting the product in my free time because I'm passionate about OpenAI and assisting people in solving AI-related problems.

I appreciate your tool as well, but it appears to be geared more toward programmers. In contrast, mine offers a scripting interface and generates code that is specifically designed to be useful for all Unity users, including artists, designers, and others.

[thorn ginkgo]

Wanted to share a small update on HelperBot! HelperBot is a GPT4 powered discord bot I'm using to help support this OpenAI Unity Integration.

https://www.youtube.com/shorts/nbCQr_XhgII

As someone who's built a few Unity Assets in their spare time while juggling a regular job, I know firsthand how challenging it can be to provide timely support and answer questions from users.

To address this, I decided to try something new with HelperBot, which I'm thrilled to say has been working incredibly well so far. Initially, I used GPT3 to power the bot, but I upgraded to GPT4 after seeing much better results on some of the technical questions asked.

Here's how it works: HelperBot is a Node app that uses stored MD files to provide basic support to users. Right now, it consists of two main MD files: one for basic readme information, and another for code samples and function signatures for the public coding interface.

Whenever a user asks a question, I feed it into HelperBot along with the relevant readme or code MD file, if applicable. From there, the bot is able to provide quick and helpful responses to basic queries.

I've had a killer time working on this bot and can't wait to see the future of technical support improve 100 fold with more people moving towards AI solutions!