Demo of GPT-4 powered IDE that creates UI on demand based on prompt

[steady escarp]

We're working on a new kind of IDE where you "code" with just english. I was tired yesterday evening and started exploring an idea "what if IDE could give you the exact UI that you need for your development?".

In the video, I write a prompt that says that I need UI for making mock server requests. This prompt is sent to our backend, fed to GPT-4 which then returns the code for the UI and the IDE renders it.

Demo - https://www.youtube.com/watch?v=ZPpBAwZ0wD8
Original tweet - https://twitter.com/mlejva/status/1641151421830529042

Vasek Mlejnsky (@mlejva)

I present to you:
GPT-4 powered IDE that creates UI on demand so it fits your exact development needs.

Need UI for making server requests? No problem. Just ask for it.

Likes

134

▶ Play video

Twitter · Mar 29, 2023, 6:52 PM

[forest sable]

Awesome demo! I like the concept a lot. Form UI is smart to tackle first. Just a couple clarifying questions I had after watching the video:

1. What are the purposes of the left and right columns of the app? The left side has instructions like you mentioned, but it's formatted differently than a typical textarea you can type in. The right side of the app appears to contain a server side express app route handler or something similar, but I'm not sure of it's purpose.

2. Are you able to configure the format / syntax of the generated UI output? For example, vanilla html vs jsx.

3. To what degree can you control the theme or component styling? For example, will I be able to specify if I want it outputted inline styles, tailwind css, or maybe inline styling etc.

Great job so far, please let me know how to stay in touch with development. Happy to be an alpha or beta tester in the future should you need one.

[restive palm]

Interesting @steady escarp . This is very useful. I have few idea to play around to get Ui/css for a feature base on a prompt. Sure, would love to contribute. Will dm

[steady escarp]

Hey, thanks for the questions.

1. What you're seeing in the video is our new kind of IDE. In this IDE you don't need to write code. Instead, you write docs/technical specs and let an AI agent do the coding job. What you're seeing on the left is a spec for a server route with Stripe checkout. The AI agent's workflow is on the right. The agent has access to tools like writing to file, running code, running commands, using filesystem, etc. It operates in a secure soundboxed cloud environment

Both 2. + 3.: It's still very early idea/exploration so none if your points are there. Not that those couldn't be done but they aren't implemented. We're focused on launching the core functionality for IDE I described above and then we'll start adding things like "just-in-time" UI.

The IDE is open sourced, you can check it out here https://github.com/new-ai-company/ide
(we open sourced it yesterday after a viral tweet from a co-founder of OpenAI that retweet our demo - https://twitter.com/mlejva/status/1641151421830529042, that's why the repo is so bare 😅)

Let me know if you have any more questions 🙂

[urban grove]

This is awesome! I'd be interested how you're tracking analytics for this tool?

[forest sable]

Ah, I get it now. Thanks for clarifying things for me. Your approach is quite creative, and it's great to hear that you were able to capitalize on public interest so quickly. Looking forward to trying it out and seeing how things progress!

[vale fulcrum]

gpt4

[old yarrow]

is this available for ppl to try

yet

[steady escarp]

Thank you!