Plug and Play: Build a G-Assist Plug-in Hackathon!

[zenith condor]

Hey, yall! Welcome to the Plug and Play G-Assist Hackathon channel!

This is the place to share your creations, have G-Assist hackathon conversations, and get help from the community or NVIDIA experts directly. We’re hyped to see what you make!

[rigid pewter]

Hello people. Whishing all participants best of luck! 🍀

[coarse torrent]

Hey, would you be able to clarify which laptop models people get? And can it be exchanged for a cash prize if for instance one wanted to upgrade a pre existing rig?

I'm assuming the 2nd and 3rd place prizes are also 50 series laptops?

[zenith condor]

Heya. Only the 1st place prize is a laptop, and it’s powered by an NVIDIA GeForce RTX 5090.

2nd place is a GeForce RTX 5080 GPU.

3rd place is a GeForce RTX GeForce RTX 5070.

[coarse torrent]

Thanks for the clarification 😄

And about whether they can be exchanged for cash if we should want to upgrade a different part. Or say I preferred an A6000 for my more professional applications?

Also which laptop is it?

[daring apex]

😎 5090 GPU Laptop .... will this laptop has same 32GB VRAM as 5090 GPU. if the laptop has same horse power as 5090 GPU, there is very cool.

[coarse torrent]

It doesn't have the same horsepower or vram as the desktop counterpart, not even close. And I want to know, is it a Legion Pro 7i, or a ROG, or what? I need the model so I can see what else is in the pack

[daring apex]

This competition entry requirement is not low as G-assist requires 12GB+ VRAM GPU. My only available GPU is Jetson Orin Nano Dev Kit 🤦‍♂️
No HW to test G-Assist ....

[coarse torrent]

@zenith condor ?

[zenith condor]

Sure thing! Thanks for the patience with the slow reply, was out of office for a few days. But some answers for you:

Prizing cannot be exchanged for cash, and there are no customization options for prizing.

As for the laptop, its a Razer Blade 16” with a GeForce RTX 5090. https://www.razer.com/gaming-laptops/Razer-Blade-16/RZ09-05289EN4-R3U1?srsltid=AfmBOorBWT9hbb0oStBMh0it3cyviGP3g2QUKGf-vIGuZrhbJxWvIIUp

[daring apex]

Wow .... this notebook is awesome 😎

[coarse torrent]

Nice laptop, I suppose one can always sell the desktop GPUs 😄

Thank you very much for the response

[daring apex]

@zenith condor I read the Hackathon terms in pdf file. I would like to use G-Assist to develop useful plugin which is not for gaming but another non-gaming meaningful and useful function G-Assist. Can I do this? Or the judging is solely for gaming related?

Captured from PDF file
The Challenge
This contest involves the following challenge:

1. Build a G-Assist plugin that helps RTX users control a broad range of PC settings, from
   optimizing game and system settings

[zenith condor]

Can you share your plug-in idea with me? You’re welcome to DM it to me if you’d like

[daring apex]

Thanks Candra. I sent DM.

[zenith condor]

Just following up here for everyone -- we're excited to see all your ideas for the Hackathon and what plug-ins sound like good ideas to you!

Happy to help with specific ideas and questions about your projects. But to clarify, entries do not have to be related to gaming. They can be about any PC workflow you find interesting or would help you and others 🙂

[lilac yoke]

I cant get acces to G-assist with Nvidia App 'cause my RTX 3080 got 10Gb instead of 12 ?!
Did i need to spoof the app or i cant try g-assist on other way ?

[lilac yoke]

i cant make "gassist run" with you git REPO, so...

[coarse torrent]

Hey @zenith condor what do I do if I don't use social media? And also what to do with the fact that my 4060 has on 8GB of VRAM? Am I not allowed to compete, or is it just the app won't run, or will run very poorly without the VRAM?

alright, I think I see an answer in another thread. I can build a plugin, but not test it without a 12GB card?

[lilac yoke]

Ok, g-assist found, let's play with sura...

[zenith condor]

Hey Serda, just checking in -- you were able to get everything to work?

[lilac yoke]

to be fair, i grabbed the nvtopps folder on a compatible g-assist systeme, and i try with the standalone sura, for the moment, it's work 😉

[quiet oar]

What kind of things everyone working on?

[daring apex]

Working on how to get the G-Assist on. I cannot meet the system requirements 🤦🏻‍♂️

[lilac yoke]

i got the g-assist from a compatible system to test it, idk if i can share this, or dev can give us something to try 🙂

but u can put this : https://github.com/NVIDIA/G-Assist/tree/main/api/bindings/python
& plug llama3 to try & simulate g-assist ❤️ (llama3-7B 8-10Gb of VRAM)

[lilac yoke]

@zenith condor can i dm ? got few question about plugin and idea :p

[zenith condor]

Sure, feel free to DM

[signal hull]

Has anyone else encountered Plugin {plugin_name} took too long to respond.? I'm getting this, but I'm seeing a successful response in my plugin log file. I'm not sure how to debug this.

[signal hull]

Fixed! ✅ I was missing <<END>> at the end of my JSON message

[lilac yoke]

Done ❤️

[daring apex]

Will the "RTX AI Workshop: How to Build A G-Assist Plugin" video available on YouTube?

[daring apex]

I have a tech question. I followed the instruction to run setup and build the exe from examples/weather. I got the weather plugin exe file. But I tried to pass input data to it but the exe does not provide the output to me. May I know if I can verify the exe along without having G-Assist integration. I would like to verify and isolate the problem. This is the example code from examples folder /weather.
Thank you for your help in advance.

[lilac yoke]

did u try something like this ?
echo '{"tool_calls":[{"func":"shutdown"}],"messages":[{"role":"system","content":"Close the plugin."},{"role":"user","content":"Shutdown."}]}' | .\dist\g-assist-plugin.exe

[daring apex]

Just tried. I wonder if my build exe having problem or not. The exe halt and I have to clt-c to break it.

C:\code\g-assist-hackathon\G-Assist\plugins\examples\weather>echo '{"tool_calls":[{"func":"shutdown"}],"messages":[{"role":"system","content":"Close the plugin."},{"role":"user","content":"Shutdown."}]}' | .\dist\weather\weather-plugin.exe
Traceback (most recent call last):
File "plugin.py", line 270, in <module>
main()
File "plugin.py", line 163, in main
command = read_command()
^^^^^^^^^^^^^^
File "plugin.py", line 216, in read_command
logging.error('Error reading from command pipe')
File "logging_init_.py", line 2115, in error
File "logging_init_.py", line 1518, in error
KeyboardInterrupt
[PYI-9532:ERROR] Failed to execute script 'plugin' due to unhandled exception!

[lilac yoke]

for the exemple:
`def shutdown(params=None, context=None, system_info=None):
return {"success": True, "message": "shutdown"}

COMMANDS = {
"shutdown": shutdown,
# other command
}

SHUTDOWN_COMMAND = "shutdown"
cmd = ""

while cmd != SHUTDOWN_COMMAND:
input_data = read_command()
cmd = tool_call.get("func")
func = COMMANDS.get(cmd)
if func:
response = func(params, context, system_info)
write_response(response)`
and, done, command shutdown working ❤️

bonus tips, if you want ctrl+c to be clean:
except KeyboardInterrupt: logging.info('Plugin stopped by user (KeyboardInterrupt). Exiting cleanly.') sys.exit(0)
❤️

[daring apex]

Really appreciated to your help 👍
Let me try it again

[lilac yoke]

No problem ❤️

[zenith condor]

Yes! It will be 🙂

[daring apex]

Interesting question on submission form 13. What NVIDIA hardware did you test your plug-in on? * 😅

[forest dome]

Hi everyone! I'm here with the G-Assist engineering team, and we'd love to help answer any questions you have about your G-Assist Plug-in hackathon submissions. We'll be in the channel until 2pm PT or so. Feel free to @ me in your questions and I'll make sure we get the right people looking.

To kick things off, we had a few questsions from last week's workshop we didn't get a chance to answer. Sharing those below:

what is the best way to test your plug in if your laptop dosent meet the g-assist system requirements?

It's hard to test the plugin if you can't run G-Assist, sure. Maybe a friend can help. You can find system requirements for G-Assist here: https://www.nvidia.com/en-us/software/nvidia-app/g-assist/

That said, laptop support is coming soon. 🙂

Does G-Assist support multi-gpu on the backend? Ex: If I have multiple GPUs in a target system, will they be utilized? *If this is supported, with things like the LLM, and ASR models run on run concurrently on the different GPUs?
Multi-GPU is not currently supported by G-Assist. But we appreciate the feedback.

[astral raptor]

Hey @forest dome ! I was trying to install the g-assist app so i can try my plugin but i ended without any sucess. Can you guide me how to install(i have an 4090)

Btw i have submited the plugin as it was 🤣

[daring apex]

I just completed. And I am thinking to submit it today or submit it on the deadline date.

I worry is my project will be cloned and submitted by another ppl 😅

[forest dome]

Installing G-Assist is pretty easy.

• Download NVIDIA App.
• On the Home page in the Discover section, there should be a card with G-Assist on it.
• Click the GET button and the download should start

[forest dome]

Glad to hear it's done! We can't wait to see what you submit. 🙂

[daring apex]

That is a G-Assist Plugin 😎 for non-gaming use.

[astral raptor]

it just doesn't appear, dont know if i made something wrong

[forest dome]

You're on desktop?

[slim wraith]

hey there folks , i have a question :

• i want to build basically a plugin that changes the keyboard color based on financial news / releases + runs a model called amazon/chronos for forcasting , but i'm afraid the "theme" is kind of adultish , meaning is like financial time series forcasting for equities actually palatable to the competition ? my main idea is that someone that's deaf couple basically get cool alerts , but i dont really want to be "that guy" and spend a lot of time on it if it's out of the question sort-of-thing

[daring apex]

I spent almost a day to prepare the video with the voice over. Even that is AI TTS. It takes time.

[astral raptor]

laptop

[forest dome]

That's why. G-Assist does not yet support laptops. Laptop support is coming soon.

[slim wraith]

i thought that was the whole idea lol , far out far out

[astral raptor]

lol, I ended up sending it without testing anyway, thx for your attention 😄

[forest dome]

The G-Assist Plug-in Hackathon doesn't have any restrictions in terms of plugin "theme." Non-gaming use cases are fine.

[slim wraith]

but i want to win 🙂 hopefully i can 🙂 fingers crossed , thanks for the advice

[forest dome]

Appreciate all these questions so far. Keep 'em coming!

[slate sedge]

@forest dome do all the submissions get a feedback?

[forest dome]

Not automatically, no. But we're here to give you feedback now if you'd like.

[astral raptor]

Will the results be public? Once posted, can we ask for feedback?

[forest dome]

The winners will be announced as part of the contest. In terms of feedback, you can always share your project here for feedback -- not just from us, but from the community too.

That's why this discord's here. 🙂

[astral raptor]

Also, can you give us a spoiler about what else Nvidia is building for us?

[forest dome]

I cannot. 😄

[astral raptor]

i hope someone make a plugin to order pizza from g-assist

"hey g-assist, if my gpu reaches X percentage of usage, order a peperoni pizza form me"

[daring apex]

This is not difficult. I believe you can make it. And then, share it 😅

This is just an API call ....

The challenging part is having enough money in your wallet ...

[astral raptor]

so, what if we connect with a mcp with a LOT of tooling for every simple thing ever?
order food, items, lock dors and etc...

for be honest the first time i saw the hackaton page i trough that any plugin could be maked, even with microphone inputs...

started to make a realtime audio censoring but i gave up

[forest dome]

Why'd you give up? Just curious.

[slim wraith]

lol last question because i've been super busy (same as everyone?) and folks are asking for feedback : when is the deadline ?

[forest dome]

5:00 PM Pacific Standard Time on July 16, 2025

[slim wraith]

wish me luck 🙂 🙂

[forest dome]

Good luck!

[slim wraith]

and good luck to all the submitters ! btw if someone (competent) with interfaces wants to help me make the trading news plugin , lmk 😉

[forest dome]

We had one more question from last week's workshop that we have an answer for. Just sharing for everyone:

I'm making a few network requests in my function that take some time to finish, and sometimes I'm seeing a timeout (Plugin took too long to respond). Is there currently support for partial updates to avoid the timeouts I'm experiencing? Are there examples of this? I saw some related code in the rise python bindings

Yes, partial updates are supported. You can send a JSON response via the ""write_response"" function; just don't include the ""success"" field. There is a 10 second timeout we allot for plugin responses, so make sure you send them before that times out. Every response resets the timeout.
Example:
write_response({""message"": ""Still processing network request...""})

[slim wraith]

via dm (i'll be getting this done next two days)

[signal hull]

Thank you for answering this one @forest dome ! (that was my question!)

For now I have a workaround where I use threading for long running tasks and I'm able to return immediately. That makes sense, good to know about the timeout reset! 🙏

[forest dome]

Glad we could help!

[astral raptor]

lots of things to do in a short space of time (I started Saturday night)

Maybe I'll opensource this, I've done some things but there are still many more to do, echo filter, improvement in the audio buffer for transcriptions, UX, latency improvement (I'm getting approximately 2s of latency initially)

[forest dome]

Hi y'all, the team's gonna have to move on to some other meetings, but we really appreciate all the questions and comments here.

Please keep the questions coming. I'll share them with our engineers and we'll do our best to help. Thanks everyone!

[coarse torrent]

will us laptop users get a chance at winning prizes in like a second competition?

[lilac yoke]

push it, and let see 😉

[sly roost]

Hi all, the web page now showing "from June 17 to July 20." Has the deadline changed?

https://developer.nvidia.com/g-assist-hackathon

[hollow sierra]

I also assume that the deadline has changed; the date of the 20th also appears in the terms and conditions.

https://developer.download.nvidia.com/licenses/NVIDIA-G-Assist-Hackathon-Contest-Terms-and-Conditions.pdf

This is a good thing—developing an effective and relevant plugin is not as simple as expected!

[slim wraith]

https://developer.nvidia.com/g-assist-hackathon/submit this link is not working for me (chrome:latest , windows11 , paris, france)

aaaand now it works totally fine , which is surprising and nice

[lilac yoke]

Submission done! Let’s goooo 🔥

[zenith condor]

Yes, its now the 20th. Glad to hear more time is helpful! Excited to see what you develop 🙂

[zenith condor]

Sweet, glad its working!

[daring apex]

Just submitted 😅

[astral raptor]

https://github.com/eletroswing/mutecore

@lilac yoke

@forest dome

[lilac yoke]

Hell yeah !!! try to finish it, and push it !! let's goooo !

[signal hull]

Hi @forest dome, I'm following up on my issue with the plugin response timeouts. I was able to send intermediate progress updates by leaving out the success: True parameter in write_response, but it looks like I'm still getting stuck at the 10 second timeout.

The message I'm getting says: Plugin {X} took too long to complete its response. I'm doing local image inference with the flux NIM, and the request takes about 20~30 seconds to complete. Is there any trick to getting the timeout counter to reset within a single request to G-Assist? I might have misunderstood how the timeout reset works.

[forest dome]

Hmm, interesting. Let me take this to the team and see if we can figure it out.

[coarse torrent]

@forest dome

I'm also going to assume therefore, as I am on a laptop, there is no point in competing

[forest dome]

Unfortunately G-Assist doesn't currently support laptop GPUs. That support is coming soon, but you'd have a hard time testing unless you have a friend who has a desktop system you can try it on.

[coarse torrent]

how many entires do you already have?

[gritty bronze]

@zenith condor Hi! Can G-Assist plugins draw on NVIDIA Overlay?
Developing a G-Assist plugin that requires visual feedback. Is there an API to render custom graphics
On the NVIDIA Overlay (where the FPS counter appears), instead of creating separate overlay windows? The current plugin manifest only supports command definitions, not UI elements. Any guidance appreciated!

[forest dome]

No, G-Assist can't draw onthe Overlay at this time.

[slim wraith]

i need a friend for this to build my submission without breaking the bank on cloud , does anyone have a few minutes to help me out with a remote or even to run the build commands on their end and push ?

we can cut the main prize in half with a saw if we win np 😉

[lilac yoke]

💪

[lilac yoke]

ho boi... what a gift !

[lilac yoke]

this damned <<END>> , lmao 🤣

[slim wraith]

hey hey hey , so i'm wrapping up and submitting but basically the app is like 17GB lol so that's not really going to make it on my free github accout, hopefully i can share the spec and instructions in the readme

the app itself is still less than 10K loc but basically when it gets wrapped up the plotting and databases get quite heavy, also there's all of torch , triton , transformers and full model(s) in there lol, but at the end of the day that's the tradeoff you make for a fully local app 🙂 i saved a lot of space just using the default nvidia sla model i think , so there is that 🙂

[glad cedar]

Just submitted LoreMaster for the #AIonRTXHackathon.
Really glad the deadline was extended — I only found the hackathon on the last day and built this in under 24 hours.
I hope the source code helps other last-minute folks cross the finish line too. Good luck!

GitHub: https://github.com/mwtuni/loremaster
Demo video: https://youtu.be/gzQvNmVxp_8

[glad cedar]

I had a similar issue with my LoreMaster plugin (as rendering the speech took longer time than allowed). I resolved it by playing speech in a thread. See my source code for example, posted on this channel

...also in your manifest.json you should set persistent to true (for the timeout issue)

[signal hull]

nice, yes I think that's a good way to go for tasks that take longer. the flux NIM that I used in my plugin takes about 30 seconds to generate images so I also used the threading pattern 🙌

[daring apex]

Congratulations to all submissions 🎉🎉

[glad cedar]

My 1-day LoreMaster plugin is still quite young — built it just in time for submission — but I’m already adding some killer features post-hackathon: a hybrid local LLM setup for private conversations and a VLM (llava) for game context.

To avoid interfering with judging, I’ve frozen the main branch to reflect the original submission and will continue development in a separate dev branch.

Is this the common practice in hackathons — freezing main and continuing on a dev branch post-submission? Curious how others are handling it.

[daring apex]

I don't know why I tried to run weather plugin example in G-Assist, it has no response. Does anyone has idea?

Typical G-assist function are working good.

I guess that is some permission problem about G-Assist but I have no clue where can I find the issue or enable G-Assist debug info.

Not the plugin issue as I just test the example from G-Assist folder in my newly setup Desktop.

[lilac yoke]

log ? 😉

[daring apex]

No luck. I sent email to NVIDIA to get help 🤦‍♂️

[lilac yoke]

damn....

[glad cedar]

I would recommend to check "list plugins":

[forest dome]

@daring apex saw your email, we're looking into this.

[daring apex]

Thanks Cory 👍

[daring apex]

Thanks mwtuni 👍
List provider is OK and showed the list correctly.

[daring apex]

I found out the problem finally. G-Assist plugin cannot work with Remote Desktop.
I setup a new Windows to test and I am sitting in front of the Physical Desktop. I run the example. it works.
Then, I enabled the Remote Desktop accessing remotely. Not working.
I tested it in front of the desktop again. It works. 😅

[slim wraith]

omg who one this one i wonder, it was a tough one for the build !

[forest dome]

We haven't announced winners quite yet. There's a bunch of good options. 🙂

That said, we did just launch our new plugin portal with mod.io. We'd love to have you add your hackathon submissions here! https://mod.io/g/g-assist

[gritty bronze]

https://mod.io/g/g-assist/m/aria-avatar-companion I forgot to add .zip file to github release page. is that counts?

[daring apex]

Any result yet 😅

[glad cedar]

They're too busy running all those awesome plugins

[daring apex]

Keep chatting with Aria and generating image 😂

[glad cedar]

Jailbreaking Aria to be a soulmate

[slate sedge]

@forest dome any updates on the results? Thanks!

[forest dome]

No updates yet. We have finalists and I need to reach out to them. I'm on it, y'all. 🙂

[slim wraith]

i havent recieved my victory email yet, so dont be shy to just send it 🙂

[forest dome]

lol!

[slim wraith]

any update?

[cursive ridge]

@forest dome any updates on the results? Thanks!

[sturdy stag]

Hello, any updates please?

[slim wraith]

@forest dome it's been a while though, huh ? let's lock this in ?

[forest dome]

#rtx-ai-pc-announcements message

[slim wraith]

heartbreaking + congrats to the winners !

[gritty bronze]

congrats!

[forest jackal]

Hi, I'm working on a plugin for the home automation hackathon. Idk if this is the right place to ask programming question, but here goes. When the plugin gets a query it check if any initial setup needs to be done and if so executes that. I have "persistent" in mainifest.json set to true. I assumed that setting that to true, means the process stays alive and thus any subsequent requests will still be in the same process meaning that all state in the RAM is still there. Instead I see that the main function is called every time.

[frozen maple]

^ I'm also wondering this.

Also, does the manifestVersion do anything? Will g-assist not pull in my updated manifest unless I bump the manifestVersion, or will it load on startup every time regardless?

[spice vortex]

On my platform, the initialize method function is never called so I do a check anytime the script starts. The shutdown command is called. The "persistent" setting is respected which means that the host keeps the plugin process alive and it reads commands through a loop.

I haven't messed with manifest version but I have to restart g-assist to clear out the persistent plugin process in between updates.