#foveated rendering

371 messages · Page 1 of 1 (latest)

nimble iron
#

See original post in wrong category https://discord.com/channels/507304429255393322/1259255548734472233
We are hiring Dev to help. I already made a mod to downscale the FPS (see original post) just need Dev to help put together a mobile app with off the shelf solutions for eye tracking and then send coords to pc via usb.

This will allow users to greatly increase FPS and will be very popular as all they will need is a phone with a camera that can see their eyes in detail which almost everyone has. We will add capes similar to optifine.

Ideally just 1 Dev and we split the money 50/50

#

@ember wigeon @coarse juniper

coarse juniper
#

Whos ready to make some bands off our premium mod? I'm already looking at some iced out bart simpson chains

nimble iron
coarse juniper
#

I'm on episode 2 right now of Java programming tutorial, im hoping by tonight ill be ready to program this

nimble iron
#

And especially with chatgpt he can code most of it anyway

coarse juniper
#

oh yeah true, ill just chatgpt it all

#

theres no point of even learning programming with chatgpt

#

I can focus on growing our company and making sales while chatgpt automates all of our programming

#

whats my first task? what do you need coded?

ember wigeon
# coarse juniper I'm on episode 2 right now of Java programming tutorial, im hoping by tonight il...

This is a good video to get you started https://youtu.be/xk4_1vDrzzo

Java tutorial for beginners full course
#Java #tutorial #beginners
⭐️Time Stamps⭐️
#1 (00:00:00) Java tutorial for beginners ☕
#2 (00:20:26) variables ❌
#3 (00:32:58) swap two variables 💱
#4 (00:36:42) user input ⌨️
#5 (00:44:40) expressions 🧮
#6 (00:49:13) GUI intro 🚩
#7 (00:55:01) Math class 📐
#8 (01:01:08) ra...

▶ Play video
#

Not that long either luckily

coarse juniper
#

is there anyway i can just feeed the video into chatgpt and have it learn all of it?

#

or is there anyway to set utube to play a video at like 60x or 100x speed

ember wigeon
fallow finch
#

using AI to do the work will not work
sure it'll be able to do a basic thing
but as soon as it'll become harder it won't be able to do it
by skipping the easy part of learning you'll justr make it impossible for you to do the hard part

ember wigeon
#

Should be very good

coarse juniper
#

oh look we already got our first hater

fallow finch
#

just take the 8h or whatever to learn the bases or java and you'll have what's needed to create mods and learn and refine

coarse juniper
ember wigeon
fallow finch
# coarse juniper oh look we already got our first hater

i literally use ChatGPT and GH Copilot
all i'm saying is it can't be the pilot
if it's the pilot it will F up
it is a very good copilot as long as you pilot tho
AI is a very powerful auto-completion, but if you don't know what you want it to autocomplete it can't do anything good for you

ember wigeon
#

Maybe in 2022

coarse juniper
#

this dues trying to throw us off by making us actually program when we can just have chatgpt do all the work

ember wigeon
#

But that is not the state of the art

#

We have good AI now

fallow finch
#

sure gl then
you'll realize your mistakes later, but it's fine mistakes are needed to learn

ember wigeon
#

Now, back to business

coarse juniper
#

dont need luck

#

but thanks anyways

#

where do ipaste this code on mondrinth?

fallow finch
# coarse juniper

you are not sharing the good code here, just that it can answer
anyway

coarse juniper
#

this is a paid mod

fallow finch
#

🤦‍♂️

ember wigeon
whole socket
#

If it is purley AI generated I think at least according to european law it's not your company asset

ember wigeon
#

Oh sorry

#

Wrong reply

coarse juniper
ember wigeon
coarse juniper
fallow finch
#

i mean last thing before i leave since it exist

#

!!chatgpt

shut depotBOT
#

Whilst LLMs (Large Language Models) like ChatGPT and Gemini are impressive tools, **they are not recommended for first-time Fabric mod developers due to their inconsistency and potential for generating inaccurate code. **

LLMs may generate incorrect code that:

  • Targets the wrong Minecraft version, leading to outdated or incompatible features.
  • Uses incorrect mappings, causing errors or unexpected behavior.
  • Is designed for the wrong loader (NeoForge vs. Fabric), resulting in incompatibility.
  • Relies on non-existent Fabric API modules, creating code that references features that don't exist (called LLM hallucinations)

It's crucial to remember that LLMs should be seen as problem-solving aids, not code-generating machines. The output they provide often requires significant modification and understanding of Java before it can be implemented as a functional mod.

Therefore, learning Java is an absolute necessity before attempting to use any LLM-generated code in your mod. Knowing how the generated code works is key to using it effectively and fixing any problems that may arise.

coarse juniper
#

bros spamming us now

fallow finch
#

and on that note, good business

coarse juniper
#

bros that mad we have a sucessful team of skilled people hes gonna spam us

#

sad

#

!!hatesdontphaseus

shut depotBOT
#

@coarse juniper: Unknown tag, use !tag to see all available tags

coarse juniper
#

also that only lists chatgpt and gemini, doesnt say anything about copilot or claude as those dont havde those issues

nimble iron
#

I was impressed it knew what changed

coarse juniper
#

yeah i got a CS degree using chatgpt

#

and i didnt even really need to show up to classes or anything or even know how 2 code or math

#

i just google answered and chatgpt, simple

#

its the future

nimble iron
coarse juniper
#

you have the ai do the nerdy grindy work while you focus on making bands, networking, success

#

thats that growth mindset the haters dont want you to kno about

coarse juniper
nimble iron
#

Lol

#

I couldn't figure out how to sign up on curse forge I think it's broken rn

midnight pond
#

Ahh yes, making yourself stupid is a great idea

coarse juniper
#

uh oh

#

hater #3 already

midnight pond
#

Even useless

coarse juniper
nimble iron
#

I have aspergers too :3

midnight pond
#

Tell a LLM to make you food

coarse juniper
#

that will be something very real in less than 3 years

#

and im here for it

#

please keep the discussion relevant to the mod tho, if you come here just to hate plz keep ur negative energy to rurself. we are out here making only big money moves

#

premium curseforge mod

whole socket
#

permium mods are not allowed

coarse juniper
#

donation curseforge mod*

#

I mistyped

#

its a donation

nimble iron
nimble iron
#

Mod is already free to download

coarse juniper
#

its just some legalize to keep all the neckbeards at bay

whole socket
#

physics mod did the same

#

till they got a mail from mojang

nimble iron
coarse juniper
#

i dont have a mailbox

nimble iron
#

Why hasn't optifine been shutdown

coarse juniper
#

so that wont happen to us

nimble iron
#

Or any other client with capes

coarse juniper
#

dudes just hating

nimble iron
#

Lol

coarse juniper
#

he doesnt like to see more succesfull people with great ideas innovate the mod space

nimble iron
#

Jenny mod is also payed (for latest release iirc)

whole socket
#

I will see you when you innovate the mod space 😛

nimble iron
#

:3

coarse juniper
#

already on it

nimble iron
coarse juniper
#

yeah we are getting major traction and publicity, kinda blowing up rn

hearty urchin
#

I mean idk about you

nimble iron
#

Oh

#

Idk why it says under review

hearty urchin
nimble iron
#

That's cool so many people found it useful already I didn't even advertise it yet 😊

nimble iron
#

Sorry I'm so dumb

coarse juniper
#

trying to figure out which car to get once the premium donations startrolling in

#

stuck between these two right now

nimble iron
#

But I will also want to attach jet engines and wings if I get rich enough

#

But unlikely to happeb

silent light
#

If we pretend nobody else has said anything here.
This mod idea is very complex to do. You would need a skilled rendering dev, and a large change to the rendering engine.

It sounds like you want to decrease the fps rendering except specifically where the person is looking.
The only way to do this currently would be to shove every frame into a framebuffer. Than only update a specific part of that framebuffer. Which is slower.
However it would let you do more optimizations like reducing the frustrum and culling areas.
Which personally I don't think would help mitigate the performance that much.

mighty copper
#

And even so, there is minimal performance gain as FX said since Minecraft is already using very simple gemotery so this kind of culling wouldn't help much.

tulip compass
#

I feel like the potential performance gained by only rendering part of the screen at full FPS would be entirely negated by the processing the user's computer would need to do to determine which areas of the screen should be affected..

mighty copper
#

For realistic VR games this approach would be possibly useful.
But in that context the rendering would be probably already developed for that, and we need to take the hardware into account as well.
VR headsets does not use a single camera for eye tracking but rather a few of them in very well constructed angles so calculating what you are looking at is more accurate and easier, but this requires application specific hardware.

brittle python
#

(I don't know about you, but this kinda felt a lot like a troll thread to me)

nimble iron
#

from my testing with lower resolutions, it can significantly increase FPS

silent light
#

You don't understand. You can't simply rend the game twice

nimble iron
silent light
#

It's basically the same performance to renderit at 144p and 1080p. The only difference is the internal buffers of the graphics card.
In reality its actually going to be a lot slower than you think. Since GPU's are really slow at rendering in low resolution

mighty copper
nimble iron
silent light
#

Yes there is a difference. However it doesn't scale

tulip compass
#

Everything else aside, eye tracking is just a... not very well developed technology.
It is practically impossible to get decent eye tracking with even high end PC webcams and AI software like NVIDIA broadcast, so that's out.
Google's ARcore face tracking is also horrible, and it doesn't even support eye tracking, so that's out too.
Apple's ARkit is decently suitable for this, its face tracking is good and it's fairly capable of eye tracking, but I still would not say it's good enough for this. And it's only high enough quality to be usable on the iPhone X and up thanks to face ID, so that's a decently high barrier for entry.

silent light
#

GPU's are terribly slow at rendering any triangle that fits within 2x2 pixels. Rendering the game twice, once at 144p and once at native. You will see a drastic performance hit

mighty copper
#

This technology could be and would be useful in VR, but not in single flat displays.
It would be easier to just upgrade your hardware to render Minecraft at a decent framecount.

#

Not counting in the possible setup chores, fees etc

silent light
#

It would be much easier to just optimize the terribly written rendering engine.
Which is what im doing

mighty copper
#

I agree

tulip compass
#

if this isn't a troll post, it's a pipe dream. No sane developer would waste their time on something like this, at least certainly not for Minecraft.

mighty copper
silent light
mighty copper
silent light
#

Not the source tho

mighty copper
#

Ah, still interesting, anywhere I could possibly get updates?

fallow finch
#

ok so how do i run vineflower again /j

silent light
fallow finch
silent light
#

Won't be there either xD

mighty copper
#

You work for moonsworth?

silent light
#

Ya

mighty copper
#

Oh i see

#

Good to see some care for MC's render pipeline

silent light
#

I've been working on an optimization for months thats going to completely change the performance of the game without any visual changes.

#

First version of it will be coming out soon. Under the name Turbo Entities

mighty copper
#

Nice

nimble iron
#

done on 1050 ti

#

also this can be used with shaders

#

which is good as I can't afford a new gpu im stuck with 1050 but still want to use shaders

mighty copper
#

At this point it's just a trade-off between resolution and fps.
I get the appeal to have more fps, but i'd rather have lower fps than look at a bad jpeg compression like output.

nimble iron
#

yes thats why we wil use foveated rendering

#

so it looks like 4k to the user

silent light
#

You will notice exponentially the smaller you go, the less the impact. Since than the framebuffer writes are no longer the bottleneck.

nimble iron
#

even though most of it can be like 144p

silent light
#

Also newer gpu's are no longer bottlenecked by screen size. These days its more or less the vertex count per pixel that actually decreases performance

#

The technique you should be using to decrease that effect is LOD

mighty copper
#

In my opinion LOD here would have minimal use, especially if it's inside your close vision.
LOD is already proven in MC but for huge render distances, take for example the FarPlaneTwo mod.

silent light
#

The list of things that need to be optimized in minecraft is ridiculous. Just implementing mimapping for entities would give a performance boost

mighty copper
#

Yes there are many parts of the rendering that would give a huge performance boost overall if fixed

#

Fortunately Mojang does not care about it

#

If anything the rendering has become exponentially worse throughout the versions.

nimble iron
silent light
#

If the system is design that way from the ground up, yes. Otherwise no

mighty copper
nimble iron
silent light
#

Have fun

nimble iron
#

:3

#

ty

mighty copper
#

How would you solve the camera problem?
Just interested, even USB is terribly slow for this kind of application.

#

I know you mentioned using phones for tracking but they are nowhere enough for this.

nimble iron
#

125 microseconds latency

#

i even use usb for keyboard and mouse the latency is not noticable

#

i think its what its meant for lol

gentle moon
#

Have fun my friend.

#

AI thoosies try to make a performance mod circa 2024

mighty copper
#

Yeah, I wish best of luck for this, I'm out of here too

nimble iron
nimble iron
nimble iron
#

still looking for devs for this !

coarse juniper
#

am I being fired?!

#

this is a rough way to find out im being let go.

#

will I at least get some sort of severance package?

nimble iron
#

no you stlil haven't dmmed me

#

well anyway you don't even know how to code

#

this task will take an experienced dev

#

whos looking to make a lot of money

coarse juniper
#

wow

#

now you are just rubbing it in

#

please my kids need to eat, this isnt funny dude. let me back on my senior full stack developer role...

inner peak
#

what is going on here

jade wave
#

bait

violet sand
#

what did I read....

coarse juniper
#

faken news

#

hater detected

coarse juniper
#

old enough that i already ahve most of the mod done, didnt even need to learn java just did chatgpt

#

already have accurate eye tracking through my android using a minimal amount of processing power and have it so the mode dynamically is downscaling certain areas of the screen'

#

currently looking into hiring a lawyer to see how I can get around licesncing to make this a paid mod

gentle moon
#

!!llms

shut depotBOT
#

@gentle moon: Unknown tag, use !tag to see all available tags

gentle moon
#

!!llm

shut depotBOT
#

Whilst LLMs (Large Language Models) like ChatGPT and Gemini are impressive tools, **they are not recommended for first-time Fabric mod developers due to their inconsistency and potential for generating inaccurate code. **

LLMs may generate incorrect code that:

  • Targets the wrong Minecraft version, leading to outdated or incompatible features.
  • Uses incorrect mappings, causing errors or unexpected behavior.
  • Is designed for the wrong loader (NeoForge vs. Fabric), resulting in incompatibility.
  • Relies on non-existent Fabric API modules, creating code that references features that don't exist (called LLM hallucinations)

It's crucial to remember that LLMs should be seen as problem-solving aids, not code-generating machines. The output they provide often requires significant modification and understanding of Java before it can be implemented as a functional mod.

Therefore, learning Java is an absolute necessity before attempting to use any LLM-generated code in your mod. Knowing how the generated code works is key to using it effectively and fixing any problems that may arise.

coarse juniper
#

first off, please dont spam the discussion

#

secondly, that applies to people who aren't certified prompt engineers

#

(aka noobs)

gentle moon
#

I'm not spamming the discussion, I am providing very essential information.

coarse juniper
#

thats already been posted LOL

#

you aren't at all

#

you are being a noob

#

please- do not spam

#

final warning

gentle moon
#

ChatGPT wont be able to solve incompatibilities between your mod and other mods.

misty badge
#

this guy is baiting or 12 just let him be stupid

gentle moon
#

It's not god.

coarse juniper
#

yeah it will

fallow finch
coarse juniper
#

its all good if you guys are jealous that im saving time and AI is currently killing it on programming this mod

gentle moon
coarse juniper
#

but please, dont spam me

#

you have to engineer the prompt, you cant just say anything and expect perfect results. that is where the skill comes in

misty badge
#

tbh best thing chatgpt has been for has been helping me understand code that i don't

coarse juniper
#

(a skill you all clearly do not have)

misty badge
#

but im a dummy

gentle moon
#

Good luck getting this approved on Modrinth or CurseForge, they intensely validate claims of optimization mods.

coarse juniper
#

give it up dog

#

you lost

gentle moon
#

And considering FX, a literal developer who has over 4 years of experience in creating optimization mods, says this is going to do jackshit, you should probably heed their advice.

coarse juniper
#

"w-w-well its not gonna get on curseforge w-w-ell well chatgpt bad" dude just accept it. its going to be an amazing mod lmfao. its stupid you would waste all this time being jealous

misty badge
#

just do drugs sebastian its a lot more dopamine than whatever this is

coarse juniper
#

go make your own mod kid

#

I win

coarse juniper
# gentle moon And considering FX, a literal developer who has over 4 years of experience in cr...

While I appreciate FX's experience in creating optimization mods and value their input, every project and its requirements are unique. While FX may have a valid point from their perspective, it's important to remember that different approaches can yield varying results depending on the specific context and goals of a mod. Therefore, it's worth exploring and experimenting with different solutions to determine what works best for this particular project. Innovation and progress often come from challenging established viewpoints and trying new methods.

gentle moon
#

You got gpt to write that huh?

#

Can't read english, cant write english, what's next? Cant take feedback?

coarse juniper
#

Actually, I wrote it myself. While I did get some insights and suggestions from ChatGPT, it's important to consider various perspectives and find what works best for our specific situation. Getting different viewpoints, even from AI, helps ensure we make informed and well-rounded decisions.

#

Me: 1
You: 0

#

womp womp

coarse juniper
#

@nimble ironWe will likely need to get an HR person, I can't be both the developer + handling all the trolls

#

let me know if thats in the budget

gentle moon
#

HR lmao

coarse juniper
#

...?

#

we aren't allowed to have a company structure now? ok...

#

interesting... looks at all the other succesful coorporations pulling in $$$$$$$ that have a company structure

violet sand
#

this has got the be the most cringe thing I've read since I stopped reading reddit...

coarse juniper
#

you should read your own bio on discord

past gazelle
#

what is this even supposed to be

#

I don't understand

#

How does eye tracking and sending coordinates increase your framerate

#

just what

gentle moon
#

it's worse lol

violet sand
coarse juniper
#

<@&765938438989152266> Got a guy making personal attacks in here, someone want to come deal with this

violet sand
#

Facepalm you've been attacking people left and right my guy... I think a lot of lads here can confirm...

coarse juniper
violet sand
#

I'm gonna leave this discussion, appologies to the mods if I went too far 😅

coarse juniper
#

Too late

#

Can't backpedal now, you've been +clipped +screenshotted +logged

upbeat needle
#

Looks pretty boring to read I'll be honest

coarse juniper
#

Deal with the conseuqences, learn from your actions

violet sand
#

it's just a guy trolling everyone

coarse juniper
#

comes into someones discussion throwing hatred and personal attacks
"ItS JusT sOME gUY tROlING eVryOne"

#

Don't ban him, just a warning will be fine. I don't want to exhile him just let him know there are rules and he should read them.

upbeat needle
#

Idk looks pretty mild and harmless

#

I'd recommend muting the thread

violet sand
#

will do

coarse juniper
#

Yeah you're out of here

gentle moon
coarse juniper
#

already 70% done with the mod

#

yall are gonna feel real silly when you are paying me for my mod you all hated on 🤣

#

might see if I can integrate a way to charge more for people who hated o nit

arctic valley
#

rendering the game twice per frame is going to be a pain tbh

coarse juniper
arctic valley
#

hmm?

#

wait so, basically you are using 2 framebuffers, where the first one renders at half the fps and the 2nd one renders at full speed?

arctic valley
#

does it actually worth the effort? 🤔

#

i feel like reducing vertices count would be better

coarse juniper
#

@nimble ironCouple trolls back in the discussion, let me know if you need me to bring in moderators again. I'll be happy to

arctic valley
#

or if you want to do some kind of "private view" with eye tracking then ig it might worth trying

#

don't get me wrong but render in low resolution and then in native resolution have more impact than render in native only

#

the gpu architecture sucks at rendering individual pixel (as in 1x1 pixel)

upbeat needle
#

!warn 981087954074222613 tone down the trolling please

shut depotBOT
#
User warned

User 701408 has been warned:
@coarse juniper (.sebastian420.#0 / 981087954074222613)
Reason: tone down the trolling please

arctic valley
#

rendering a quad (well it's actually 2 triangles in opengl) that fills 1x1 px would discards 3 pixels in 2x2 kernel

coarse juniper
#

@upbeat needle........?......

arctic valley
#

so basically wasted 3/4 of rendering time

coarse juniper
#

I'm on the developers for the mod trying to keep the discussion pertinent and I get a warning?....

arctic valley
#

it might helps with software rendering i think 🤔

#

but why would people use their cpu to render the game when they already have a gpu

short tusk
#

What the fuck am I reading

violet sand
jade wave
teal steeple
#

being a better “prompt engineer” will not help an LLM know what a function is called 😭

#

this isnt even ragebait this is just sadnessbait

#

i’m just geniunely sad that theres probably someone who actually thinks like this

coarse juniper
#

first warning, keep going and I get the mods.

teal steeple
#

that’s like cliché at this point

coarse juniper
#

ah I see, someone's who's website doesn't have any impressive projects and doesn't even scroll properly on mobile is trying to pick a fight.

yeah, no thanks. blocked.

teal steeple
#

guess you gotta report yourself and ping mods now, shame

coarse juniper
#

How is that a personal attack?

#

its a bug report

#

silly noob

short tusk
#

Her website has fart with reverb 10/10 website if I say so myself

coarse juniper
teal steeple
coarse juniper
#

yeah no thanks

teal steeple
coarse juniper
#

I'm good

teal steeple
#

it’s shit

coarse juniper
short tusk
#

Top tier trolling

coarse juniper
#

likely story

teal steeple
coarse juniper
#

we can tell you're bored and attention starved.

#

it's pretty obvious my man

teal steeple
#

yeah

#

i know

#

but atleast i’m not doing anything bad, just bullying you

#

remember! it’s always legal to bully someone with an AI profile picture!

coarse juniper
#

is that what you consider bullying?

teal steeple
coarse juniper
#

I'd consider bullying more like how you get treated at school

#

but you do you man

teal steeple
#

might wanna workshop that one a bit more

brittle python
#

<@&765938438989152266> as funny as this troll thread is to read, maybe you should look into closing it if necessary? (Sorry for the ping)

teal steeple
#

get a peer review

coarse juniper
#

yeah we got @teal steeple in here flaming and going off topic

#

<@&765938438989152266>

#

can we get a mod to come deal with this

brittle python
#

Yes, it's obiuvsly her fault. /s

teal steeple
coarse juniper
#

he keeps replying to me talking crap because he's jealous I actually know how to make mods

#

so yeah

#

pretty cringe

teal steeple
#

no i’m pretty proud chatgpt can make mods that’s pretty impressive

coarse juniper
#

you know there's resources for you to learn mod dev online? and chatgpt?

#

you don't have to be a hater

teal steeple
#

you are such a crypto bro it’s crazy

coarse juniper
#

? I'm not allowed to invest in different crypto currencies now? lmao ok

#

*looks at his past 2 month gains and raises single eyebrow

#

finally a moderator, thank God

upbeat needle
#

!mute 981087954074222613 2d trolling

shut depotBOT
#
User muted

User 701408 has been muted until Thu, 11 Jul 2024 16:33:55 Z:
@coarse juniper (.sebastian420.#0 / 981087954074222613)

Duration: 2d
Reason: trolling

upbeat needle
#

!lock