Official Benchmark of URP vs BiRP

[leaden grove]

When there will be a proving where Mobile Device will benefit from using URP rather than BiRP?
Because most of the time, people who uses URP Suffers on low end device!

[light estuary]

I'm not really answering the question, but I feel it could be useful to know the following. (you or someone else)

I've seen some project sample come to life that are targeting low-end devices. https://forum.unity.com/threads/introducing-the-new-urp-3d-sample-beta.1495706/

Maybe looking into those project could help you realize the scope of what is expected in URP for low end devices. If your scope seem to be relatively close to what is presented in those samples, whatever if BiRP is better than URP does not matter anymore.

Also note that people that suffers using URP might also suffer by using BiRP. Performance of the engine is definitely a factor, but the amount of work you are asking is an other factor that is equivalent. What's more is that you have control over that factor.

[leaden grove]

Its not a low end..

Iphone 6S Is just ahead of the time

My Samsung A70 Run on < 15fps (2019 release)

I also have Samsung A02 (2021 release).

I bet its only 5fps on the sample

(terminal benchmar)

[light estuary]

Not exactly sure about the performance, but I believe the A70 is better than the iPhone 6S

[light estuary]

It would be pretty easy to test.

[leaden grove]

heres the data from G3D Mark

Iphone 6s get a 2289 score on openGL

while my A70 is 1843

unity lies to us by using iphone 6s because developers expect its a slow & old device

thats why they never uses android to test on

even the 6S Vulkan score is 1850, my SAMSUNG A70 is Only 405

nobody can lies about data

[light estuary]

I have no idea what does number means.

[leaden grove]

g3d benchmark, they provides number about openGL & vulkan performance score

basically unity is using iphone 6s (which equivalent to almost S9)
to fool us. which is not a low end device at all?

[light estuary]

Also, GPU is one specs. The CPU is another one that could be the bottleneck.

[leaden grove]

basically URP = CPU + GPU Heavy

[light estuary]

The A70 has a better CPU than the iPhone 6s

[leaden grove]

no counter arguement on thi

[light estuary]

Maybe, you could try to balance your load on those particular devices ? More CPU work to reduce the GPU works.

[leaden grove]

out of scope.

still proves unity lies to us by using S9 as a benchmark 😄

S9 = low end (unity claims)

[light estuary]

Also, note that I am the one that stated that it is low-end.

And, you can directly provide feedback

[leaden grove]

exactly thats why I made this post

[light estuary]

This wouldnt be the right place for that though.

[leaden grove]

*ask the experts

[drifting surge]

Thank you for sharing your concerns. Your observations about the differences between the iPhone 6s and the Samsung A70 are noted, and we will incorporate this feedback into future benchmarks.

The Android ecosystem is notably fragmented, with a wide variety of devices having different specifications, even within the same model in different countries. This diversity makes it challenging to create a one-size-fits-all benchmark.

We use devices like the iPhone 6s in our benchmarks because they provide a consistent baseline for comparison. While it may perform similarly to higher-end devices in certain aspects, it's not intended to mislead but to offer a stable reference point. The performance on Android devices can vary significantly due to the fragmented nature of the ecosystem.

The URP sample is designed to showcase rich content, which might be more demanding on the GPU and CPU. It's also important to note that while our high-end quality profiles are more suited to devices like iPhones, they may not be as compatible with a broad range of Android devices, leading to differences in performance. In that case it is better to use medium or low quality settings.

We are aware of the need for easier scalability in Unity, especially considering the diverse range of hardware. We're considering implementing a hardware tiering system that could help developers better optimize their applications for a wider range of devices, enhancing performance across different tiers.

[leaden grove]

yo, your talk is not in the context...

[true bolt]

🤔 Curious is the hardware tiering system will work automatically or it's something that need to tweak manually by developer? Is that another new option will added into URP Asset?

[drifting surge]

We are currently finalizing the design but I can not share any concrete details. The goal is that features can be activated/deactivated based on hardware/driver capabilities. And then developers should also be able to override settings for certain device tiers or concrete specs (e.g. GPUs), if they have issues with their content on these devices. Ideally, we can also adaptively scale settings based on the profile.

[true bolt]

I see. At least it's able to setup different profile settings based on device tiers or concrete spec should be ok but it will be really nice to make it work automatically by default and only manually tweak when it's not working well. Btw I think currently urp still lacking a lot of features and tooling to ship truly performant content for mobile platform like terrain for mobile, blob shadow, day and night cycle for mobile and etc. Another big pain point is I have serious mobile game project that I found it's gpu bound that spend gpu frame more than 17ms but there's no urp tooling to figure out where's the root cause of the problem. I hope official can put more resources to tackle these hard problems.

[molten tendon]

Hey @true bolt , we do have several resources available to advise on profiling on Mobile devices.
The Ultimate Guide to Profiling has some info on using native GPU profilers on Android (such as RenderDoc).

https://resources.unity.com/games/accelerate-success-native-gpu-profiling-webinar
https://unity.com/how-to/profiling-and-debugging-tools
https://resources.unity.com/games/ultimate-guide-to-profiling-unity-games
https://images.response.unity3d.com/Web/Unity/{121b241a-e312-4763-a7a6-8f57878e6bec}_JW10233_Optimize_Your_Mobile_Game_Perfrormance_R4.3.pdf

Hope this helps

[true bolt]

Ya. I know there's a lot of advanced tooling outside of unity but it will be really nice to have similar tooling inside unity. I tried it before that it super annoying that either I failed to get the tool working or it's too advanced for me to get the info I want.

[molten tendon]

There is the much simpler Frame Debugger : https://docs.unity3d.com/Manual/frame-debugger-window.html which may help with very broad diagnosis, but has limited profiling capability.
I do think dedicated, platform-specific native profilers (like RenderDoc) are ultimately the way to go and well worth investing the time in learning if possible.

Also coming in 2023.2+ is the new Profiler Highlights module https://docs.unity3d.com/2023.2/Documentation/Manual/ProfilerHighlights.html

[true bolt]

🤔 Actually there's System Metrics Mali package available but it's Mali exclusive. Actually I ask this question before but until now there's no new update from official yet. Will it support more GPU vendors soon like Immortalis from Arm and Adreno from Qualcomm?