[Tauri v2] Disabling hardware acceleration on some windows | Tauri Apps | Page 1

stiff sinew Sep 18, 2024, 10:43 PM

#

Heya! I wrote an OBS overlay app, but OBS's window capture cannot capture any of my overlay windows because they have hardware acceleration enabled by default. I've looked for about 2 hours now and all I could find was the --disable-gpu browser arg, which causes the windows to immediately close every time I open them. I've also tried having a look around some of the webview stuff (using Window#with_webview) and I couldn't find anything there either.

Is there any good, reliable way to disable hardware acceleration? Or at least get my windows to capture in OBS? (yes, I'm using the "Windows 10" capture method)

stiff sinew Sep 19, 2024, 11:24 AM

#

[Tauri v2] Disabling hardware acceleration on some windows

sonic pagoda Sep 19, 2024, 2:29 PM

#

where did use the --disable-gpu flag?

stiff sinew Sep 19, 2024, 2:30 PM

#

sonic pagoda where did use the `--disable-gpu` flag?

WebviewWindowBuilder::new(...).additional_browser_args("--disable-gpu")

#

As soon as the window opens, it immediately closed and cannot be created again

sonic pagoda Sep 19, 2024, 2:35 PM

#

try putting it in tauri.config.json like:

"windows": [
{
...,
"additionalBrowserArgs": "--disable-gpu"
}
]

stiff sinew Sep 19, 2024, 2:37 PM

#

Sure, one sec

#

Nope, same thing

#

Alongside obviously making every update in the main window take forever

sonic pagoda Sep 19, 2024, 2:39 PM

#

stiff sinew Alongside obviously making every update in the main window take forever

im not sure what this means, or if its relevant

#

can you provide the console log for when you try and run it?

stiff sinew Sep 19, 2024, 2:40 PM

#

sonic pagoda im not sure what this means, or if its relevant

Without hardware acceleration, it takes a good second or two for any of the content in the main window to update

stiff sinew Sep 19, 2024, 2:41 PM

#

sonic pagoda can you provide the console log for when you try and run it?

There's nothing in console, the window just closes

sonic pagoda Sep 19, 2024, 2:41 PM

#

run with --verbose

stiff sinew Sep 19, 2024, 2:43 PM

#

sonic pagoda Sep 19, 2024, 2:44 PM

#

open the browser console too

stiff sinew Sep 19, 2024, 2:44 PM

#

Of the main window?

sonic pagoda Sep 19, 2024, 2:44 PM

#

inspect element

#

yeah

stiff sinew Sep 19, 2024, 2:45 PM

#

Nothing

sonic pagoda Sep 19, 2024, 2:45 PM

#

make sure you have it open while trying to open the overlay

stiff sinew Sep 19, 2024, 2:45 PM

#

Yep, I did

#

Opened it right before clicking the button

sonic pagoda Sep 19, 2024, 2:47 PM

#

and if you get rid of the gpu stuff, the overlay opens fine?

stiff sinew Sep 19, 2024, 2:48 PM

#

Yep

#

I should mention that this same code, including capturing the window in OBS, worked fine with Tauri v1

#

Meaning that I didn't need to disable hardware acceleration in the first place ^^

#

Issue only started happening after migrating

sonic pagoda Sep 19, 2024, 2:50 PM

#

what happens if you use a browser source in obs? can you select the overlay like that

stiff sinew Sep 19, 2024, 2:51 PM

#

sonic pagoda what happens if you use a browser source in obs? can you select the overlay like...

Probably, but there wouldn't be any content since that page relies on the IPC bridge

sonic pagoda Sep 19, 2024, 2:51 PM

#

try?

stiff sinew Sep 19, 2024, 2:53 PM

#

Yeah, it seems like I can use a browser source for it

sonic pagoda Sep 19, 2024, 2:53 PM

#

functions as intended?

stiff sinew Sep 19, 2024, 2:53 PM

#

No, because it relies on the app window

sonic pagoda Sep 19, 2024, 2:54 PM

#

youre going to have to be more specific

stiff sinew Sep 19, 2024, 2:54 PM

#

stiff sinew Sep 19, 2024, 2:55 PM

#

sonic pagoda youre going to have to be more specific

It uses the Tauri API, which afaik only works when the page is being rendered inside of a Tauri window

sonic pagoda Sep 19, 2024, 3:06 PM

#

the overlay window that you are creating IS a tauri window

#

which means that the API should work as intended

stiff sinew Sep 19, 2024, 3:07 PM

#

Yes, and the OBS browser source only renders a webpage

#

Meaning that it's not capturing the Tauri window itself

sonic pagoda Sep 19, 2024, 3:19 PM

#

your best bet is setting up logging and figuring out why its closing

#

https://github.com/tauri-apps/tauri-plugin-log

stiff sinew Sep 19, 2024, 3:20 PM

#

sonic pagoda your best bet is setting up logging and figuring out why its closing

Well, presumably, get_webview_window is still returning not-none otherwise it would attempt to reopen whenever I press the button

sonic pagoda Sep 19, 2024, 3:21 PM

#

can you share the code here that opens the window?

#

in text, not image

stiff sinew Sep 19, 2024, 3:21 PM

#

pub fn maybe_open(&mut self) -> Result<(), Error> {
    if self.app.get_webview_window(&self.label).is_none() {
        WebviewWindowBuilder::new(
            &self.app,
            self.label.clone(),
            WebviewUrl::App(self.url.clone().into()),
        )
        .title(self.title.clone())
        .transparent(true)
        .resizable(false)
        .inner_size(800.0, 600.0)
        .skip_taskbar(true)
        .center()
        .build()?;
    }

    Ok(())
}

sonic pagoda Sep 19, 2024, 3:31 PM

#

try making the function async

stiff sinew Sep 19, 2024, 3:35 PM

#

No difference

sonic pagoda Sep 19, 2024, 3:35 PM

#

what happens when you .unwrap instead of ?

stiff sinew Sep 19, 2024, 3:36 PM

#

Again, no difference

#

No panic

sonic pagoda Sep 19, 2024, 3:44 PM

#

what happens when you try and open the second webview window on startup by adding it to the config?

stiff sinew Sep 19, 2024, 3:46 PM

#

One moment

#

Still closes

#

"windows": [
    {
        "minWidth": 1280,
        "minHeight": 720,
        "center": true,
        "fullscreen": false,
        "resizable": false,
        "title": "DiscOverlay",
        "decorations": false
    },
    {
        "minWidth": 800,
        "minHeight": 600,
        "fullscreen": false,
        "resizable": false,
        "title": "Voice Overlay",
        "decorations": true,
        "label": "voice",
        "url": "http://localhost:5173/voice-overlay",
        "transparent": true,
        "additionalBrowserArgs": "--disable-gpu"
    }
],

sonic pagoda Sep 19, 2024, 4:00 PM

#

and that same config but without disable gpu works?

stiff sinew Sep 19, 2024, 4:01 PM

#

Yep

sonic pagoda Sep 19, 2024, 4:01 PM

#

stiff sinew Still closes

anything in the console?

stiff sinew Sep 19, 2024, 4:01 PM

#

sonic pagoda anything in the console?

Nothing at all

#

With and without verbose mode

sonic pagoda Sep 19, 2024, 4:01 PM

#

do -vvv

stiff sinew Sep 19, 2024, 4:02 PM

#

Nothing, again

sonic pagoda Sep 19, 2024, 4:14 PM

#

what happens when you navigate to the url http://localhost:5173/voice-overlay in your browser when the app is open

stiff sinew Sep 19, 2024, 4:15 PM

#

sonic pagoda what happens when you navigate to the url `http://localhost:5173/voice-overlay` ...

Again, since my browser isn't a Tauri window, there's no actual functionality

#

It's just a brown page

sonic pagoda Sep 19, 2024, 4:16 PM

#

is that what you should be seeing, excluding the loss of functionality?

#

can you tauri info and share that here

stiff sinew Sep 19, 2024, 4:17 PM

#

sonic pagoda is that what you should be seeing, excluding the loss of functionality?

Kind of? All of the info from the Rust code obviously isn't there

stiff sinew Sep 19, 2024, 4:18 PM

#

sonic pagoda can you `tauri info` and share that here

[✔] Environment
    - OS: Windows 10.0.22631 x86_64 (X64)
    ✔ WebView2: 128.0.2739.79
    ✔ MSVC: Visual Studio Community 2022
    ✔ rustc: 1.79.0 (129f3b996 2024-06-10)
    ✔ cargo: 1.79.0 (ffa9cf99a 2024-06-03)
    ✔ rustup: 1.27.1 (54dd3d00f 2024-04-24)
    ✔ Rust toolchain: stable-x86_64-pc-windows-msvc (environment override by RUSTUP_TOOLCHAIN)
    - node: 22.6.0
    - pnpm: 9.4.0
    - npm: 10.8.2

[-] Packages
    - tauri 🦀: 2.0.0-rc.15
    - tauri-build 🦀: 2.0.0-rc.12
    - wry 🦀: 0.43.1
    - tao 🦀: 0.30.0
    - tauri-cli 🦀: 2.0.0-rc.16
    - @tauri-apps/api : 2.0.0-rc.0
    - @tauri-apps/cli : 2.0.0-rc.16

[-] Plugins
    - tauri-plugin-single-instance 🦀: 2.0.0-rc.4
    - @tauri-apps/plugin-single-instance : not installed!

[-] App
    - build-type: bundle
    - CSP: unset
    - frontendDist: ../build
    - devUrl: http://localhost:5173/
    - framework: Svelte
    - bundler: Vite

sonic pagoda Sep 19, 2024, 4:22 PM

#

cargo update

stiff sinew Sep 19, 2024, 4:26 PM

#

Still closes

#

[✔] Environment
    - OS: Windows 10.0.22631 x86_64 (X64)
    ✔ WebView2: 128.0.2739.79
    ✔ MSVC: Visual Studio Community 2022
    ✔ rustc: 1.79.0 (129f3b996 2024-06-10)
    ✔ cargo: 1.79.0 (ffa9cf99a 2024-06-03)
    ✔ rustup: 1.27.1 (54dd3d00f 2024-04-24)
    ✔ Rust toolchain: stable-x86_64-pc-windows-msvc (environment override by RUSTUP_TOOLCHAIN)
    - node: 22.6.0
    - pnpm: 9.4.0
    - npm: 10.8.2

[-] Packages
    - tauri 🦀: 2.0.0-rc.15
    - tauri-build 🦀: 2.0.0-rc.12
    - wry 🦀: 0.43.1
    - tao 🦀: 0.30.1
    - tauri-cli 🦀: 2.0.0-rc.16
    - @tauri-apps/api : 2.0.0-rc.0
    - @tauri-apps/cli : 2.0.0-rc.16

[-] Plugins
    - tauri-plugin-single-instance 🦀: 2.0.0-rc.4
    - @tauri-apps/plugin-single-instance : not installed!

[-] App
    - build-type: bundle
    - CSP: unset
    - frontendDist: ../build
    - devUrl: http://localhost:5173/
    - framework: Svelte
    - bundler: Vite
```it appears there was nothing to update either

heady jolt Sep 19, 2024, 4:33 PM

#

changing additionalBrowserArgs typically means you have to change the webview's data folder (if you have multiple webviews at least) which you can only do by spawning the window in rust

#

though i have to say it's quite confusing that you only have to disable acceleration in v2 as there were no relevant changes in v2 that should matter here

stiff sinew Sep 19, 2024, 4:34 PM

#

I should mention, I obviously had to switch OBS's capture method to "Windows 10" (which supposedly is meant to work for hardware accelerated windows + support transparency) when using v1

#

With v2, the Window Capture outright has no content and the other capture method options just result in a blacked out window (whereas, iirc, with v1 it'd still show the window content at least, just without transparency)

#

heady jolt Sep 19, 2024, 4:49 PM

#

can you try it with tauri's unstable feature flag? Can't remember if that changed the webview->window injection method or not but worth a try.

stiff sinew Sep 19, 2024, 4:50 PM

#

Sure thing, one moment

#

No OBS capture still

And the window still immediately closes if I add the arg

heady jolt Sep 19, 2024, 4:58 PM

#

No OBS capture still
That makes no sense to me then, either stable or unstable should match the v1 behavior unless there was a change i missed. :/
And the window still immediately closes if I add the arg
Which i am fairly sure is because of the data dir i mentioned above.

#

link to what i mean https://docs.rs/tauri/2.0.0-beta/tauri/webview/struct.WebviewWindowBuilder.html#method.data_directory

stiff sinew Sep 19, 2024, 4:58 PM

#

heady jolt > No OBS capture still That makes no sense to me then, either stable or unstable...

I forgot to mention I'm adding the arg when creating the window with a WeviewWindowBuilder, not inside of my config file

heady jolt Sep 19, 2024, 4:58 PM

#

which is a good thing because otherwise you couldn't change the data dir

stiff sinew Sep 19, 2024, 4:58 PM

#

heady jolt link to what i mean <https://docs.rs/tauri/2.0.0-beta/tauri/webview/struct.Webvi...

ah

sonic pagoda Sep 19, 2024, 5:25 PM

#

what is the data_directory exactly?

heady jolt Sep 19, 2024, 5:28 PM

#

the webview's data/cache/storage dir

#

everything the webview may have to write to disk (not including tauri's js apis) will be written to that dir

#

and for some reason 2 webviews with different browser args can't share the same dir

sonic pagoda Sep 19, 2024, 5:30 PM

#

weird

#

given that the reason for that behavior is unknown, how would one go about uncovering it?

#

maybe relevant: https://github.com/MicrosoftEdge/WebView2Feedback/issues/4593

heady jolt Sep 19, 2024, 5:32 PM

#

not just maybe :P

stiff sinew Sep 19, 2024, 5:33 PM

#

sonic pagoda maybe relevant: https://github.com/MicrosoftEdge/WebView2Feedback/issues/4593

Classic

#

Wouldn't explain (to me) why the other webview window closes itself, though

#

If it's sharing data with the main window, my assumption would be that it would simply not use the new arg

sonic pagoda Sep 19, 2024, 5:34 PM

#

if both webviews have --disable-gpu as the browser args, then it should be able to share the data dir?

heady jolt Sep 19, 2024, 5:35 PM

#

yes, as long as the args (including the "no args" option) match the data dir can be shared

#

but once 2 processes try to access the same dir with different args it'll explode

#

now why the first process crashes and not just the second doesn't make much sense to me either but doesn't matter either really, at least one of them has to crash i guess

sonic pagoda Sep 19, 2024, 5:37 PM

#

well that sounds like a bandaid solution for Deftu, given the looks of their app it doesnt seem like acceleration is needed.

#

but it still doesnt explain why its not playing nice with OBS when it should

heady jolt Sep 19, 2024, 5:38 PM

#

sonic pagoda well that sounds like a bandaid solution for Deftu, given the looks of their app...

yeah, i think saving the resources you save by having shared processes between the windows should be more valuable than having hardware acceleration in the other window.

sonic pagoda Sep 19, 2024, 5:39 PM

#

queer bug

#

no way i would have ever figured this out

stiff sinew Sep 19, 2024, 5:39 PM

#

Me neither

#

What I found weirder is that there's a difference (here) between v1 and v2

#

There were several differences, actually

sonic pagoda Sep 19, 2024, 5:40 PM

#

i guess for now just try out this solution and let us know if it works

heady jolt Sep 19, 2024, 5:41 PM

#

stiff sinew What I found weirder is that there's a difference (here) between v1 and v2

for that i'd appreciate a github issue if you don't mind

#

didn't find an existing one at least

stiff sinew Sep 19, 2024, 5:42 PM

#

Sure thing, which repo would that be on?

heady jolt Sep 19, 2024, 5:42 PM

#

the main tauri repo

stiff sinew Sep 19, 2024, 5:42 PM

#

Alrighty, will do

heady jolt Sep 19, 2024, 5:43 PM

#

thanks

stiff sinew Sep 19, 2024, 5:45 PM

#

Alright so it didn't crash this time, thankfully

#

But it's still not capturing anything in OBS

#

Now I'm really confused lol

heady jolt Sep 19, 2024, 5:46 PM

#

what made you think that hardware acceleration was the issue?

#

i didn't read the full convo

sonic pagoda Sep 19, 2024, 5:47 PM

#

its a known thing

#

TLDR

stiff sinew Sep 19, 2024, 5:47 PM

#

heady jolt i didn't read the full convo

I did quite a bit of research and most forums say that OBS's Window Capture doesn't capture (webview) windows with hardware acceleration enabled

sonic pagoda Sep 19, 2024, 5:47 PM

#

electron has issues too

stiff sinew Sep 19, 2024, 5:47 PM

#

BUT there was a "Windows 10" capture method added which was meant to fix this

#

But that doesn't seem to be working

sonic pagoda Sep 19, 2024, 5:48 PM

#

stiff sinew But it's still not capturing anything in OBS

even the main window?

stiff sinew Sep 19, 2024, 5:49 PM

#

It seems to be capturing the main window fine, which is also confusing

#

Maybe it's the transparency?

heady jolt Sep 19, 2024, 5:49 PM

#

works in my app with transparency

stiff sinew Sep 19, 2024, 5:50 PM

#

Here's the function I use for opening the window

pub fn maybe_open(&mut self) -> Result<(), Error> {
    if self.app.get_webview_window(&self.label).is_none() {
        WebviewWindowBuilder::new(
            &self.app,
            self.label.clone(),
            WebviewUrl::App(self.url.clone().into()),
        )
        .title(self.title.clone())
        .transparent(true)
        .resizable(false)
        .inner_size(800.0, 600.0)
        .skip_taskbar(true)
        .additional_browser_args("--disable-gpu")
        .data_directory(self.data_dir())
        .center()
        .build()?;
    }

fn data_dir(&self) -> PathBuf {
    let mut path = self
        .app
        .path()
        .app_data_dir()
        .expect("Failed to get app data dir");
    path.push("overlays");
    path.push(&self.label);
    if !path.exists() {
        std::fs::create_dir_all(&path).expect("Failed to create app data dir");
    }

    path
}
```~~I doubt that's the correct data dir but it's functional atm~~

sonic pagoda Sep 19, 2024, 5:52 PM

#

did you try disabling transparency on the second window?

stiff sinew Sep 19, 2024, 5:53 PM

#

I haven't, no

#

One sec

#

I found the issue concern

#

heady jolt Sep 19, 2024, 5:58 PM

#

what

stiff sinew Sep 19, 2024, 5:58 PM

#

OBS is the bane of my existence

#

This is just evil atp

#

Keep in mind, I was setting this in v1 too

#

And there were no issues. I'd assume that it wouldn't even give me the option to select the window if this is why it can't capture it

#

Or, maybe this is a Windows problem

sonic pagoda Sep 19, 2024, 6:00 PM

#

so since you had that enabled, it wouldnt show in obs?

stiff sinew Sep 19, 2024, 6:00 PM

#

Yep

sonic pagoda Sep 19, 2024, 6:01 PM

#

oy

#

so gpu can stay on

stiff sinew Sep 19, 2024, 6:02 PM

#

Yep, thankfully

#

Should I still open an issue about it?

heady jolt Sep 19, 2024, 6:12 PM

#

stiff sinew Keep in mind, I was setting this in v1 too

this setting is 1:1 the same implementation in v1 and v2 so it's not its fault alone. Could be in conjunction with the new webview injection idk

stiff sinew Sep 19, 2024, 6:13 PM

#

Could be. I'm sure something was changed at some point down the line which may affect that. Very peculiar issue, though

heady jolt Sep 19, 2024, 6:13 PM

#

stiff sinew Should I still open an issue about it?

if it worked in v1 then either v1 or v2 had an issue therefore a github issue is still appreciated :)

#

interestingly enough, with setSkipTaskbar true the "old" window capture method works fine.

#

so basically setSkipTaskbar decides whether you have to use bitbit or win10

#

which again, makes no sense to me x)

stiff sinew Sep 19, 2024, 6:15 PM

#

I'd safely assume that's an OBS issue then lol

heady jolt Sep 19, 2024, 6:16 PM

#

i'll compare it with v1 too real quick

#

okay, almost the same behavior except that i can't record anything in v1 with skipTaskbar true kkushKEKW

#

though bitbit at least tries to. with skipTaskbar false it's black, and with true it's white

#

so maybe check that out too before creating an issue?

stiff sinew Sep 19, 2024, 6:19 PM

#

Deftu/DiscOverlay

GitHub

GitHub - Deftu/DiscOverlay

Contribute to Deftu/DiscOverlay development by creating an account on GitHub.

#

I have a released binary here which has working recording ^^

#

Or, it worked for my friend and I at least

#

Don't mind how incredibly messy the code is there lol

#

Basically rewritten everything since, was just trying to get a working MVP

heady jolt Sep 19, 2024, 6:54 PM

#

it has the same behavior as my v1 test above on my machine

#

so "nothing" with win10 recording and a black window with the other method

stiff sinew Sep 19, 2024, 6:55 PM

#

That's really strange, since it's been working for me

#[Tauri v2] Disabling hardware acceleration on some windows