PlaywrightCrawler - how often browser fingerprints are changed?

[fair herald]

Are browser fingerprints changed

• every request?
• every 1 min?
• every... I do not what else ))

And how changing browser fingerprints related
to using or not using PlaywrightCrawler.launchContext.useIncognitoPages ?

I am asking this because I saw a situation when two attempts to open a bot detection site
https://fingerprint.com/demo/ result in same "ID" - in other words they were
able to identify me! Screenshots attached.

Interval between requests - 3 min.
Different IPs (from the pool of "rotating" IP's).
Without incognito

[thin basin]

Following

[fair herald]

I used the site [1] to test PlaywrightCrawler with different setting. Here what I saw:

** 1. Without incognito mode **
Without incognito mode - as described above - the site [1] assigns the same ID even when different IP's are used.

** 2. Incognito mode turned on **

    launchContext: {
        experimentalContainers: false,
        useIncognitoPages: true,
        launcher: firefox,
    },

With incognito mode turned on the site [1] can not detect Crawlee - it assigns a
different ID for every request.

** 3. With experimentalContainers turned on: **

    launchContext: {
        experimentalContainers: true,
        useIncognitoPages: false,
        launcher: firefox,
    },

the site [1] assign the same ID even when different IP's are used.

In all cases - no session pool and persistent cookies:

    useSessionPool: false,
    persistCookiesPerSession: false,

[1] https://fingerprint.com/demo/

So is it "as designed" or my test is wrong or something else?

[unborn dagger]

Fingerprint and proxy IP should be attached to a browser. Depending on your browserPoolOptions, it will open some number of pages per browser. By default it is 100 requests per browser I think. Those should have same fingerprint and proxy IP. Each new browser should attach to different IP and fingerprint.

Incognito and experimental containers should on the other hand use different fingerprint/IP for each request.

But of course, there might be bugs

Thanks for all the testing

[fair herald]

Incognito and experimental containers should on the other hand use different fingerprint/IP for each request.

This seems to be true for incognito - different ID (on fingerprint.com/demo/) assigned every time

And something is wrong in case of experimental containers - same ID all the time!

[fair herald]

I did additional tests with bot detection/fingerprinting sites.

Used PlaywrightCrawler with this configuration:

    launchContext: {
        experimentalContainers: false,
        useIncognitoPages: true,
        launcher: firefox,
    },

No session pool and persistent cookies. PlaywrightCrawler.browserPoolOptions.useFingerprints = true

• Test results with [1] are same as before - it assigns a different ID for every request. Fine.
• Test results with [2] and [3] - SAME ID FOR EVERY REQUEST. The IP was different with each request.

On the screenshot from site [2] -attached below- look at "FP ID" on the top and on "visits".
"Visits: 4" - it means this site knows - it is my visit number 4.

Screenshots from site [3] are self-explaining: huge "Your fingerpring:" in the middle.
Fingerprint remains the same when I visit it from different IP.

Not a good news.
So, what can be done against it?
The FingerprintGenerator is there, how it can be used against [2] and [3] ???

[1] https://fingerprint.com/demo/
[2] https://abrahamjuliot.github.io/creepjs/
[3] https://noscriptfingerprint.com/