NeoSkies island scan 2.0

[surreal rain]

After spending days improving the scan from scanning loaded chunks to scanning every single generated chunks, I'm happy to see that it still scans the test overworld in 7 seconds, it is slightly slower on smaller worlds, but it is now guaranteed to not miss any blocks.
I'll still work on it to make sure it doesn't use too much RAM and add extra options for servers to choose, such as only scanning loaded chunks, add a time limit and more once I improve the threading to not use too much CPU

That scan made a 5800X3D go from ~6% to ~50-58% so if the world is big it can use quite some CPU

There are still many bugs to be fixed but the scan should be mostly done

[stoic estuary]

for smaller worlds

i think you could use a different algorithm

like go from the faster algorithm if the world is small

like about say 1k chunks

thats would be the mid point of switching

[surreal rain]

most of the time (on small worlds) is spent getting the chunk data from the region files
I first go trough loaded chunks, to cut time, and than trough unloaded
unfortunately, I can't tell the world size without going trough the region files, so I can't do much

The only moment I can is when the island has a limited size, but the current algorithm allows scanning an island from console, without having to load the world chunks, so I may keep it, the time on small islands isn't very big, 300ms, it used to be smaller but this is still pretty fast
I may multithread the part of getting the chunks to scan but it doesn't seem worth it rn

The scan on of loaded chunks is also synchronous currently, as I quickly put that, I'm still improving this code

so, it turns out that reducing the threads doing the scan did absolutely nothing, same speed and CPU usage...

[stoic estuary]

mhm

so

you need the region file in order to gather the data

and that takes time

why not seperate as 2 threads the loaded chunks

and the loading of the region file

[surreal rain]

yeah, I'm still working on that, the mod is still in alpha so that will change on the future, I need to work on other fetaures, too, so I may not do that now

Changed number formatting to be more human readable

Scan now has a thread count option

[stoic estuary]

mhm