little sage
Hi all,
On new (>9.13.1) FP implementations to StorageGrid I see an average object size in SG larger then 4MB.
This is expected as FP collects a 1000 4kb blocks and puts them in an object.
I am now looking at an older implementation (currently running OnTap 9.12.1 and SG 11.8.0.8) I see and average object size around 200 kb and shrinking over time. Yesterday it was 231 KB. See screenshot for today (226KB)
SG is only used for FP.
Can anyone explain that?
Thanks!
Martijn
little sage
Just checked a number of objects with an S3 browser, objects seems to be around 4MB....
fickle pumice
We put a few enhancements in 9.13.1 for improving readahead. You may have a lot of partial 4 MB objects and fragmentation if I had to guess.
swift sorrel
The issue you are seeing is in StorageGRID average object size reporting. Ontap stores in 4MB objects but does much smaller range reads which skew the object size calculations
fickle pumice
With that in mind, ONTAP does 4k to 256k GETs, so that may be correct.
sturdy turret
That dashboard in the Grid is pulling incorrect figures. If you add up all the objects in your tenants and their logical capacity and do the maths, you'll find the real average object size is much, much larger than what that dashboard shows.
I've raised this and its being looked at and hopefully will be fixed.