Hello everyone. I'm trying to make sense of this dashboard. For some reason, I am doubting the History numbers. I've selected 'last 90 days' of my FlexGroups, viewing activity "Monthly".
It seems my access and modify totals are awful low. Does this dashboard include all reads/writes, or is it aggregated by object, Monthly?
#ONTAP File System Analytics dashboard
deep kettle
silk badge
What does System Manager look like?
deep kettle
What specifically am I looking for in SM? I don't see anything closely resembling hot/cold data access
distant herald
@deep kettle Are you selecting All or multiple volumes in Grafana? There is an issue with the "Accessed" and "Modify" panels. Instead of using avg, we should be using sum in these panels to get accurate results.
Handling percentages is tricky for multi select, will look into that further. For now, please update the queries in the following panels:
For the Volume Access (Monthly) History panel, change the query to:
sum(volume_analytics_bytes_used_by_accessed_time{datacenter=~"$Datacenter", cluster=~"$Cluster", svm=~"$SVM", volume=~"$Volume", activity=~"$Activity", dir_name="."}) by (time, order)
For the Volume Modify ($Activity) History panel, change the query to:
sum(volume_analytics_bytes_used_by_modified_time{datacenter=~"$Datacenter", cluster=~"$Cluster", svm=~"$SVM", volume=~"$Volume", activity=~"$Activity", dir_name="."}) by (time, order)
Does this resolve the issue for these two panels? SM shows data per volume, so the data should be accurate when you select one volume at a time.
distant herald
@deep kettle Could you try importing json from here and see if it fixes the issue. It has fixes for percent panel as well.
deep kettle
Yes, that may be better... However, I am noticing it is missing one of volumes... Even if I hand-type the variable values in the Volume field, it does not pickup the volume
distant herald
Volume dropdown in FSA dashboard is populated by metric volume_analytics_dir_bytes_used
Do you have analytics enabled for that volume?
deep kettle
Another question, if I am trying to see my turnover rate for say the last six months, do I select "last six months" in the range?
distant herald
Available range option for history panels are below
distant herald
range changes are not needed for this
deep kettle
How do I help diagnose the missing volume?
distant herald
It is possible that this volume doesn't get populated in top 20 volumes by size. We collect FSA for only top 20 volumes by size
https://github.com/NetApp/harvest/blob/main/conf/rest/9.12.0/volume_analytics.yaml#L14
It can be customized in template.
deep kettle
I am only looking at six flexgroups in the svm... I have an fvol00 which is the qtree exporter, then fgvol01/2/3/4/5/6. I see all but fgvol03. TopResources are 10
Oh, the svm only has these seven volumes
distant herald
This is the API call that Harvest makes per cluster to select volumes for FSA. Could you check if the volume appears in this list?
curl -s -k -u USER:PASS 'https://CLUSTER_IP/api/storage/volumes?fields=name&analytics.state=on&order_by=space.used%20desc&max_records=20'
Make sure to replace USER, PASS, and CLUSTER_IP with the appropriate values.
deep kettle
I get twelve entries back from the entire cluster. fgvol03 is not included
Some of the volumes that come back are small
distant herald
Means analytics is not enabled for fgvol03 volume
Could you navigate to the volume page in SM and check if analytics is enabled in the explorer?
deep kettle
It is; 'analytics show -vserver vsacfg21 -volume fgvol03' returns, "State: on"
distant herald
Could you share response of below API?
Make sure to replace USER, PASS, and CLUSTER_IP with the appropriate values.
curl -s -k -u USER:PASS 'https://cluster_ip/api/storage/volumes?fields=name,analytics.state&name=fgvol03'
deep kettle
Yes, you hit the nail on the head
For some reason it is stuck in initializing
But I don't see that in ONTAP. This is a volume which was stuck initializing, and Support had us kill the job which made it go normal. But obviously it didn't. I have to call support again
distant herald
Sure. Please let us know if it doesn't show up post ONTAP fix.
deep kettle
Well, we tried all sort of things, nothing helped. I just upgraded to 9.14.1P9. All seems well now
spiral sorrel
Glad you got it working @deep kettle
deep kettle
Thanks Chris
lime vortex
Here are the steps taken from the NetApp case. @spiral sorrel @deep kettle @distant herald