enable analytics and quota reports | NetApp | Page 1

glad skiff Jan 12, 2024, 3:41 PM

#

@lean ingot @shy river Happy New Year to all.
I'm trying to figure out how to enable file analytics and quota reports in NAbox/Harvest. So far my File Analytics do not appear to be collected. REST is enabled, I think.
Same with Quotas', "No Data".
Can some one help?
Thank you
TasP

lean ingot Jan 12, 2024, 3:53 PM

#

hi @glad skiff which version of Harvest are you using? For file system analytics (FSA) did you see the note at the top of the dashboard about enabling FSA for one or more volumes via https://docs.netapp.com/us-en/ontap/task_nas_file_system_analytics_enable.html ?

For Quotas, can you email use your log file? https://netapp.github.io/harvest/23.11/help/log-collection/#nabox email to ng-harvest-files@netapp.com

glad skiff Jan 12, 2024, 4:30 PM

#

lean ingot hi <@734108538015842375> which version of Harvest are you using? For file system...

I have turned on volume analytics on my flexgroups. Could it be that it doesn't like flexgroups yet?

lean ingot Jan 12, 2024, 4:49 PM

#

a quick scan of the FSA technical report implies that ONTAP supports FSA with flexgroups

glad skiff Jan 12, 2024, 5:14 PM

#

lean ingot a quick scan of the FSA technical report implies that ONTAP supports FSA with fl...

Yes, I can see the reports in System Manager. I am sending the logs, but I think something else happened; kind of weird, you'll see in a bit

lean ingot Jan 12, 2024, 6:36 PM

#

🙂 yes those are not the log files I expected. Those are the nabox-api log files but not the harvest ones. What does dc ps show? Is the nabox-harvest2 container running? If so, try this
dc logs nabox-harvest2 > nabox-harvest2.log ; tar -czvf nabox-harvest2.log.tar.gz nabox-harvest2.log

glad skiff Jan 12, 2024, 8:10 PM

#

It is 1.1MB compressed. I need to have a second person review it; unfortunately I probably will not be able to send it until Tuesday, we are closed on Monday.

glad skiff Jan 23, 2024, 3:53 PM

#

Just sent it @lean ingot

glad skiff Jan 24, 2024, 3:22 PM

#

Lem me know when you get a chance to look

lean ingot Jan 24, 2024, 3:42 PM

#

will do

lean ingot Jan 24, 2024, 5:16 PM

#

hi @glad skiff thanks for the logs. There are two clusters that are successfully collecting Rest:VolumeAnalytics: 20 instances and 2 instances. If you check your Prometheus do you see metrics for volume_analytics_dir_bytes_used? Like this

#

The other clusters do not have any instances of Rest:VolumeAnalytics
2024-01-12T19:41:03Z INF collector/collector.go:367 > no instances, entering standby collector=Rest:VolumeAnalytics task=data
2024-01-12T19:41:06Z INF collector/collector.go:367 > no instances, entering standby collector=Rest:VolumeAnalytics task=data

#

One of the pollers also has an auth problem
2024-01-12T16:49:23Z WRN poller/poller.go:678 > init collector-object error="StatusCode: 401, Error: auth failed, Message: 401 Unauthorized, API: /api/cluster?fields=%2A&return_records=true" Poller=**** collector=Rest object=VolumeAnalytics

glad skiff Jan 24, 2024, 5:21 PM

#

How do I get to that?

lean ingot Jan 24, 2024, 5:23 PM

#

log into nabox, then edit the URL in the URL bar and change dashboard to prometheus

#

mentioned here https://nabox.org/documentation/troubleshooting/#using-prometheus-and-graphite

glad skiff Jan 24, 2024, 5:29 PM

#

I'm in Dashboards, and I ran the query as above, I see only one cluster, acesg.

#

Do I need to manually add the rest?

lean ingot Jan 24, 2024, 5:38 PM

#

you typed volume_analytics_dir_bytes_used in Prometheus?

glad skiff Jan 24, 2024, 5:41 PM

#

Yes sir,t then clicked EXECUTE

lean ingot Jan 24, 2024, 5:42 PM

#

excellent. If you see data there, you should see data in the ONTAP: File System Analytics (FSA) Grafana dashboard. Can you check there?

glad skiff Jan 24, 2024, 5:43 PM

#

All panels are populated with "No data"

lean ingot Jan 24, 2024, 5:44 PM

#

if you click in the Cluster dropdown do you see anything?

glad skiff Jan 24, 2024, 5:45 PM

#

Ok, I see the cluster and two SVMs I saw in the Prometheous query screen. But how do I add my other cluster?

#

I've already enabled it in ONTAP

lean ingot Jan 24, 2024, 5:46 PM

#

and if you select the cluster, the panels update with data?
what's the name of the poller for the cluster you expect to see there but don't?

glad skiff Jan 24, 2024, 5:47 PM

#

'aces' reports no data

lean ingot Jan 24, 2024, 5:48 PM

#

nabox-harvest2.log:nabox-harvest2 2024-01-12T16:49:23Z WRN poller/poller.go:678 > init collector-object error="StatusCode: 401, Error: auth failed, Message: 401 Unauthorized, API: /api/cluster?fields=%2A&return_records=true" Poller=aces collector=Rest object=VolumeAnalytics

#

password is wrong

glad skiff Jan 24, 2024, 5:49 PM

#

Isn't it the same password for the cluster monitor?

#

I wonder if the account is not enabled for the app

lean ingot Jan 24, 2024, 5:55 PM

#

yes that could be, I thought this poller had worked in the past, which would imply a password issue. If it has never worked, yes could be an account issue. Here are the docs about preparing the cluster https://netapp.github.io/harvest/nightly/prepare-cdot-clusters/
you can also do an easy test from the command line with curl like this
curl --user user:pass -snk 'https://10.193.48.11/api/cluster?fields=version'

glad skiff Jan 24, 2024, 5:55 PM

#

Account is enabled for https, ontapi, ssh

lean ingot Jan 24, 2024, 5:55 PM

#

replace user, pass, and ip address

glad skiff Jan 24, 2024, 5:55 PM

#

Am I missing something?

lean ingot Jan 24, 2024, 5:55 PM

#

those look fine. Try the curl

glad skiff Jan 24, 2024, 5:57 PM

#

Sorry, where would I find it

lean ingot Jan 24, 2024, 5:57 PM

#

curl --user user:pass -snk 'https://10.193.48.11/api/cluster?fields=version'
replace user, pass, and ip address with your values

glad skiff Jan 24, 2024, 5:59 PM

#

I bet this needs to be alocal account...

#

It acutally took the domain account

#

Spelling errors, all mine

#

It took the account and password which is the same one I've been using, but it has collected any data yet.

#

ok, I found it

#

I'm not sure what the working cluster is using to login with, I'll track it down

#

New DISA rules, they want all AD domain, but the clusters are in separate domains with no trusts. So I'm using local RO accounts. Did not create those

#

Thank you

glad skiff Jan 24, 2024, 6:33 PM

#

Just modified volume_nalytics.yaml to 10 records / 100 directories, thinking 10 flexgroups and 100 qtrees? Am I assuming correctly?

vapid hazel Jan 25, 2024, 10:27 AM

#

@glad skiff The filter section outlined below is configured to collect File System Analytics (FSA) for the top n (in this example, 10) volumes—both FlexVol and FlexGroup—sorted by space.used. The MaxDirectoryCount parameter specifies the number of directories (in this example, 100) to be collected per volume, ordered by directory bytes used on-disk.

  - filter:
      - analytics.state=on
      - order_by=space.used desc
      - max_records=20

plugins:
  - VolumeAnalytics:
      - MaxDirectoryCount: 100

Sample URL which collects FSA per volume
api/storage/volumes/375dd429-802b-11ed-a5cd-00a098d39e12/files?return_records=true&fields=analytics.file_count,analytics.bytes_used,analytics.subdir_count,analytics.by_modified_time.bytes_used,analytics.by_accessed_time.bytes_used&order_by=analytics.bytes_used+desc&type=directory&max_records=100

glad skiff Jan 25, 2024, 1:10 PM

#

Ok, I'm showing my lack of knowledge... Is there a document where I can also define the rest-roles required with readonly access to give HARVEST full access to the API's? i.e. my Node dashboard is all NO DATA.

#

Is it creating a 'services web access" to the current harvest role?

lean ingot Jan 25, 2024, 2:20 PM

#

hi @glad skiff did you use the role based access control list defined here? https://netapp.github.io/harvest/nightly/prepare-cdot-clusters/#ontap-cli We found a few missing permissions yesterday and that list has been updated. Can you copy/paste those again and restart your poller to make sure you have them all?

If there are permissions problems, they will be present in your logs. I know it's a chore for you to send us your log files so I can give you commands to run on nabox if you like, otherwise please send us your nabox log file.

glad skiff Jan 25, 2024, 2:20 PM

#

Great, thank you

#

I did a role with -cmddir DEFAULT and -access readonly. Is that okay? Now I will add the REST portion

lean ingot Jan 25, 2024, 2:29 PM

#

yes, that adds readonly access to all APIs. You do not need to add REST too. Rest roles are defined in terms of cmd RBAC. All you should need is to make sure that -application http is added for your user and that the harvest role has web access for REST. Both of those commands are listed https://netapp.github.io/harvest/nightly/prepare-cdot-clusters/#create-harvest-user-and-associate-with-the-harvest-role

glad skiff Jan 25, 2024, 2:33 PM

#

That does not work for some reason. I had to add the web access before HARVEST was able to get data.

#

However, I am seeing that the web-access for harvest2-role has Type admin access. Can I make it readonly?

lean ingot Jan 25, 2024, 2:36 PM

#

do you mean one of these steps?

glad skiff Jan 25, 2024, 2:37 PM

#

Yes sir, I believe that is where they came from

#

I also have security and sysmgr assigned to harvest2-role

lean ingot Jan 25, 2024, 2:39 PM

#

those steps are not using type admin access. the $ADMIN_VSERVER is mentioned because that's how you grant access to ZAPI/REST

#enable analytics and quota reports