making the switch from nabox to | NetApp | Page 1

grizzled peak Sep 15, 2022, 1:56 PM

#

That might have been a plugin in Harvest 1.x, @lofty pivot ?

lofty pivot Sep 15, 2022, 1:57 PM

#

hi @upper loom what dashboard in Harvest 1.X had the nfs connection count that is missing in Harvest2. Maybe it got missed in the rewrite

upper loom Sep 15, 2022, 1:58 PM

#

I'll have to crank the old nabox server up again - gimme a minute

grizzled peak Sep 15, 2022, 1:58 PM

#

drwxr-xr-x  2 root root  4096 Nov 27  2020 .
drwxr-xr-x 11 root root  4096 Dec  8  2020 ..
-rwxr-xr-x  1 root root  8865 Aug 19  2019 bash_extension_example.sh
-rwxr-xr-x  1 root root  9407 Aug 19  2019 nfs-connections.sh
-rwxr-xr-x  1 root root 11529 Aug 19  2019 perl_extension_example.pl
-rwxr-xr-x  1 root root 11603 Aug 19  2019 python_extension_example.py
-rwxr-xr-x  1 root root 21880 Aug 19  2019 snapmirror_replications.py
nabox-api:/opt/packages/netapp-harvest/extension#

#

nfs-connections.sh

lofty pivot Sep 15, 2022, 1:59 PM

#

thanks @grizzled peak

#

ok, looks like that script ssh-es into cluster and issues ONTAP cli commands. That's not something Harvest 2 supports, but we can use the (preferred) REST private CLI to do the same

upper loom Sep 15, 2022, 2:04 PM

#

well fart - maybe it wasn't there - I can't find it now

lofty pivot Sep 15, 2022, 2:04 PM

#

@upper loom no need to crankup your old server - I see what's needed. If you have a GitHub account, would you mind creating a Harvest issue that captures this ask?

lofty pivot Sep 15, 2022, 2:04 PM

#

upper loom well fart - maybe it wasn't there - I can't find it now

no worries

upper loom Sep 15, 2022, 2:04 PM

#

sure - np

lofty pivot Sep 15, 2022, 2:04 PM

#

thanks!

upper loom Sep 15, 2022, 2:04 PM

#

thanks for the quick response

#

submitted (correctly I hope)

lofty pivot Sep 15, 2022, 2:13 PM

#

thanks! Rahul reminded me we added something like this in main recently 🎊

wanton vine Sep 15, 2022, 2:16 PM

#

@upper loom Harvest has this information which is only available in our nightly builds . Template here https://github.com/NetApp/harvest/blob/main/conf/rest/9.12.0/netConnections.yaml

upper loom Sep 15, 2022, 2:18 PM

#

👍

wanton vine Sep 15, 2022, 2:18 PM

#

This is only a Rest Collector feature. You would need to enable this template here https://github.com/NetApp/harvest/blob/main/conf/rest/default.yaml#L16 or add this line in custom.yaml. Add Rest collector to your pollers and you should see metrics like below

upper loom Sep 15, 2022, 2:20 PM

#

so self taught for all of this stuff here - how would I do that?

#

@wanton vine

wanton vine Sep 15, 2022, 2:21 PM

#

Do you mean how to enable this in NABox?

upper loom Sep 15, 2022, 2:22 PM

#

yes

wanton vine Sep 15, 2022, 2:23 PM

#

Okay I'll list down the steps.

upper loom Sep 15, 2022, 2:23 PM

#

Thank you very much @wanton vine

wanton vine Sep 15, 2022, 3:15 PM

#

Here are the steps https://github.com/NetApp/harvest/discussions/1284

upper loom Sep 15, 2022, 3:23 PM

#

@wanton vine thank you

grizzled peak Sep 16, 2022, 7:30 AM

#

is rest directory considered "standard" like perf and zapiperf ?

#

and is netConnection default with recent harvest builds ?

wanton vine Sep 16, 2022, 9:30 AM

#

yes and yes

#

there is restperf dir also

grizzled peak Sep 16, 2022, 9:39 PM

#

good ! Will get that in the main version

grizzled peak Sep 19, 2022, 5:43 AM

#

netConnections.yaml is only 9.12 ?

wanton vine Sep 19, 2022, 6:29 AM

#

It uses private cli so should work in older versions also

grizzled peak Sep 19, 2022, 3:49 PM

#

ok so does it matter that's it's in the 9.12.0 directory and not 9.7.0 ?

wanton vine Sep 19, 2022, 3:57 PM

#

it is not, harvest chooses based on information given here https://github.com/NetApp/harvest/blob/main/conf/README.md#harvest-versioned-templates

#

There may be need for different template for a version if counter name differs or it is absent

grizzled peak Sep 20, 2022, 5:51 AM

#

a custom.yaml file doesn't need collector: line, correct ?

wanton vine Sep 20, 2022, 5:52 AM

#

object templates and harvest config are different. Collector: is only for harvest config and not for custom.yaml

grizzled peak Sep 20, 2022, 5:53 AM

#

thanks. DOes that seem ok to you ?

nabox-harvest2        | 2022-09-20T05:39:10Z INF rest/rest.go:184 > Using default timeout Poller=cluster2 collector=Rest:NetConnections timeout=30s
nabox-harvest2        | 2022-09-20T05:39:10Z INF collector/helpers.go:134 > best-fit template Poller=cluster2 collector=Rest:NetConnections path=/conf/conf/rest/9.12.0/netConnections.yaml v=9.7.0
nabox-harvest2        | 2022-09-20T05:39:10Z INF rest/rest.go:124 > initialized cache Poller=cluster2 collector=Rest:NetConnections numMetrics=0 timeout=30s
nabox-harvest2        | 2022-09-20T05:39:10Z INF collector/collector.go:344 > no instances, entering standby Poller=cluster2 collector=Rest:NetConnections task=data
nabox-harvest2        | 2022-09-20T05:39:28Z INF rest/rest.go:184 > Using default timeout Poller=AFF collector=Rest:NetConnections timeout=30s
nabox-harvest2        | 2022-09-20T05:39:29Z INF collector/helpers.go:134 > best-fit template Poller=AFF collector=Rest:NetConnections path=/conf/conf/rest/9.12.0/netConnections.yaml v=9.8.0
nabox-harvest2        | 2022-09-20T05:39:29Z INF rest/rest.go:124 > initialized cache Poller=AFF collector=Rest:NetConnections numMetrics=0 timeout=30s
nabox-harvest2        | 2022-09-20T05:40:01Z INF rest/rest.go:184 > Using default timeout Poller=cluster1 collector=Rest:NetConnections timeout=30s
nabox-harvest2        | 2022-09-20T05:40:22Z WRN ./poller.go:668 > init collector-object (Rest:NetConnections): 0:  Poller=cluster1
nabox-harvest2        | 2022-09-20T05:44:10Z INF collector/collector.go:344 > no instances, entering standby Poller=cluster2 collector=Rest:NetConnections task=data
nabox-harvest2        | 2022-09-20T05:49:10Z INF collector/collector.go:344 > no instances, entering standby Poller=cluster2 collector=Rest:NetConnections task=data

#

no instance on cluster2 is fine I guess, that's a svm dr destination mostly

#

But I don't seem to find net_connection in prom

wanton vine Sep 20, 2022, 5:57 AM

#

looks like no data on that cluster. Could you run network connections active show on that cluster and see?

grizzled peak Sep 20, 2022, 5:58 AM

#

cluster1::network connections active> show
Vserver    Interface              Remote
Name       Name:Local Port        Host:Port                    Protocol/Service
---------- ---------------------- ---------------------------- ----------------
Node: cluster1-01
vsphere    lif1:2049              10.1.0.12:828                TCP/nfs
vsphere    lif1:2049              10.1.0.11:1007               TCP/nfs
vsphere    lif1:2049              10.1.0.11:1008               TCP/nfs
vsphere    lif1:2049              10.1.0.12:829                TCP/nfs
docker     lif1:2049              10.1.0.41:890                TCP/nfs
5 entries were displayed.

wanton vine Sep 20, 2022, 5:59 AM

#

hmm strange . could you DM me the cluster details and i'll try locally

#

I am getting the data for the shared cluster

grizzled peak Sep 20, 2022, 6:06 AM

#

harvest version 22.09.19-nightly (commit 3d57787) (build date 2022-09-19T00:23:03-0400) linux/amd64

wanton vine Sep 20, 2022, 6:06 AM

#

yeah that should be fine

#

Are you sure its the same cluster? shows 5 entries in cli for u as per screenshot above and for me i get 542 entries?

grizzled peak Sep 20, 2022, 6:08 AM

#

The other one I showed you was my home lab, this one you have access

wanton vine Sep 20, 2022, 6:08 AM

#

ok do u mean u get no data for this cluster also?

grizzled peak Sep 20, 2022, 6:08 AM

#

indeed

wanton vine Sep 20, 2022, 6:08 AM

#

okay

#

may be turn on debug logs

grizzled peak Sep 20, 2022, 6:10 AM

#

wait I see that now :

nabox-harvest2        | 2022-09-20T06:07:31Z INF rest/rest.go:311 > Collected Poller=AFF apiD=28m2.239s collector=Rest:NetConnections instances=552 metrics=6624 parseD=8ms

wanton vine Sep 20, 2022, 6:10 AM

#

cool

grizzled peak Sep 20, 2022, 6:10 AM

#

Lol, that's one of those things, I didn't wait enough.

#

Isn't that suppose to collect on the next minute ?

wanton vine Sep 20, 2022, 6:10 AM

#

apiD shows 28m2.2s??

#

it took 28 minutes to get response?

#

it should collect in first poll itself

grizzled peak Sep 20, 2022, 6:11 AM

#

ohhhhhh

#

lol. 28m seems like a lot...

wanton vine Sep 20, 2022, 6:12 AM

#

indeed

#

for me i get response in 2s

#

for this cluster

grizzled peak Sep 20, 2022, 6:12 AM

#

is that a single REST call or many ?

wanton vine Sep 20, 2022, 6:12 AM

#

should be single in this case since records are tiny

#

only if it were many thousands, we go with batching

grizzled peak Sep 20, 2022, 6:14 AM

#

ok I'll test again on a local nabox

#making the switch from nabox to