NEW: Harvest 23.05.0 has been released | NetApp | Page 1

pulsar yew May 3, 2023, 12:51 PM

#

The Harvest team is happy to announce the release of 23.05.0
https://github.com/NetApp/harvest/releases/tag/v23.05.0

📌 Highlights of this major release include:

💎 Seven new dashboards:
    • StorageGRID and ONTAP fabric pool
    • Health
    • S3 object storage
    • External service operations
    • Namespace
    • SMB
    • Workloads

⭐ Several of the existing dashboards include new panels in this release:
    • StorageGRID Overview dashboard includes traffic classification panels
    • Network dashboard includes net routes
    • SVM dashboard includes LIF counters and the NFS panels filter graphs by NFS version
    • Volume dashboard includes efficiency statistics
    • Aggregate dashboard includes the amount of free space
    • Compliance dashboard only reports on data SVMs

🔐 Harvest can fetch cluster credentials via a credential script. Thanks to Ed Wilts for raising.

🌾 Harvest includes new templates to collect:
    • IP routes. Thanks jfong for contributing!
    • QoS fixed and adaptive policy groups. Thanks @faguayot for raising!
    • Cloud targets and storage
    • Export rules
    • Namespaces
    • CIFS clients
    • LIF counters
    • Volume efficiency stats

• Harvest containers are published to GitHub's container registry in addition to DockerHub and cr.netapp.io.
If you're using cr.netapp.io, we encourage you to switch to ghcr.io or DockerHub. In 2024, we will stop publishing to cr.netapp.io

• Harvest uses a distroless image as its base now - reducing the size of the container and reducing the attack surface

• Harvest collects 38 additional EMS events and alert rules in this release

• Harvest EMS alert rules were updated to include better label names and align their severity with Prometheus best practices. Thanks to @7840vz for contributing this feature!


📕 Documentation additions

velvet galleon May 3, 2023, 12:59 PM

#

Congratulations to another great and feature-rich release. Thanks to the whole team for your exemplary handling of bug reports and feature requests! Keep up the good work. 🥳

wild sandal May 3, 2023, 1:56 PM

#

Whoohoo!!!

#

Nice work team.

rugged wigeon May 3, 2023, 3:01 PM

#

Very nice team. I will install it tomorrow 😊

sullen zodiac May 3, 2023, 3:02 PM

#

Nice work. First bug 🙂
Disk dashboard, List of disks. Power on hours. ONTAP 9.11.1P6 on FAS2720 shows 16453 hours. Harvest shows 53h:00m:00s.

pulsar yew May 3, 2023, 3:03 PM

#

thanks Ed, we're on it!

pulsar yew May 3, 2023, 3:43 PM

#

sullen zodiac Nice work. First bug 🙂 Disk dashboard, List of disks. Power on hours. ONTAP ...

thanks for reporting @sullen zodiac , have confirmed the metrics are correct for zapi and rest but the dashboard is using the wrong unit. It is using clock(s) which is wrong. Which of these do you prefer? Option a (seconds 1 decimal) or option b (duration 1 decimals)?

sullen zodiac May 3, 2023, 5:21 PM

#

Something like 1.2 years has enough granularity for us.

pulsar yew May 3, 2023, 5:22 PM

#

thanks, we'll go with option a

pulsar yew May 3, 2023, 6:08 PM

#

fixed, will be in tonight's nightly https://github.com/NetApp/harvest/pull/2039

modern jewel May 4, 2023, 1:28 PM

#

Hi all, I upgrade my harvest system to the version 23.05.0 but the "Volume Sis Stat" raw in volume dashboard have "no data" in all graphs.

If I open one graph in edit mode , I see that the metrics are missing as you can see into the image.

I don't know if is my problem caused by the upgrade.

Could you help me please ?

Thank you!

pulsar yew May 4, 2023, 2:14 PM

#

hi @modern jewel can you send the log files for one of your pollers that should be reporting volume sis stats? https://github.com/NetApp/harvest/wiki/FAQ#how-do-i-share-sensitive-log-files-with-netapp

modern jewel May 4, 2023, 2:31 PM

#

I'm sorry, maybe I explain bad. I had a nightly version of harvest2.0 and now I upgraded to this version.
I'm using the container version.
The link is the same ?

pulsar yew May 4, 2023, 2:39 PM

#

the shared link describes where to email the log files - you are using the docker compose workflow? If that's correct, you can grab the logs for one of your pollers via docker logs $container the name of the container can be found via docker ps -a

when you upgraded did you regenerate your harvest-compose?
https://netapp.github.io/harvest/23.05/install/containers/#upgrade-harvest

modern jewel May 5, 2023, 8:34 AM

#

Hi @pulsar yew ,
yes , I've regenerate the harvest-compose.

I've gotten also the containers logs. Can I attach the logs here or you want a specific part of log.
The logs file has many rows 😅

pulsar yew May 5, 2023, 11:12 AM

#

can you zip them and email them to ng-harvest-files@netapp.com?

pulsar yew May 5, 2023, 12:16 PM

#

thanks @modern jewel got the email

clever folio May 5, 2023, 1:27 PM

#

Hi!
Does this contain the fix already outlined here? Namely disabling workloads by default? Or is this yaml file something I'll need to nuke after updating again?

wild sandal May 5, 2023, 1:45 PM

#

It was commented out for me.

#

I had to uncomment it.

sullen zodiac May 5, 2023, 1:48 PM

#

pulsar yew fixed, will be in tonight's nightly https://github.com/NetApp/harvest/pull/2039

I installed the 23.05.05 nightly into my nabox instance and don't see the fix. What am I missing?

clever folio May 5, 2023, 1:50 PM

#

Thanks Paul!

wild sandal May 5, 2023, 1:51 PM

#

yw.

pulsar yew May 5, 2023, 1:54 PM

#

sullen zodiac I installed the 23.05.05 nightly into my nabox instance and don't see the fix. ...

I believe nabox requires you to reset the dashboards when there are dashboard changes after upgrading. Do you recall if you pressed the reset button after upgrading?

sullen zodiac May 5, 2023, 4:11 PM

#

pulsar yew I believe nabox requires you to reset the dashboards when there are dashboard ch...

yup, I definitely reset - that's a standard part of my upgrade process. I did it again and rebooted nabox with no change. If I manually edit the dashboard and change it to seconds, I get what you said I would get. So I saved that, reset, and it didn't revert and I was still displaying seconds. This looks like a bug in nabox, not harvest. I wonder how many of my other dashboards aren't what they should be...

sullen zodiac May 5, 2023, 4:11 PM

#

sullen zodiac yup, I definitely reset - that's a standard part of my upgrade process. I did i...

@icy sorrel ?

pulsar yew May 5, 2023, 5:16 PM

#

@sullen zodiac we can check the logs if you get a chance. ssh into nabox and run docker logs -n 10 -f nabox-harvest2 then press Reset, you should see OK msgs or errors. I just tried with these versions and got these log msgs

sullen zodiac May 5, 2023, 6:53 PM

#

I see the imports, including disk.json. I currently have it set to seconds with 3 decimal points so I can see when it changes. disk.json has it set to 1 decimal point but it's not getting picked up by the grafana instance. I'm going to let it settle over the weekend and see if anything magical happens.

pulsar yew May 5, 2023, 7:00 PM

#

hmm, odd. If you click the gear icon and then Versions in the left gutter, do you see the new versions? Every time you click Reset and the bin/harvest grafana import command runs, a new version will be created like so

sullen zodiac May 5, 2023, 7:43 PM

#

I think we're getting somewhere. New versions are NOT getting created. I checked other dashboards and they are mostly dated 2022. All of the StorageGRID dashboards get new versions so I know the RESET did do something. None of the ONTAP c-dot or 7-mode dashboards are getting new versions.

sullen zodiac May 5, 2023, 8:07 PM

#

Making progress... It seems I have 2 sets of dashboards and I was looking at the wrong ones. One set is getting updated and one isn't. So how do I clean this up?

#

sullen zodiac May 5, 2023, 8:39 PM

#

I found it and deleted all of the "NetApp Detail" dashboards and now have just the ONTAP ones tagged with harvest. MUCH nicer! And yes, the power-on hours issue for me that started all of this is fixed.

icy sorrel May 5, 2023, 10:42 PM

#

Ah yes, dashboard location and name changed at some point and there is no easy way to safely delete older ones

fresh bloom May 8, 2023, 3:48 PM

#

is there away to monitor network switch ports (intercluster switches) on harvest dashboard

daring copper May 8, 2023, 4:00 PM

#

@fresh bloom Could you share ONTAP CLI command for this information?

fresh bloom May 8, 2023, 4:26 PM

#

daring copper <@1026167784104804362> Could you share ONTAP CLI command for this information?

Snmp prtocol

daring copper May 8, 2023, 4:37 PM

#

@fresh bloom I don't see an ONTAP command snmp protocol. Could you share ONTAP command that displays this information? Alternatively, if there's a ZAPI or Rest call that you could share.

viscid willow May 10, 2023, 6:53 AM

#

dashboard metrocluster ....

a FMC have FC-VI adapter, a MCIP have iWARP adapter.
the metrocluster dashboard only shows the FC-VI information.
can you implement the iWARP info also in this dashboard?

pulsar yew May 10, 2023, 11:57 AM

#

hi @viscid willow we'll take a look. Do you want these counters collected via REST or ZAPI? At the moment, they're only available via ZAPI

pulsar yew May 10, 2023, 12:16 PM

#

captured here https://github.com/NetApp/harvest/issues/2068 feel free to add comments

pulsar yew May 10, 2023, 3:34 PM

#

pull request with new template. Feel free to give it a try and let us know if that works for you. Example output here https://github.com/NetApp/harvest/issues/2068#issuecomment-1542416157

autumn ether May 25, 2023, 5:18 PM

#

@7840vz do you have screenshots of what the EMS alerting looks like?

wild sandal May 25, 2023, 6:41 PM

#

???

#

Wrong thread @autumn ether

#

?

autumn ether May 25, 2023, 7:19 PM

#

it was the right thread, but I didn't realize (until now...) that 7840vz isn't on this Discord 😦

wild sandal May 25, 2023, 8:09 PM

#

Fail

autumn ether May 25, 2023, 8:27 PM

#

it's been a bit of a day!

#NEW: Harvest 23.05.0 has been released