How filter which metrics wants to gather with Harvest

[remote garnet]

Hello, I would like to know how can we filter in the harvest.yml which measurements gather or what don't? Thank you

[ocean portal]

@remote garnet Are you interested in disabling some of the counters that Harvest collects? Or perhaps you're looking to filter the object instances that are collected, such as specific volumes?

[remote garnet]

@ocean portal What I need to have is only some measurements for a specific exporter (InfluxDB) which is pointing a BD not manage by us. So we need to reduce the series inserted on that since now are too much.

[ocean portal]

@remote garnet Harvest currently does not support the feature of exporting different sets of metrics to Prometheus/InfluxDB exporters for a single poller, nor does it allow for filtering on the Harvest side for exporters. A potential workaround could be to establish two separate pollers for the same ONTAP cluster: one sending all metrics to Prometheus, and another sending a limited set of metrics using a different set of templates. This approach might increase the data collection load on the ONTAP side.
Could you please submit a feature request for this?

[remote garnet]

@ocean portal But there is any way to limit the measurements gather in the harvest config file or other place? Because we can use for now two different instances to recollect only the need it information for every DB.
I don't know if I like it too much the possibility of increase load on ONTAP site.

[cloud lava]

another option would be to use one poller collecting all metrics exporting to Prometheus as normal. Then setup Prometheus to remote write the metrics to Telegraf, which sends them to InfluxDB.

Prometheus remote write lets you create, update, delete metrics before those metrics are exported.
https://www.influxdata.com/blog/prometheus-remote-write-support-with-influxdb-2-0/
https://prometheus.io/docs/prometheus/latest/configuration/configuration/#remote_write

[patent hamlet]

@ocean portal is it possible to filter collection for qtree counters in zapiperf so qtree counters is only collected for specific SVM?

[ocean portal]

@patent hamlet Yes, the ZapiPerf filter feature is currently available in our nightly builds and will be available in our next stable release. If you want to try this out, you can access the nightly build here: https://github.com/NetApp/harvest/releases/tag/nightly. You can also find the documentation here: https://netapp.github.io/harvest/nightly/configure-zapi/#filter