#qtree object exceeds the data capacity of the performance subsystem

1 messages · Page 1 of 1 (latest)

frail valley
#

I have a customer cluster with over 1600 Qtrees, mostly all in one massive FlexGroup (over 10PB of data in this FlexGroup). When polling, I see these logs (I've masked the cluster name):

nabox-harvest2 | 2024-02-14T23:52:20Z INF qtree/qtree.go:228 > Collected Poller=<cluster_name> apiD=7.316s batchSize=500 metrics=13787 numQuotas=1539 object=Qtree parseD=65ms plugin=Zapi:Qtree
nabox-harvest2 | 2024-02-14T23:52:21Z INF collector/collector.go:580 > Collected Poller=<cluster_name> apiMs=1559 calcMs=0 collector=Zapi:Qtree exportMs=235 instances=1668 instancesExported=29150 metrics=11584 metricsExported=29150 parseMs=36 pluginMs=7419 pollMs=9030 zBegin=1707954731969
nabox-harvest2 | 2024-02-14T23:54:32Z INF zapiperf/zapiperf.go:1604 > API request rejected => Aggregated instances requested for the qtree object exceeds the data capacity of the performance subsystem, because it includes 152866 constituent instances. With the current counter set, use the -node, -vserver, or -filter flags to include at most 100824 constituent instances in order to stay within the data capacity. Alternatively, requesting fewer counters will also reduce the required data and may allow more instances to be requested. errNum="13001" statusCode="0" Poller=<cluster_name> collector=ZapiPerf:Qtree request=perf-object-instance-list-info-iter

Is there any way around this or this just an ONTAP limitation issue?

median gorge
#

@frail valley This is an error received from ONTAP side. We can try the following options from the Harvest side to see if they help:

  1. We could attempt to reduce the batch_size (https://netapp.github.io/harvest/23.11/help/troubleshooting/#batch_size) on the Harvest side to fetch a smaller number of instances at once. Based on my reading of past ONTAP issues in this area, this approach has not been successful.
  2. Another alternative could be to reduce the number of counters collected from the template.
  3. We could try instance filtering in the Harvest template to collect only relevant Qtree instances. Please note that this feature is currently available in the nightly build only. https://netapp.github.io/harvest/nightly/configure-zapi/#filter

If none of these options prove helpful, then you may want to consult with the ONTAP team on this matter.

Related references:

https://community.netapp.com/t5/Active-IQ-Unified-Manager-Discussions/NetApp-Harvest-data-list-update-failed/m-p/133903/highlight/true#M24300
ONTAP Burt: 1033377,928758,908322