Pollers having errors after adding some new clusters

[crisp tusk]

@hot panther @obtuse garnet I am seeing some errors after adding a couple of clusters in my nabox there were around 31 clusters already in nabox and other 2 have been added, after adding those i see system is just reporting 26 active clusters and i some some errors in harvest logs

2024-06-12T06:29:37Z ERR collector/collector.go:367 > error="failed to fetch data: error making request 0: " Poller=uxxxxxxx302 collector=Rest:Status task=data
2024-06-12T06:29:37Z ERR collector/collector.go:367 > error="failed to fetch data: error making request 0: " Poller=uxxxxxxx302 collector=Rest:Volume task=data
2024-06-12T06:29:37Z ERR collector/collector.go:367 > error="failed to fetch data: error making request 0: " Poller=uxxxxxxx302 collector=Rest:SnapMirror task=data
2024-06-12T06:29:37Z ERR collector/collector.go:367 > error="failed to fetch data: error making request 0: " Poller=uxxxxxxx302 collector=Rest:Disk task=data
2024-06-12T06:29:37Z ERR collector/collector.go:367 > error="failed to fetch data: error making request 0: " Poller=uxxxxxxx302 collector=Rest:Aggr task=data
2024-06-12T06:29:37Z ERR collector/collector.go:367 > error="failed to fetch data: error making request 0: " Poller=uxxxxxxx302 collector=Rest:Node task=data
2024-06-12T06:29:37Z ERR collector/collector.go:367 > error="failed to fetch data: error making request 0: " Poller=uxxxxxxx302 collector=Rest:Lun task=data
2024-06-12T06:29:37Z ERR collector/collector.go:367 > error="failed to fetch data: error making request 0: " Poller=sxxxxxxx302 collector=Rest:Aggr task=data
2024-06-12T06:29:37Z ERR collector/collector.go:367 > error="failed to fetch data: error making request 0: " Poller=sxxxxxxx302 collector=Rest:Lun task=data
2024-06-12T06:29:37Z ERR collector/collector.go:367 > error="failed to fetch data: error making request 0: " Poller=sxxxxxxx302 collector=Rest:Status task=data

[hot panther]

What version of NAbox ?
Can you look into dmesg see if you have any OOM Kill errors ?

[obtuse garnet]

Could you also share harvest logs @ [e-mail]

[crisp tusk]

currently on 3.2 i am going to update it to 3.5.3

cant see any OOM error in dmesg

         total        used        free      shared  buff/cache   available

Mem: 16015 5218 8134 1 2663 10619
Swap: 1792 0 1792

[hot panther]

Looking good.

[crisp tusk]

i have sent the log file @obtuse garnet @hot panther

[obtuse garnet]

Received

@crisp tusk Are you using Harvest 23.02?

[crisp tusk]

yeah

is their any issue related to this in that release?

[obtuse garnet]

Okay. We have made several improvements to Rest Collector since then. Could you upgrade to either of below Harvest releases
https://github.com/NetApp/harvest/releases/tag/v24.05.0
https://github.com/NetApp/harvest/releases/tag/nightly

And then share logs if any errors.

[crisp tusk]

let me update both nabox and harvest and check

will update back in 30-45 minutes

[obtuse garnet]

nabox upgrade is not needed for this error.

[crisp tusk]

yeah bt anyway its on an old release will get both done in one go