fleet smelt Oct 17, 2022, 6:17 AM

#

@sacred hazel This could be similar to issue https://github.com/NetApp/harvest/issues/1173 where we have added support for AFF900. Could you share the output of below commands
bin/zapi -p POLLERNAME show data --api environment-sensors-get-iter --max 10000
bin/zapi -p POLLERNAME show data --api storage-shelf-info-get-iter --max 10000

sacred hazel Oct 17, 2022, 7:52 AM

#

thanks your answer. I have tp find how to do this on nabox

fleet smelt Oct 17, 2022, 7:56 AM

#

on NABox, you can run them like below screenshot. You need to login as root as mentioned here https://nabox.org/documentation/configuration/

sacred hazel Oct 17, 2022, 8:20 AM

#

thanks i will do that ASAP

#

i need to know more the inside of nabox

fleet smelt Oct 17, 2022, 2:18 PM

#

ok sure. Let us know if you have questions regarding NABox

sacred hazel Oct 18, 2022, 8:50 AM

#

i have the result of the command

#

it s quite big how can i share the result?

fleet smelt Oct 18, 2022, 9:03 AM

#

You can mail it to us at ng-harvest-files@netapp.com

sacred hazel Oct 18, 2022, 9:25 AM

#

ok i will compress it

fleet smelt Oct 18, 2022, 10:08 AM

#

Thanks we have received the files.

fleet smelt Oct 21, 2022, 9:40 AM

#

@sacred hazel I have gone through the logs shared. Below is the analysis.
1: shelf DS212-12 no temperature
--> There is temperature data for these shelves. Could you run below query in prometheus and share the response.
shelf_max_temperature * on(shelf) group_left(model) shelf_labels{model="DS212-12"}

2: shelf DS460-12 no data ( temperature , fan , power consumption )
--> For these also, I see the data. Could you run below query in prometheus and share the response.
shelf_max_temperature * on(shelf) group_left(model) shelf_labels{model="DS460-12"}
shelf_power * on(shelf) group_left(model) shelf_labels{model="DS460-12"}
shelf_max_fan_speed * on(shelf) group_left(model) shelf_labels{model="DS460-12"}

3: nodes FAS80x no power consumption
--> First we try to get power sensors, but only two of the nodes (cns_09 , cns_10) return power.
Since ONTAP returns power for those two nodes, Harvest will use it. You sould see power data for these nodes.
For the other nodes, (cns_n03, cns_n04, cns_n05, cns_06), since no power was returned, we try to find voltage and current sensor metrics so Harvest can calculate it ourselves. The ZAPI response does not include any voltage sensor metrics for these nodes though. There are current metrics, but without voltage metrics, Harvest is unable to calculate power for these nodes.

sacred hazel Oct 21, 2022, 10:27 AM

#

fleet smelt <@486206688047661077> I have gone through the logs shared. Below is the analysis...

1st command i got the result
Error executing query: found duplicate series for the match group {shelf="12.10"} on the right hand-side of the operation: [{name="shelf_labels", cluster="cns", datacenter="data", instance="nabox-harvest2:12990", job="harvest2", model="DS212-12", module_type="iom12", op_status="normal", serial_number="SHJHU2138000339", shelf="12.10", state="online", vendor_name="NETAPP"}, {name="shelf_labels", cluster="cng", datacenter="cng", instance="nabox-harvest2:12991", job="harvest2", model="DS212-12", module_type="iom12", op_status="normal", serial_number="SHJHU2138000338", shelf="12.10", state="online", vendor_name="NETAPP"}];many-to-many matching not allowed: matching labels must be unique on one side

#

2nd command same kind of errors
Error executing query: found duplicate series for the match group {shelf="12.11"} on the right hand-side of the operation: [{name="shelf_labels", cluster="cns", datacenter="data", instance="nabox-harvest2:12990", job="harvest2", model="DS460-12", module_type="iom12", op_status="normal", serial_number="SHJHU2142000304", shelf="12.11", state="online", vendor_name="NETAPP"}, {name="shelf_labels", cluster="cng", datacenter="cng", instance="nabox-harvest2:12991", job="harvest2", model="DS460-12", module_type="iom12", op_status="normal", serial_number="SHJHU2142000299", shelf="12.11", state="online", vendor_name="NETAPP"}];many-to-many matching not allowed: matching labels must be unique on one side
Error executing query: found duplicate series for the match group {shelf="12.11"} on the right hand-side of the operation: [{name="shelf_labels", cluster="cns", datacenter="data", instance="nabox-harvest2:12990", job="harvest2", model="DS460-12", module_type="iom12", op_status="normal", serial_number="SHJHU2142000304", shelf="12.11", state="online", vendor_name="NETAPP"}, {name="shelf_labels", cluster="cng", datacenter="cng", instance="nabox-harvest2:12991", job="harvest2", model="DS460-12", module_type="iom12", op_status="normal", serial_number="SHJHU2142000299", shelf="12.11", state="online", vendor_name="NETAPP"}];many-to-many matching not allowed: matching labels must be unique on one side

sacred hazel Oct 21, 2022, 10:37 AM

#

fleet smelt <@486206688047661077> I have gone through the logs shared. Below is the analysis...

for the first run indeed cns_n09 and cns_n10 are not 80xx FAS model. all is working well for these model which are FAS8700 . I will try now to compare what i can get on the cli and what is in the output file done by the zapi query.

📎 message.txt

fleet smelt Oct 21, 2022, 10:42 AM

#

Let me check the queries

#

Let's try below queries
shelf_max_temperature * on(shelf,cluster) group_left(model) shelf_labels{model="DS212-12"}
shelf_max_temperature * on(shelf,cluster) group_left(model) shelf_labels{model="DS460-12"}
shelf_power * on(shelf,cluster) group_left(model) shelf_labels{model="DS460-12"}
shelf_max_fan_speed * on(shelf,cluster) group_left(model) shelf_labels{model="DS460-12"}

fleet smelt Oct 21, 2022, 11:03 AM

#

sacred hazel for the first run indeed cns_n09 and cns_n10 are not 80xx FAS model. all is work...

sure. For node power, harvest tries to search for power sensors if not found, it tries to search for voltage, current (needs both to calculate power) sensors. If none of them are found then power is returned as 0. Power regex are defined here https://github.com/NetApp/harvest/blob/main/cmd/collectors/zapi/plugins/sensor/sensor.go#L44-L46

sacred hazel Oct 21, 2022, 1:01 PM

#

fleet smelt Let's try below queries `shelf_max_temperature * on(shelf,cluster) group_left(mo...

the first query seems to work i got the following result
{cluster="cng", datacenter="cng", instance="nabox-harvest2:12991", job="harvest2", model="DS212-12", shelf="10.52", unit="C"}
39
{cluster="cns", datacenter="data", instance="nabox-harvest2:12990", job="harvest2", model="DS212-12", shelf="12.13", unit="C"}
35
{cluster="cns", datacenter="data", instance="nabox-harvest2:12990", job="harvest2", model="DS212-12", shelf="13.30", unit="C"}
35
{cluster="cns", datacenter="data", instance="nabox-harvest2:12990", job="harvest2", model="DS212-12", shelf="13.31", unit="C"}
39
{cluster="cns", datacenter="data", instance="nabox-harvest2:12990", job="harvest2", model="DS212-12", shelf="13.32", unit="C"}
38

the last 3 give me the same message
Empty Query result

fleet smelt Oct 21, 2022, 1:04 PM

#

sacred hazel the first query seems to work i got the following result {cluster="cng", datacen...

Okay great so we have data for DS212-12

#

for DS460-12 I see below data.

#

Hmm given I see the data from the same input data as yours, We may have to check logs. Could you mail us the output of below command
dc logs nabox-harvest2 > nabox-harvest2.log

sacred hazel Oct 21, 2022, 2:00 PM

#

just sent

jade willow Oct 21, 2022, 2:06 PM

#

hi @sacred hazel looks like your ONTAP user is missing some permissions. Can you double check that ONTAP user that is setup for Harvest has the permissions listed here? https://github.com/NetApp/harvest/blob/main/docs/AuthAndPermissions.md#ontap-cli

sacred hazel Oct 21, 2022, 2:07 PM

#

let me check

jade willow Oct 21, 2022, 2:10 PM

#

ERR volume/volume.go:117 > Failed to collect disk data error="API request rejected => Insufficient privileges: user 'netapp-harvest' does not have read access to this resource" Poller=cng object=Volume plugin=Zapi:Volume

#

that's from the volume plugin which is sending ZAPIs that require the following permissions. It won't have any impact on the power conversation we are having here, but of course, means the security dashboard won't have data. Still looking through the log file

Permissions required for Harvest 22.05+ security dashboard

fleet smelt · 2022-10-17T06:17:57.012Z

Missing Power metrics for FAS80x and DS460-12 shelf | NetApp | Page 1

security login role create -role harvest2-role -access readonly -cmddirname "network interface"
security login role create -role harvest2-role -access readonly -cmddirname "security"
security login role create -role harvest2-role -access readonly -cmddirname "storage encryption disk"
security login role create -role harvest2-role -access readonly -cmddirname "vserver"

sacred hazel Oct 21, 2022, 3:18 PM

#

well that become tricky

#

i create another user on my netapp to put it in the harvest2 role

#

but right now i can't change the user used to acces the cluster on nabox

#

i got the message An Error Occurred

#

and when i try to acces to the Settings

#

i got the message

#

Looks like we have a problem loading this menu

#

execpt for the maintenance menu

jade willow Oct 21, 2022, 3:22 PM

#

this settings or a different one?

sacred hazel Oct 21, 2022, 3:23 PM

#

yes this one

#

and all the menu below except the maintenance menu that works

jade willow Oct 21, 2022, 3:24 PM

#

perhaps your session timed out? what if you press the lock in the upper right and and login again?

sacred hazel Oct 21, 2022, 3:25 PM

#

arghhhh

#

i was almost sure i did it

#

but now it s work

#

thanks

#

i m going on

#Missing Power metrics for FAS80x and DS460-12 shelf

Permissions required for Harvest 22.05+ security dashboard