#Convert microseconds to milliseconds in Grafana Alert Notifications

1 messages · Page 1 of 1 (latest)

wide ginkgo
#

I have setup NetApp Volume latency alerts in Grafana.
Whenever an alert is triggered, we get the latency value in microseconds.

Is there a way to setup the alerts to convert latency in milliseconds and trigger notification?

`[FIRING:3] Volume Top Average Latency ASE | NetApp Harvest 21.11 - cDOT (n1_aggr1_sata ntap-cluster-dev00 SY3 poller-ntap-cluster-dev00:13000 harvest ntap-cluster-dev00-01 critical ontap flexvol)
Firing
Value: [ var='B' labels={name=volume_avg_latency, aggr=n1_aggr1_sata, cluster=ntap-cluster-dev00, datacenter=SY3, instance=poller-ntap-cluster-dev00:13000, job=harvest, node=ntap-cluster-dev00-01, svm=ntap-cloud-vs2, type=flexvol, volume=ntap_cloud_vs2_00_sata} **value=112998.3873015873 **], [ var='C' labels={name=volume_avg_latency, aggr=n1_aggr1_sata, cluster=ntap-cluster-dev00, datacenter=SY3, instance=poller-ntap-cluster-dev00:13000, job=harvest, node=ntap-cluster-dev00-01, svm=ntap-cloud-vs2, type=flexvol, volume=ntap_cloud_vs2_00_sata} value=1 ]
Labels:

  • alertname = Volume Top Average Latency
  • aggr = n1_aggr1_sata
  • cluster = ntap-cluster-dev00
  • datacenter = SY3
  • grafana_folder = ASE | NetApp Harvest 21.11 - cDOT
  • instance = poller-ntap-cluster-dev00:13000
  • job = harvest
  • node = ntap-cluster-dev00-01
  • severity = critical
  • storage = ontap
  • svm = ntap-cloud-vs2
  • type = flexvol
  • volume = ntap_cloud_vs2_00_sata`

Any help is much appreciated.

wraith pumice
#

Hi @wide ginkgo , I have tried to reproduce the alerting use-case same as you mentioned in Grafana 9.X, Initially it's giving the value in microsec, because the unit of that metric is μs. I have changed the metric query in Grafana alert like this: volume_read_latency{}/1000 >= {{threshold_in_ms}} . Attached the screenshot of prometheus value and fired alert value when it's fired.