So, we can't rely on either Prometheus' internal ALERTS_FOR_STATE and endsAt, StartsAt also.
Then, what should we use to get the age of alerts? On Tuesday, April 21, 2020 at 3:40:02 PM UTC+5:30, Brian Brazil wrote: > > On Tue, 21 Apr 2020 at 11:06, Rahul Hada <[email protected] <javascript:>> > wrote: > >> We have configured Alertmanager to send alert notification to different >> mediums. Below is the sample output of one alert from alertmanager API. >> Here what does startAt & endsAt time actually refers to. Please help, as >> the endsAt time does not stands for alert ends time. >> >> ************** >> *Mountpoint:* /mnt/vol1 ","summary":"High Disk Usage on *172.20.11.80:9100 >> <http://172.20.11.80:9100>* - *dh4-k1-og-ws-n1.foo.in* >> <http://dh4-k1-og-ws-n1.dailyhunt.in> on the filesystem */mnt/vol1* >> "},"startsAt":"2020-04-13T10:40:53.612166298+05:30","endsAt":"2020-04-21T15:26:53.612166298+05:30","generatorURL":" >> http://dh4-k1-infra-prometheus-n1.foo.in:9090/graph?g0.expr=%28%28node_filesystem_size_bytes%7Bfstype%21~%22nfs.%2A%22%7D+-+node_filesystem_avail_bytes%7Bfstype%21~%22nfs.%2A%22%7D%29+%2F+node_filesystem_size_bytes%7Bfstype%21~%22nfs.%2A%22%7D+%2A+100+%3E+90%29+%2A+on%28instance%29+group_left%28nodename%29+node_uname_info\u0026g0.tab=1 >> >> <http://dh4-k1-infra-prometheus-n1.dailyhunt.in:9090/graph?g0.expr=%28%28node_filesystem_size_bytes%7Bfstype%21~%22nfs.%2A%22%7D+-+node_filesystem_avail_bytes%7Bfstype%21~%22nfs.%2A%22%7D%29+%2F+node_filesystem_size_bytes%7Bfstype%21~%22nfs.%2A%22%7D+%2A+100+%3E+90%29+%2A+on%28instance%29+group_left%28nodename%29+node_uname_info%5Cu0026g0.tab=1> >> ","status":{"state":"active","silencedBy":[],"inhibitedBy":[]},"receivers":["eben_api"] >> >> **************** >> >> Thanks in Advance >> > > endsAt is an implementation detail of how alerting is done reliably so > that a brief disruption of alerts making it to the Alertmanager won't be an > issue. Alerts are basically leases, and endsAt is when the lease is up. > > Basically you should never rely on either value, outside of debugging > Prometheus alerting in and of itself. > > -- > Brian Brazil > www.robustperception.io > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/690a9167-ba7e-4a91-bfcb-6bbd6b8f8b25%40googlegroups.com.
