topic Re: Multiple alerts created for 5 minutes sliding window in Alerting

Multiple alerts created for 5 minutes sliding window

Mayank_Sh — Wed, 14 Sep 2022 11:42:07 GMT

Multiple alerts created for 5 minutes sliding window

Timeframe is 16:50 to 16:52 PM.
Alert Configuration is 3 minutes threshold for 5 minutes sliding window , Please refer the Alert Configuration Screenshot.

Custom alert details below:

No Dimension filter applied.

Threshold > 1

Threshold minutes > 3 minutes

Sliding window = 5 minutes

Please refer the Alert Configuration Screenshot.

Our Expectation was only 1 alerts for this time frame. But Totally 5 alerts were triggered.

Please refer the Problem Dashboard screenshot and created alerts screenshot.

Re: Multiple alerts created for 5 minutes sliding window

mrc15816 — Sun, 18 Sep 2022 21:11:07 GMT

I haven’t done a lot of log monitoring but based on the screenshots I see each alert has a different action type i.e. GET, ADD & PLAN. If you can share the log file as well would like to understand.

Thanks

Raj

Re: Multiple alerts created for 5 minutes sliding window

Mayank_Sh — Tue, 20 Sep 2022 05:20:19 GMT

Please check attached logs file.

Re: Multiple alerts created for 5 minutes sliding window

mrc15816 — Thu, 22 Sep 2022 03:17:23 GMT

@Mayank_Sh I haven’t looked into the details of the log file, but wanted to share this behavior I noticed in my environment. We have enabled Custom Alert for NTP drift and we had 10 systems alerted and we have seen 10 alerts vs. a single alert with all the devices. I haven’t played with other alert types to see the behavior. If I find anything with your log will let you know thanks for sharing with us.