cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

K8 Cronjob failed jobs should not trigger success alert after triggering failed job alert

akashkatoch
Newcomer

I have created custom log metric event which filter out failed cronjob and set this custom metric in anomalies detection metric event to monitor failed cronjobs . While setting an alert I have notice that dynatrace is triggering the alert when any job got failed and immediately triggers resolved alert  for the same failed jobs . Ideally Cronjob that got failed is already failed and there is no point for dynatrace to trigger resolved status . As since Dynatrace does not offer any default cronjob metric event but still they can add filter in metric event which restrict dynatrace to send resolved trigger for failed cronjob

3 REPLIES 3

akashkatoch
Newcomer

I saw you have edited the content , did someone acknowledge it @MaciejNeumann  ?

travis_walker
Dynatrace Enthusiast
Dynatrace Enthusiast

@wolfgang_beer Is this something you can advise on? 

wolfgang_beer
Dynatrace Leader
Dynatrace Leader

Dear @akashkatoch ,

With log events you can trigger a problem that is kept open for a default period of 15min. In case the same log event appears again in this period of time, the problem is automatically refreshed and kept in active state.

You can add a custom event property with the value 'dt.event.timeout' = 60 to set the keepalive to 60 minutes to keep it active and open for a longer period of time.

wolfgang_beer_0-1719553579822.png

In case you want the same problem to be open for days or weeks, there is no built-in mechanism in Dynatrace. This needs to be handled in an external ticketing system instead.

Best greetings,

Wolfgang

Featured Posts