topic Re: Custom alerts on Log Monitoring in Alerting

Custom alerts on Log Monitoring

mayana_khan_ext — Fri, 19 Feb 2021 03:39:56 GMT

Hi,

I have configure the string in logs to be monitor as metric (log Event) and created the custom alert with threshold of 1 count for 1min to 3min default.

The above static threshold will alerts for each error string occurrence in logs?

Also once the metric is created and added to custom chart it will detect/display the historical (older) log errors?

Re: Custom alerts on Log Monitoring

wolfgang_beer — Fri, 19 Feb 2021 09:57:33 GMT

Yes it will.

Re: Custom alerts on Log Monitoring

wolfgang_beer — Fri, 19 Feb 2021 09:58:18 GMT

Concerning historic occurances: No, it counts from the time you defined the pattern.

Re: Custom alerts on Log Monitoring

mayana_khan_ext — Mon, 22 Feb 2021 01:21:55 GMT

Also do we need to need to select the particular log process in scope? if we not selected the scope then what will be the issue?

Re: Custom alerts on Log Monitoring

Babar_Qayyum — Mon, 22 Feb 2021 07:23:42 GMT

Hello @Mayana K.

The good practice is to limit the scope, and especially when you are using the calculated metrics.

Regards,

Babar

Re: Custom alerts on Log Monitoring

mayana_khan_ext — Mon, 22 Feb 2021 07:41:21 GMT

Actually the issue we are facing is, we have configure a log monitoring error with "X" parameter by creating a custom metric.

When ever the error occurs for X parameter, The dynatrace generate a problem with "X error" and "Y error" as well, but we don`t have any reference of "Y error" in logs.

The below steps has performed to configure a alert

Search for the error in analyze logs and created X error and Y error
Created custom alerts for X and Y errors with above thresholds.
Manually updated the X error to log file for testing.

But dynatrace sends a problem with both X and Y description

Re: Custom alerts on Log Monitoring

Babar_Qayyum — Mon, 22 Feb 2021 08:52:32 GMT

Hello @Mayana K.

Did you try to limit the scope?

Are both problems coming from the same logs?

Regards,

Babar

Re: Custom alerts on Log Monitoring

mayana_khan_ext — Mon, 22 Feb 2021 08:57:55 GMT

Yes limited the scope.

And both the error are generating in same problem and coming from the same logs.

Re: Custom alerts on Log Monitoring

mayana_khan_ext — Tue, 23 Feb 2021 07:13:15 GMT

We got the fix.

X error = 'system error failed'

Y error = 'system error failure'

I was using the query to filter the logs as 'system error failed' . This will matching the both X error and Y error.

X error = 'system error failed'

Y error = 'system error failure'

seems this is why we got the alert for both x and Y errors.

I have updated the query as "'system error failed'" then it exactly matching the parameter.

Re: Custom alerts on Log Monitoring

Babar_Qayyum — Tue, 23 Feb 2021 07:42:19 GMT

Hello @Mayana K.

Nice to hear that you fixed your problem.

Regards,

Babar