topic Re: alerting for failed distributed traces in Alerting

Alerting for failed distributed traces

Peter_Youssef — Fri, 12 May 2023 17:49:04 GMT

I need to create an alert for the failed distributed traces for this service as attached below

I've specified the failed only and the amount of time it exceeds to be alerted on.

appreciate your support and guidance.

Re: alerting for failed distributed traces

Peter_Youssef — Tue, 03 Jan 2023 13:32:50 GMT

I've created it through creating a custom metric then create a custom events for alerting.

It's very interesting, Thanks.
If there any extra methods to configure it, please share it with me.

Re: alerting for failed distributed traces

AurelienGravier — Tue, 03 Jan 2023 21:31:56 GMT

Hello @Peter_Youssef

The best way for me :

1- Create a request naming rule on the service settings to group all your traces on the same request (request naming rules help to adjust how your requests are tracked). example of naming rule for your use case :

2- It takes a while for newly added key requests to show on the top request list, the new request will appear on your service, opening it and mark it as key request. It will help to apply different thresholds for this specific request.

3- Go on the services settings on the menu, anomaly detection and you will be able to specify a custom threshold for this key request to detect anomalies on error rate for example :

For example, this configuration will generate a problem when the error rate on the request "/b2b/trnprocessor/identifiers/no-id/sales-ext" will exceed 5% :

Regards Aurelien.

Re: alerting for failed distributed traces

AurelienGravier — Fri, 06 Jan 2023 10:14:42 GMT

hello, @Peter_Youssef

Did you try the solution ?

Re: alerting for failed distributed traces

Peter_Youssef — Fri, 06 Jan 2023 13:48:26 GMT

Tested ,Thanks for guidance @AurelienGravier

Re: alerting for failed distributed traces

Peter_Youssef — Fri, 06 Jan 2023 16:39:08 GMT

after these steps, I've created problem alerting profile and it works perfectly now.

Re: alerting for failed distributed traces

Peter_Youssef — Tue, 17 Sep 2024 06:15:40 GMT

Thanks @AurelienGravier, It worked fine.