topic Dynatrace Distributed Tracing on Kubernetes in Container platforms

Dynatrace Distributed Tracing on Kubernetes

polll — Fri, 17 May 2024 07:03:09 GMT

Hey! I have deployed the Dynatrace operator on Kubernetes (cloud native approach), and I am able to see my Kubernetes cluster on my dashboard along with the infrastructure specific metrics. I know OneAgent is able to provide tracing information as well for my applications, however I cannot see anything related to tracing. When I go to the distibuted tracing page, nothing shows up, and when I'm specifically looking at my application under the kubernetes monitoring section I also don't see anything.

I was able to see tracing information when I manually instrumented the application with OpenTelemetry (adding the opentelemetry tracing jar) inside my deployment for kubernetes, however I want to implement automatic tracing with OneAgent, and it appears that I don't need to configure anything application specific for that.

Is there a certain section where I can find distributed tracing information, or do I need to configure anything either application specific or on my dynatrace operator to see tracing information? Any tips would be helpful. Thanks!

Re: Dynatrace Distributed Tracing on Kubernetes

dannemca — Thu, 16 May 2024 18:57:15 GMT

First thing is check the out of the box supported technologies : https://docs.dynatrace.com/docs/setup-and-configuration/technology-support#containers

Then if your app fits in it, the next thing you need to do once the Operator is successfully deployed, with the proper namespaces/pods set to be fully monitored , https://docs.dynatrace.com/docs/setup-and-configuration/setup-on-k8s/guides/operation/annotate#installation-options , is to re-deploy your workloads, so the pods get the OneAgent on them.

One thing I like to do is to check if the processes where your app is running has the OneAgent version metadata and if is there any message in it, like monitoring injection problems due to some builtin or custom rule. https://docs.dynatrace.com/docs/platform-modules/infrastructure-monitoring/process-groups/configuration/pg-monitoring#enable-or-disable-built-in-process-monitoring-rules

Re: Dynatrace Distributed Tracing on Kubernetes

PacoPorro — Fri, 17 May 2024 07:19:54 GMT

Do you have a direct connection from your pods to Dynatrace?
Do you have an ActiveGate configured in your operator? Is the AG able to communicate with Dynatrace?

Please run

kubectl exec deploy/dynatrace-operator -n dynatrace -- dynatrace-operator troubleshoot

Take a look on this
https://docs.dynatrace.com/docs/shortlink/installation-k8s-troubleshooting