cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Peter_Jelitsch1
Dynatrace Participant
Dynatrace Participant

Short gaps in monitoring of one to two minutes is an expected behavior.

Why does this happen?

When the settings for a Kubernetes cluster change, the old configuration is removed from the ActiveGate, and the system tries to find the most appropriate ActiveGate to monitor the Kubernetes cluster with the new settings. Once the best matching ActiveGate is known, the monitoring with the new configuration starts on the assigned ActiveGate. Depending on the data (different metric types, events, etc.) it may take up to two minutes until monitoring resumes.

Example

We turn off monitoring events.

community-post-monitoring-settings.png

With the following command, we can see the change in the monitoring state of the ActiveGate involved. (For this example we have one containerized ActiveGate in the monitored Kubernetes cluster.)

watch 'kubectl logs -n dynatrace k8s8459-activegate-0 2> /dev/null | grep -E "Configuration (added|updated|removed)" | tail -8'

We see that at 11:18 UTC, the (old) monitoring configuration is removed and at 11:19 UTC the new configuration becomes active.

community-post-ag-log.png

In the data explorer, we can see this gap of two minutes for metrics originating from this ActiveGate (Note: the local time is CET, which is UTC+1)

community-post-gap-in-dexp.png

 

Version history
Last update:
‎11 Jan 2024 09:13 AM
Updated by:
Comments
ViniFerreira
Dynatracer
Dynatracer

Hello Peter. 

 

Thanks for sharing, this is help me. 

But I have another question. 

When this gap happen for hours, around 6 or 7 hours. Do you have any idea about this? I´m investiganting a problem like this.