Discrepancies in the data for Apache Kafka

[Vikas_g1997]

Hi Team,

We are using the Apache Kafka extension to retrieve the consumer lag metric. However, we are observing discrepancies in the data.

For example, when checking certain topics like OUTBOUND_PROCESSING_TOPIC in the Dynatrace Explorer page, we see a high count of 431K, whereas the customer-reported count is 66,574.

Could someone help us understand why there is such a discrepancy in the data? We are using the following metric:
kafka.consumer.consumer-metrics.records-lag-avg