We have recently migrated to Amazon Managed Streaming Kafka (MSK) within the AWS Cloud infrastructure. As part of our transition, we aimed to integrate CloudWatch metrics for MSK into our existing Dynatrace monitoring environment. However, we noticed that Dynatrace currently does not support metrics related to "Consumer Groups" available in CloudWatch.
The absence of Consumer Group metrics is a significant concern for us, as one of the key performance indicators that our users rely on is the lag associated with these Consumer Groups. These metrics are critical for monitoring the application's capability to efficiently process messages from the Kafka queue. They also help us make informed decisions about whether to allocate additional resources to a consuming application.
Is there an existing solution or workaround to incorporate Amazon MSK Consumer Group metrics into Dynatrace?
