cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Kafka Offset Lag

bill_scheuernst
Organizer

I am working on creating a JMX plugin for Kafka metrics. I would like to see the offset lag, per topic, and per partition. I have tried numerous times and am able to create a plugin, using the "records-lag" and "records-lag-max" Confluent metric, where the lag is per topic and per process, but never per topic and per partition, even though the configuration file suggests I can.

jmx plugin.pptx

3 REPLIES 3

david_lopes
Dynatrace Helper
Dynatrace Helper

You will need to download the extension json file (From technologies, Custom Extensions), add the partition dimension to the metric definition, and reupload it.

I can help if you would like to post the extension json file here

I would very much appreciate any assistance. We are in the midst of a major project with a 1/1/21 deliverable.plugin.txt

offset_lag.txt

It's either this or use the "kafka-consumer-groups.sh" script with the offset lag output, and then graph it in Excel. We are looking for Kafka throughput for each partition as the "engine" generating the topics and data runs on each partition.

Deepak_Gupta
Newcomer

Hi Bill,

Did you get the solution, I am looking to monitor per-topic metrics but not able to get