Hello,
I am evaluating a log-processing approach in Dynatrace OpenPipeline to reduce log storage and licensing costs while preserving operational visibility.
The idea is to first analyze incoming logs and generate the required observability signals, such as Metric Events and Davis Events, from the relevant records. Once these events have been successfully created, the original log records would be dropped from the pipeline instead of being retained.
This approach would allow us to continue monitoring critical conditions and triggering alerts through Metric Events and Davis Events, while reducing the volume of logs stored and consumed for licensing purposes.
Proposed Flow:
Incoming Logs
↓
Filter Relevant Records
↓
Generate Metric Events
↓
Generate Davis Events
↓
Validate Event Creation
↓
Drop Original Log Records
↓
Reduce Log Retention & License Consumption
Regards,
Suraj Gupta
