Enriching logs with AWS entity information

[manisundaram]

we have 2 integrations in place

1. AWS Cloudwatch integration, where we are pulling in cloudwatch metrics for various AWS Services

2. Log integration. We are pulling in AWS Database Migration service logs from cloudwatch into Dynatrace

When logs are coming in, they are not getting mapped to entities (AWS DMS Entities) 

When looking through documentation for Dynatrace, entity linking is not available for DMS Services - https://docs.dynatrace.com/docs/shortlink/lma-stream-logs-with-firehose#view-aws-logs

We are thinking if we can use OpenPipeline to achieve this ? Is it possible - any thoughts ?

[RohitBisht]

Hi Mani,

It is possible you can get the "entity id" from the AWS service and manually tag the logs using classic log processing rules or openpipeline. 
I have done something similar in the past for cloudwatch logs and it works well.
Best is to get details about the AWS service entity from the API and then reuse it to map the topology accordingly.
https://docs.dynatrace.com/docs/shortlink/api-entities-v2-get-entity

[Peter_Youssef]

Hi @manisundaram 

In addition to valuable inputs by @RohitBisht 

Regarding the raised concern PFA resources for actual execution as per monitoring requirements:

AWS:

• https://docs.dynatrace.com/docs/ingest-from/amazon-web-services/integrate-with-aws/cloudwatch-metric...
• https://docs.dynatrace.com/docs/ingest-from/amazon-web-services/integrate-with-aws/aws-metrics-inges...
• https://video.dynatrace.com/watch/XBanorC1aSmHWhH5G6jCva
• https://www.youtube.com/watch?v=zX6CFj5EB94

Entities:

• https://docs.dynatrace.com/docs/discover-dynatrace/references/dynatrace-api/environment-api/entity-v...

Logs:

• https://docs.dynatrace.com/docs/analyze-explore-automate/logs/lma-log-ingestion/lma-log-ingestion-vi...
• https://docs.dynatrace.com/docs/analyze-explore-automate/logs/lma-use-cases

Log processing with Open Pipeline:

• https://docs.dynatrace.com/docs/analyze-explore-automate/logs/lma-openpipeline

Regarding the accurate mapping:

• You can refer to the available topology relationships upon the successful integration.
• https://docs.dynatrace.com/docs/discover-dynatrace/references/semantic-dictionary/model/dt-entities

Hoping it helps.

BR,

Peter