topic Re: Ingest log files stored in ".gz" format in AWS S3 in Log Analytics

Ingest log files stored in ".gz" format in AWS S3

Shirai — Fri, 09 May 2025 16:37:53 GMT

A customer has a question.
Is it possible to ingest ".gz" format log files stored in AWS S3 into Dynatrace and monitor them?

I understand that this is possible without any problems if the log file is in plain format. However, I don't think ".gz" can be ingested into Dynatrace. I would like to hear your opinions.

T.Shirai

Re: Ingest log files stored in ".gz" format in AWS S3

AntonPineiro — Wed, 22 May 2024 12:36:35 GMT

Hi,

Are you talking in Grail or Logs Classic?

Best regards

Re: Ingest log files stored in ".gz" format in AWS S3

Shirai — Wed, 22 May 2024 23:55:08 GMT

Thanks for your comment. I am talking about Grail.

Re: Ingest log files stored in ".gz" format in AWS S3

AntonPineiro — Thu, 23 May 2024 06:56:57 GMT

Hi,

I suppose no limitation about data format because I only see limitations in logs classic.

I have just not found similar documentation in Grail but I hope someone confirm to you.

Best regards

Re: Ingest log files stored in ".gz" format in AWS S3

jabari — Thu, 14 Nov 2024 13:14:18 GMT

Sorry, but currently log agent doesn't support gz files and rotation into gz files.

Re: Ingest log files stored in ".gz" format in AWS S3

Eonives1 — Fri, 11 Apr 2025 15:04:37 GMT

Hi everyone,

Just to share our experience — in one of our customer environments, we were able to ingest .gz compressed log files using the S3 Log Forwarder and view their contents in Dynatrace (both in Logs Classic and the new Logs UI).

However, we noticed that not all log lines are visible. While the ingestion works and we can search inside the log content, we are unable to retrieve the first and last lines from the files — even when using specific search queries for those lines.

At this point, we are trying to understand if this is:

a limitation of Dynatrace itself,
or a limitation specifically related to handling .gz compressed files.

Any insights or official confirmation would be very helpful.

Thanks!