cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Ingest log files stored in ".gz" format in AWS S3

Shirai
Advisor

A customer has a question.
Is it possible to ingest ".gz" format log files stored in AWS S3 into Dynatrace and monitor them?

I understand that this is possible without any problems if the log file is in plain format. However, I don't think ".gz" can be ingested into Dynatrace. I would like to hear your opinions.

T.Shirai

 

T.Shirai IIM Corp. Osaka Japan
5 REPLIES 5

AntonPineiro
DynaMight Guru
DynaMight Guru

Hi,

Are you talking in Grail or Logs Classic?

Best regards

❤️ Emacs ❤️ Vim ❤️ Bash ❤️ Perl

Thanks for your comment. I am talking about Grail.

T.Shirai IIM Corp. Osaka Japan

Hi,

I suppose no limitation about data format because I only see limitations in logs classic.

I have just not found similar documentation in Grail but I hope someone confirm to you.

Best regards

❤️ Emacs ❤️ Vim ❤️ Bash ❤️ Perl

jabari
Dynatrace Enthusiast
Dynatrace Enthusiast

Sorry, but currently log agent doesn't support gz files and rotation into gz files.

Eonives1
Visitor

Hi everyone,

Just to share our experience — in one of our customer environments, we were able to ingest .gz compressed log files using the S3 Log Forwarder and view their contents in Dynatrace (both in Logs Classic and the new Logs UI).

However, we noticed that not all log lines are visible. While the ingestion works and we can search inside the log content, we are unable to retrieve the first and last lines from the files — even when using specific search queries for those lines.

At this point, we are trying to understand if this is:

  • a limitation of Dynatrace itself,

  • or a limitation specifically related to handling .gz compressed files.

Any insights or official confirmation would be very helpful.

Thanks!

Featured Posts