topic Re: How to extract field from log in Log monitoring V2 in Log Analytics

How to extract field from log in Log monitoring V2

dcappare — Mon, 31 Jan 2022 09:42:32 GMT

I'm new in the community and in the use of Dynatrace.

There is someway to extract specific fields in a custom trace log.

I associate the custom log to the process but I don't find a way to extract and create a custom field.

For example if I have a logfile with these line pattern:

25/01/2021 ORD1234 OK

Is there some way to identify the ORD1234 as NrOrder and OK as Result fields to use in the search text for post processing?

Thank's a lot for helping me

Re: How to extract field from log in Log monitoring V2

Babar_Qayyum — Sun, 30 Jan 2022 07:12:43 GMT

Hello @dcappare

If you are looking for the log custom attributes. Please have a look at the below link:

https://www.dynatrace.com/support/help/how-to-use-dynatrace/log-monitoring/log-monitoring-v2/log-custom-attributes

Regards,

Babar

Re: How to extract field from log in Log monitoring V2

dcappare — Sun, 30 Jan 2022 07:26:00 GMT

Hi Babar,

thank for your reply. I have some doubt because in this article it seems that the custom metric is to built only for json log but i don' t understand if this is possible for log4Net , log4j or custom log defining some rule or regular expr to extract a specific field as a metric.
thanks a lot for your support

Re: How to extract field from log in Log monitoring V2

HansLougas — Tue, 01 Feb 2022 12:02:23 GMT

Hi dcappare,

You are correct, you can create custom metrics from API ingested logs in JSON at the moment.

Extracting specific fields from plaintext logs will be available soon!

Best regards,

Hans

Re: How to extract field from log in Log monitoring V2

mathias_indermu — Thu, 03 Feb 2022 13:26:44 GMT

"Extracting specific fields from plaintext logs will be available soon!"
Any information on which release it is planned? Looking forward to it too.

Re: How to extract field from log in Log monitoring V2

HansLougas — Fri, 04 Feb 2022 09:19:27 GMT

Most precise information will definitely be in the release notes, but the team will post here too when a release time is certain-

Re: How to extract field from log in Log monitoring V2

jegron — Mon, 02 May 2022 11:56:58 GMT

@HansLougas : Do you have an ETA for this feature ?

Re: How to extract field from log in Log monitoring V2

HansLougas — Mon, 02 May 2022 12:52:09 GMT

Hi, I am eager to share a specific ETA, but currently asking to please hold.

I will keep this thread posted as soon as we have ETA.

Re: How to extract field from log in Log monitoring V2

mathias_indermu — Mon, 09 May 2022 07:12:56 GMT

Here are some promises and an outlook:

https://youtu.be/J_y_NVWwjUc

Re: How to extract field from log in Log monitoring V2

HansLougas — Mon, 09 May 2022 09:12:59 GMT

Thanks for posting this here also Mathias!

I recommend watching through the whole Observability Clinic session, but if you're curious about extracting fields from log record, see from 53:26.

Re: How to extract field from log in Log monitoring V2

HansLougas — Tue, 31 May 2022 09:23:43 GMT

Hi all,

I'm happy to share that Log Processing has been released in Preview in Dynatrace 1.242.

Please see this feedback channel for more details.

Re: How to extract field from log in Log monitoring V2

sundarv1 — Thu, 18 Apr 2024 14:18:43 GMT

Hi Babar

log.source= "/opt/jboss/var/main.log" AND (content="error" OR content="ERROR" OR content="warning" OR content="Warning") - this is our log source. we want to get alert only if first line of content starts with error.

With the above setting, it is generating alerts when there is word "ERROR" in the entire log file