topic Can't run VMware EF2 extension because of "High memory usage detected ..." in Extensions

Can't run VMware EF2 extension because of "High memory usage detected ..."

AntonioSousa — Sun, 22 Dec 2024 19:01:36 GMT

In a very big VMware environment, we are unable to run the EF2 VMware extension.

In the logs, the "High memory usage detected for python datasource running configuration ..." appears.

In the past, I have managed to use different performance profiles to maximize how resources are used by an ActiveGate. In some very special cases, I have also resorted to raising RAM in the AG machines.

In the VMware case, that's what we did with the client. But, it got ridiculous when I had a 32 GB machine, where 28 GB were available, but the message still appeared.

It was then that we noticed that the limit is not a percentage of the machine, but has a fixed limit per configuration, as shown in https://docs.dynatrace.com/docs/shortlink/extensions-concepts#resource-consumption

So, whatever I would raise the RAM of the machine, it wouldn't help, because the limit is fixed.

I have posted a Product Idea for this at: https://community.dynatrace.com/t5/Product-ideas/Extend-EF2-RAM-and-also-CPU-limit-per-configuration/idi-p/265401

But, eventually there might be an undocumented config option for this?

BTW, if you get this "High memory usage detected ..." message, check if this might be happening to you.

Re: Can't run VMware EF2 extension because of "High memory usage detected ..."

Peter_Youssef — Tue, 17 Dec 2024 07:47:00 GMT

Hi @AntonioSousa

PFA resource for checking on the deployed AG:

https://docs.dynatrace.com/docs/shortlink/sgw-configure#memory-limits

Hoping it helps.

BR,

Peter

Re: Can't run VMware EF2 extension because of "High memory usage detected ..."

AntonioSousa — Sat, 11 Jan 2025 21:24:38 GMT

The solution to this issue is to get the following entry in extensionsuser.conf

dslimit_python_mem=2000

In this case, each monitoring configuration might use 2000 MB

Please beware that you have to make sure that you have sufficient memory in the AG to run it smoothly...

Re: Can't run VMware EF2 extension because of "High memory usage detected ..."

fstekelenburg — Mon, 13 Jan 2025 16:02:13 GMT

Hi @AntonioSousa, you use high limits, right? We have been in the same lane with a customer. Actually support informed us that for this type of extension, they strongly advise using a dedicated AG with profile set to Dedicated, which is not documented in the extension itself.
(Ref ActiveGate in Extensions 2.0 concepts — Dynatrace Docs)
I am sure you already went there, but I figured just to mention this, for others who may encounter ESX/VMware extension deployments 😉

Re: Can't run VMware EF2 extension because of "High memory usage detected ..."

AntonioSousa — Mon, 13 Jan 2025 16:07:01 GMT

@fstekelenburg,

I was using Dedicated, but still not enough. It has a 1500 MB limit per configuration. At the moment, one of our VMware monitoring configurations is using more than 3000 MB...

Re: Can't run VMware EF2 extension because of "High memory usage detected ..."

Peter_Youssef — Mon, 13 Jan 2025 22:41:24 GMT

Thanks @AntonioSousa for sharing the shortest solution path.

Re: Can't run VMware EF2 extension because of "High memory usage detected ..."

darshil — Wed, 09 Apr 2025 08:27:57 GMT

Hi AntonioSousa

Could you please let me know if your solution above was helpful? We are encountering the same error with our Salesforce extension configurations. I added the entry as suggested, but I am still seeing the error mentioned below.

Error: Method=process_all_logs: Callback Method=process_all_logs took 1691.0987 seconds to execute, which is longer than the interval of 600.0s

Our extensionsuser.conf looks like below currently:-

#STATSD configuration
statsdenabled=false
StatsdPort=18126

#Syslog configuration
syslogenabled=false

dslimit_python_mem=2000

Thanks!

Re: Can't run VMware EF2 extension because of "High memory usage detected ..."

darshil — Wed, 09 Apr 2025 08:28:10 GMT

Is the above error/issue totally different from "High memory usage detected for python datasource running configuration 58163fca-142f-39dc-8854-fd6d96571f71. Restarting" ? AntonioSousa

Re: Can't run VMware EF2 extension because of "High memory usage detected ..."

AntonioSousa — Wed, 09 Apr 2025 09:29:17 GMT

@darshil

You might want to check this thread out: https://community.dynatrace.com/t5/Dynatrace-tips/PRO-TIP-Solve-quot-High-memory-usage-detected-quot-in-AG/m-p/267163

Re: Can't run VMware EF2 extension because of "High memory usage detected ..."

Raymondo — Thu, 12 Feb 2026 09:24:17 GMT

I'd be keen to understand how you became aware of this property as I can't seem to find it in the documentation. I'd like to know what other options might be available? Specifically CPU limits too. I can only find one reference to this option in the docs against a Cisco extenstion.

Re: Can't run VMware EF2 extension because of "High memory usage detected ..."

AntonioSousa — Thu, 12 Feb 2026 20:34:41 GMT

@Raymondo ,
At the time, I got the info from a Support Ticket. I was authorized to put it here.
There are other configuration options, but @Mike_L I believe this info belongs better in the documentation. This was discussed in ticket #419948. Can you help?

Re: Can't run VMware EF2 extension because of "High memory usage detected ..."

Mike_L — Thu, 12 Feb 2026 22:13:51 GMT

@maciej_grynda something to consider for documentation.