Can't run VMware EF2 extension because of "High memory usage detected ..."

[AntonioSousa]

In a very big VMware environment, we are unable to run the EF2 VMware extension.

In the logs, the "High memory usage detected for python datasource running configuration ..." appears.

In the past, I have managed to use different performance profiles to maximize how resources are used by an ActiveGate. In some very special cases, I have also resorted to raising RAM in the AG machines.

In the VMware case, that's what we did with the client. But, it got ridiculous when I had a 32 GB machine, where 28 GB were available, but the message still appeared.

It was then that we noticed that the limit is not a percentage of the machine, but has a fixed limit per configuration, as shown in https://docs.dynatrace.com/docs/shortlink/extensions-concepts#resource-consumption

So, whatever I would raise the RAM of the machine, it wouldn't help, because the limit is fixed.

I have posted a Product Idea for this at: https://community.dynatrace.com/t5/Product-ideas/Extend-EF2-RAM-and-also-CPU-limit-per-configuration...

But, eventually there might be an undocumented config option for this?

BTW, if you get this "High memory usage detected ..." message, check if this might be happening to you.

[Peter_Youssef]

Hi @AntonioSousa 

PFA resource for checking on the deployed AG:

• https://docs.dynatrace.com/docs/shortlink/sgw-configure#memory-limits

Hoping it helps.

BR,

Peter

[AntonioSousa]

The solution to this issue is to get the following entry in extensionsuser.conf

dslimit_python_mem=2000

In this case, each monitoring configuration might use 2000 MB

Please beware that you have to make sure that you have sufficient memory in the AG to run it smoothly...

[Peter_Youssef]

Thanks @AntonioSousa for sharing the shortest solution path.

[darshil]

Hi AntonioSousa

Could you please let me know if your solution above was helpful? We are encountering the same error with our Salesforce extension configurations. I added the entry as suggested, but I am still seeing the error mentioned below.

Error: Method=process_all_logs: Callback Method=process_all_logs took 1691.0987 seconds to execute, which is longer than the interval of 600.0s

Our extensionsuser.conf looks like below currently:-

#STATSD configuration
statsdenabled=false
StatsdPort=18126

#Syslog configuration
syslogenabled=false

dslimit_python_mem=2000

Thanks!

[darshil]

Is the above error/issue totally different from "High memory usage detected for python datasource running configuration 58163fca-142f-39dc-8854-fd6d96571f71. Restarting" ? AntonioSousa

[AntonioSousa]

@darshil 

You might want to check this thread out: https://community.dynatrace.com/t5/Dynatrace-tips/PRO-TIP-Solve-quot-High-memory-usage-detected-quot...

[fstekelenburg]

Hi @AntonioSousa, you use high limits, right? We have been in the same lane with a customer. Actually support informed us that for this type of extension, they strongly advise using a dedicated AG with profile set to Dedicated, which is not documented in the extension itself.
(Ref ActiveGate in Extensions 2.0 concepts — Dynatrace Docs)
I am sure you already went there, but I figured just to mention this, for others who may encounter ESX/VMware extension deployments 😉

[AntonioSousa]

@fstekelenburg,

I was using Dedicated, but still not enough. It has a 1500 MB limit per configuration. At the moment, one of our VMware monitoring configurations is using more than 3000 MB...