Can't run VMware EF2 extension because of "High memory usage detected ..."

Platform Extensions
,
1

In a very big VMware environment, we are unable to run the EF2 VMware extension.

In the logs, the “High memory usage detected for python datasource running configuration …” appears.

In the past, I have managed to use different performance profiles to maximize how resources are used by an ActiveGate. In some very special cases, I have also resorted to raising RAM in the AG machines.

In the VMware case, that’s what we did with the client. But, it got ridiculous when I had a 32 GB machine, where 28 GB were available, but the message still appeared.

It was then that we noticed that the limit is not a percentage of the machine, but has a fixed limit per configuration, as shown in About Extensions — Dynatrace Docs

AntonioSousa_0-1734374894814.png
AntonioSousa_0-1734374894814.png1083×256 14.9 KB

So, whatever I would raise the RAM of the machine, it wouldn’t help, because the limit is fixed.

I have posted a Product Idea for this at: https://community.dynatrace.com/t5/Product-ideas/Extend-EF2-RAM-and-also-CPU-limit-per-configuration/idi-p/265401

But, eventually there might be an undocumented config option for this?

BTW, if you get this “High memory usage detected …” message, check if this might be happening to you.

2

Hi @AntonioSousa

PFA resource for checking on the deployed AG:

Hoping it helps.

BR,

Peter

3

The solution to this issue is to get the following entry in extensionsuser.conf

dslimit_python_mem=2000

In this case, each monitoring configuration might use 2000 MB

Please beware that you have to make sure that you have sufficient memory in the AG to run it smoothly…

4

Hi @AntonioSousa, you use high limits, right? We have been in the same lane with a customer. Actually support informed us that for this type of extension, they strongly advise using a dedicated AG with profile set to Dedicated, which is not documented in the extension itself.
(Ref ActiveGate in Extensions 2.0 concepts — Dynatrace Docs)
I am sure you already went there, but I figured just to mention this, for others who may encounter ESX/VMware extension deployments :wink:

5

@fstekelenburg,

I was using Dedicated, but still not enough. It has a 1500 MB limit per configuration. At the moment, one of our VMware monitoring configurations is using more than 3000 MB…

6

Thanks @AntonioSousa for sharing the shortest solution path.

7

Hi AntonioSousa

Could you please let me know if your solution above was helpful? We are encountering the same error with our Salesforce extension configurations. I added the entry as suggested, but I am still seeing the error mentioned below.

Error: Method=process_all_logs: Callback Method=process_all_logs took 1691.0987 seconds to execute, which is longer than the interval of 600.0s

Our extensionsuser.conf looks like below currently:-

statsd configuration
statsdenabled=false
StatsdPort=18126

syslog configuration
syslogenabled=false

dslimit_python_mem=2000

Thanks!

8

Is the above error/issue totally different from “High memory usage detected for python datasource running configuration 58163fca-142f-39dc-8854-fd6d96571f71. Restarting” ? AntonioSousa

9

@darshil

You might want to check this thread out: https://community.dynatrace.com/t5/Dynatrace-tips/PRO-TIP-Solve-quot-High-memory-usage-detected-quot-in-AG/m-p/267163

10

I’d be keen to understand how you became aware of this property as I can’t seem to find it in the documentation. I’d like to know what other options might be available? Specifically CPU limits too. I can only find one reference to this option in the docs against a Cisco extenstion.

11

@Raymondo ,
At the time, I got the info from a Support Ticket. I was authorized to put it here.
There are other configuration options, but @Mike_L I believe this info belongs better in the documentation. This was discussed in ticket #419948. Can you help?

12

@maciej_grynda something to consider for documentation.