Activation of deep monitoring was unsuccessful, injection is manually disabled after update to version CLR (FullCLR 4.8.4645.0)

[jiri_stefanek]

After Windows upgrade we are facing problems with OA injection to the processes on multiple servers (IIS processes are affected.).

Dynatrace complains that activation of deep monitoring was unsuccessfull, even though that deep monitoring setting is set ON - monitor. 

We noticed that the problematic processes use a different version of the secondary CLR technology. The problematic processes use a newer version of the CLR (FullCLR 4.8.4645.0), while the working processes use an older version of the CLR (FullCLR 4.0.30319.0).

Any tips on how to fix the problem? Or is it possible to downgrade to CLR (FullCLR 4.8.4645.0)?

[radek_jasinski]

Hi @jiri_stefanek 

As far as I can see .NET version 4.8 is supported (perhaps it's in too new a version - just my guess).
Have you updated OneAgent as well?

https://docs.dynatrace.com/docs/shortlink/section-technology-support#net-framework

Radek

[jiri_stefanek]

Hi @radek_jasinski  yes OneAgent running on the latest version 1.277

[radek_jasinski]

You could still try opting for an older version of RUM JS. Do you have any OA log entries about the error?

[hampmdus]

Hi Radek,

could you please advice us where exactly (in which log) we should look for error entries? We already discussed this topic with support and only mention about CLR was found in SupportArchiveB6236DBF\support_archive\AGENT\e614228e6542d336\logs\dotnet\ruxitagent_RISE.ROTI.Log.LogSenderService.exe_3048.0.log (LogSenderService is name of one of faulty services)

2023-11-28 06:48:42.819 UTC [00000bdc] severe [dotnet] Error in NativeAgentCallbacks: Object reference not set to an instance of an object.
2023-11-28 06:48:42.881 UTC [00000bec] info [dotnet] .NET Agent initialized (AppDomain: DefaultDomain[1], CLR Version: 4.0.30319.42000)
2023-11-28 06:48:42.881 UTC [00000bec] info [dotnet] GC Settings: Workstation, LatencyMode: Interactive
2023-11-28 06:48:42.881 UTC [00000bec] info [dotnet] Using new PInvoke layer: False
2023-11-28 06:48:42.882 UTC [00000bec] info [dotnet] [AgentConfig] sensor.stringTruncationLimit.webrequest=4096
2023-11-28 06:48:42.882 UTC [00000bec] info [dotnet] [AgentConfig] optionCaptureStackSourceInfoDotnet=False
2023-11-28 06:48:42.882 UTC [00000bec] debug [dotnet] PHASE END: prepare
2023-11-28 06:48:42.882 UTC [00000bec] debug [dotnet] PHASE: start
2023-11-28 06:48:42.884 UTC [00000bec] info [dotnet] [ContextPropagation] Storage is: AsyncLocalStoreWithHolder
2023-11-28 06:48:42.886 UTC [00000bec] info [dotnet] [Operations] setup: compat mode
2023-11-28 06:48:42.895 UTC [00000bdc] severe [dotnet] System.NullReferenceException: Object reference not set to an instance of an object.
at Dynatrace.OneAgent.Sto.Trace.IsChannelEnabled(String channelName)
at Dynatrace.OneAgent.Sto.Trace.GetChannel(String channelName)
at Dynatrace.OneAgent.Sampling.AutoSensor.Run()
at Dynatrace.OneAgent.Communication.NativeAgentCallbacks.IntCallback(Int32 iRef, Int64 lIdx, Int32 data)
2023-11-28 06:48:42.909 UTC [00000bec] debug [dotnet] PHASE END: start
2023-11-28 06:48:42.909 UTC [00000bec] debug [dotnet] INIT OK
2023-11-28 06:48:43.106 UTC [00000bec] debug [dotnet] INIT 'System'
2023-11-28 06:48:43.495 UTC [00000bec] info [dotnet] [ConfigFlags] initialized for System
2023-11-28 06:48:43.501 UTC [00000bec] debug [dotnet] MODULE TYPE Runtime
2023-11-28 06:48:43.501 UTC [00000bec] debug [dotnet] PHASE: prepare
2023-11-28 06:48:43.501 UTC [00000bec] debug [dotnet] PHASE END: prepare
2023-11-28 06:48:43.501 UTC [00000bec] debug [dotnet] PHASE: start
2023-11-28 06:48:43.501 UTC [00000bec] debug [dotnet] PHASE END: start
2023-11-28 06:48:43.501 UTC [00000bec] debug [dotnet] INIT OK
2023-11-28 06:48:43.832 UTC [00000bec] debug [dotnet] INIT 'System.Messaging'
2023-11-28 06:48:43.958 UTC [00000bec] info [dotnet] [ConfigFlags] initialized for System.Messaging
2023-11-28 06:48:43.958 UTC [00000bec] debug [dotnet] MODULE TYPE Runtime
2023-11-28 06:48:43.958 UTC [00000bec] debug [dotnet] PHASE: prepare
2023-11-28 06:48:43.958 UTC [00000bec] debug [dotnet] PHASE END: prepare
2023-11-28 06:48:43.958 UTC [00000bec] debug [dotnet] PHASE: start
2023-11-28 06:48:43.958 UTC [00000bec] debug [dotnet] PHASE END: start
2023-11-28 06:48:43.958 UTC [00000bec] debug [dotnet] INIT OK
2023-11-28 06:48:43.995 UTC [00000e64] info [dotnet] [InProcTagging] created the local path handler
2023-11-28 06:48:44.041 UTC [00000e6c] info [native] tech detected: TECHNOLOGIES__KNOWN__TECHNOLOGY__WCF (4.8.4645.0)
2023-11-28 06:48:44.301 UTC [00000e6c] debug [dotnet] INIT 'System.ServiceModel'
2023-11-28 06:48:45.125 UTC [00000e6c] info [dotnet] [ConfigFlags] initialized for System.ServiceModel
2023-11-28 06:48:45.133 UTC [00000e6c] debug [dotnet] MODULE TYPE Runtime
2023-11-28 06:48:45.133 UTC [00000e6c] debug [dotnet] PHASE: prepare
2023-11-28 06:48:45.133 UTC [00000e6c] debug [dotnet] PHASE END: prepare
2023-11-28 06:48:45.133 UTC [00000e6c] debug [dotnet] PHASE: start
2023-11-28 06:48:45.133 UTC [00000e6c] debug [dotnet] PHASE END: start
2023-11-28 06:48:45.133 UTC [00000e6c] debug [dotnet] INIT OK
2023-11-28 06:48:46.142 UTC [00000890] info [native] Creating message queue 'discovery_entry_point' ...
2023-11-28 06:48:46.143 UTC [00000890] info [native] Could not connect to pipe:\\.\pipe\discovery_entry_point5 for 0 seconds, in SocketPipeMessageQueueWriterImpl::create, error code: 2, error message: The system cannot find the file specified. hPipe:FFFFFFFF
2023-11-28 06:49:06.174 UTC [00000890] info [native] Successfully connected to pipe \\.\pipe\discovery_entry_point after trying for 20 seconds
2023-11-28 06:52:38.430 UTC [00000844] info [comm ] URL https://xxxxxxxx:9999/communication  not working (Resolving timed out after 2001 milliseconds)
2023-11-28 06:52:40.441 UTC [00000844] info [comm ] URL https://xx.xxx.xx.xxx:9999/communication  not working (Connection timed out after 2011 milliseconds)
2023-11-28 06:52:42.455 UTC [00000844] info [comm ] URL https://xx.xxx.xx.xxx.:9999/communication  not working (Connection timed out after 2013 milliseconds)
2023-11-28 06:52:43.981 UTC [00000844] info [comm ] Connected to https://xx.xxx.xx.xxx:443/communication 
2023-11-28 06:53:54.643 UTC [00000bec] info [native] Shutting down CLR profiler... 3052
2023-11-28 06:53:54.643 UTC [00000bec] info [native] Merging EIMAP with C:/ProgramData/dynatrace/oneagent/agent/runtime/0x47077739e6457d00_dotnet_S-1-5-21-3521595049-301303566-333748410-115198_1/eimap
2023-11-28 06:53:54.647 UTC [00000bec] info [native] Saving EIMAP to C:/ProgramData/dynatrace/oneagent/agent/runtime/0x47077739e6457d00_dotnet_S-1-5-21-3521595049-301303566-333748410-115198_1/eimap
2023-11-28 06:53:54.650 UTC [00000890] info [native] Thread 'oneagentperiodicevents' exiting (kernel thread ID 2192)...
2023-11-28 06:53:54.650 UTC [00000844] info [native] Thread 'oneagentperiodicurls' exiting (kernel thread ID 2116)...
2023-11-28 06:53:54.650 UTC [00000908] info [native] Thread 'oneagentperiodicrequests' exiting (kernel thread ID 2312)...
2023-11-28 06:53:54.650 UTC [00000b94] info [native] Thread 'DotNetSamplingModule' exiting (kernel thread ID 2964)...
2023-11-28 06:53:54.665 UTC [00000bdc] info [native] Thread 'DotNetSamplingModule' exiting (kernel thread ID 3036)...
2023-11-28 06:53:54.667 UTC [000009a0] info [native] Thread 'oneagentsubpathsender' exiting (kernel thread ID 2464)...
2023-11-28 06:53:54.667 UTC [00000bec] info [cstats] Connection Status (48 times 1800s) : 0648
2023-11-28 06:53:54.667 UTC [000008ac] info [native] Thread 'oneagentrequesthandler' exiting (kernel thread ID 2220)...
2023-11-28 06:53:54.667 UTC [00000bec] info [cstats] https://xx.xxx.xxx.xx443/communication  : *
2023-11-28 06:53:54.667 UTC [00000bec] info [cstats] https://xx.xxx.xx.xx:9999/communication : -
2023-11-28 06:53:54.667 UTC [00000bec] info [cstats] https://xx.xxx.xx.xx9999/communication : -
2023-11-28 06:53:54.667 UTC [00000bec] info [cstats] https://xxxxxxxx:9999/communication  : -
2023-11-28 06:53:54.671 UTC [00000bec] info [native] Successfully sent shutdown message (3ms)
2023-11-28 06:53:54.671 UTC [000003c8] info [native] Trying to flush async messages
2023-11-28 06:53:54.671 UTC [000003c8] info [native] Thread 'oneagentasyncsender' exiting (kernel thread ID 968)...
2023-11-28 06:53:54.672 UTC [00000144] info [native] Trying to flush async messages
2023-11-28 06:53:54.672 UTC [00000144] info [native] Thread 'oneagentasyncsender' exiting (kernel thread ID 324)...
2023-11-28 06:53:54.672 UTC [00000bec] info [native] Shutdown successful processType(DEFAULT)

[radek_jasinski · Accepted solution]

Hi @hampmdus 

I see a lot of errors in your log (for example: System.NullReferenceException: Object reference not set to an instance of an object.). I recommend to open the support ticket for this problem.

probably your version is not supported.

Radek

[hampmdus]

Thank you for your insight Radek. Support archive is already opened and we are waiting for reply. 

Dušan

[radek_jasinski]

Great, please let’s us know if you have any info! 

[hampmdus]

Hi Radek,

sorry for late reply - I totally forgot about this topic. 

Situation was solved by full reinstall of OneAgent.

Br,

Dušan