cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Looking to upgrade from Dynatrace Managed to SaaS? See how

Failed to start Dynatrace after automatic upgrade

rudy_h
Helper

Hi,

I failed to start Dynatrace Cluster server after automatic upgrade as found in the log:

2025-06-11 19:00:21 UTC INFO    [<server,0x1>] [UpgradeManagerWorker] Triggering cluster upgrade to version : 1.314.70.20250607-192122
2025-06-11 19:00:21 UTC INFO    [<server,0x1>] [AutomaticUpgradeServiceImpl] Version 1.314.70.20250607-192122 is present
2025-06-11 19:00:21 UTC INFO    [<server,0x1>] [AutomaticUpgradeServiceImpl] Check preconditions
2025-06-11 19:00:21 UTC INFO    [<server,0x1>] [UpgradeCommunication] Checking upgrade preconditions started
2025-06-11 19:00:21 UTC INFO    [<server,0x1>] [UpgradeCommunication] Checking preconditions on local node 1
2025-06-11 19:00:31 UTC INFO    [<server,0x1>] [<server>, UpgradeManagementImpl] Execute launch-system-check.sh script
---
---
---
2025-06-11 19:14:23 UTC INFO    [<server,0x1>] [<server>, ServerLifecycle] Shutting down Hazelcast cluster ...
2025-06-11 19:14:23 UTC INFO    [<server,0x1>] [APMClusterServiceImpl] [xxx.xx.xx.xxx]:5701 [xxx] Address[xxx.xx.xx.xxx]:5701 is SHUTTING_DOWN
2025-06-11 19:14:23 UTC INFO    [<server,0x1>] [ClusterResponsibilityStrategyFactory] Lifecycle Event received: SHUTTING_DOWN
2025-06-11 19:14:25 UTC INFO    [<server,0x1>] [APMClusterServiceImpl] [xxx.xx.xx.xxx]:5701 [xxx] Destroying node initializer.
2025-06-11 19:14:25 UTC INFO    [<server,0x1>] [APMClusterServiceImpl] [xxx.xx.xx.xxx]:5701 [xxx] Hazelcast Shutdown is completed in 1430 ms.
2025-06-11 19:14:25 UTC INFO    [<server,0x1>] [APMClusterServiceImpl] [xxx.xx.xx.xxx]:5701 [xxx] Address[xxx.xx.xx.xxx]:5701 is SHUTDOWN
2025-06-11 19:14:25 UTC INFO    [<server,0x1>] [ClusterResponsibilityStrategyFactory] Lifecycle Event received: SHUTDOWN
2025-06-11 19:14:25 UTC INFO    [<server,0x1>] [<server>, ServerLifecycle] Shutting down Webserver...
2025-06-11 19:14:25 UTC SEVERE  [<server,0x1>] [<server>, ServerLifecycle] Shutdown failed
java.lang.NullPointerException: Cannot invoke "com.dynatrace.core.platform.api.worker.WorkerPool.stop(long)" because "this.userGroupConfigEventWorkerPool" is null
at com.dynatrace.apm.iam.data.LevelPolicyBindingStoreEventSubscriber.stop(LevelPolicyBindingStoreEventSubscriber.java:65)
at com.dynatrace.apm.iam.service.LevelPolicyBindingServiceFactory.unregisterEventBusHandlers(LevelPolicyBindingServiceFactory.java:66)
at com.dynatrace.apm.iam.api.OnPremIamWiring.unregisterEventBusHandlers(OnPremIamWiring.java:198)
at com.compuware.apm.server.onprem.OnPremServerLifecycle.unregisterManagedGlobalEventBusHandlers(OnPremServerLifecycle.java:3135)
at com.compuware.apm.server.onprem.OnPremServerLifecycle.unregisterGlobalEventBusHandlers(OnPremServerLifecycle.java:3111)
at com.compuware.apm.server.core.api.ServerLifecycle.shutdownWithoutExit(ServerLifecycle.java:4041)
at com.compuware.apm.server.core.api.ServerLifecycle.shutdown(ServerLifecycle.java:3800)
at com.compuware.apm.server.core.ServerShutdownRunner.run(ServerShutdownRunner.java:121)
at java.base/java.lang.Thread.run(Unknown Source)
 
2025-06-11 19:14:25 UTC INFO    [<server,0x1>] [<server>, ServerLifecycle] [Server shutdown] took 3 seconds
2025-06-11 19:14:25 UTC INFO    [<server,0x1>] [<server>, BasicLifecycle] Finished shutdown. 
2025-06-11 19:14:25 UTC INFO    [<server,0x1>] [<server>, BasicLifecycle] Checking for unexpected non-daemon threads
2025-06-11 19:14:25 UTC WARNING [<server,0x1>] [<server>, BasicLifecycle] non-daemon threads: BasicLifecycle.exitVm() was called
"foundation-pausedog-0" Id=35 TIMED_WAITING
2025-06-11 19:14:25 UTC INFO    [<server,0x1>] [<server>, BasicLifecycle] Exiting with code=0
2025-06-11 19:14:25 UTC INFO    [<server,0x1>] [<com.compuware.apm.logging>, LoggingServiceImpl] Logging service is shutting down.
2025-06-11 19:15:52 UTC INFO    [<header>] +-----------------------------------------------------------------------------
2025-06-11 19:15:52 UTC INFO    [<header>] + Dynatrace LLC
2025-06-11 19:15:52 UTC INFO    [<header>] +-----------------------------------------------------------------------------
2025-06-11 19:15:52 UTC INFO    [<header>] + Version 1.314.53.20250607-172326
2025-06-11 19:15:52 UTC INFO    [<header>] + server: 0x1; cluster: xxx;
2025-06-11 19:15:52 UTC INFO    [<server,0x1>] [<com.compuware.apm.logging>, LoggingServiceImpl] Platform: Linux, Version: 5.14.0-362.13.1.el9_3.x86_64, Architecture: amd64, Processors: 4
2025-06-11 19:15:52 UTC INFO    [<server,0x1>] [<com.compuware.apm.logging>, LoggingServiceImpl] VM: OpenJDK 64-Bit Server VM, Version: 21.0.6, Vendor: Eclipse Adoptium, Memory [maxMemory=11560M, initHeap=11560M, maxHeap=11560M, usedMeta=20M, committedMeta=20M, totalPhysicalMemory=32109M, freePhysicalMemory=5813M]
2025-06-11 19:15:52 UTC INFO    [<server,0x1>] [<com.compuware.apm.logging>, LoggingServiceImpl] file.encoding: UTF-8, sun.jnu.encoding: UTF-8, user.name: dynatrace
2025-06-11 19:15:52 UTC INFO    [<server,0x1>] [<com.compuware.apm.logging>, LoggingServiceImpl] Input Arguments: -Dcom.compuware.apm.WatchDogTimeout=180 -Xms11559M -Xmx11559M -Duser.language=EN -Dfile.encoding=UTF-8 -Dsun.jnu.encoding=UTF-8 -Djava.io.tmpdir=/opt/dynatrace-managed/server/tmp-bin -XX:+UseG1GC -XX:MaxGCPauseMillis=2000 -XX:-OmitStackTraceInFastThrow -XX:+ExplicitGCInvokesConcurrent -XX:StringTableSize=5000011 -XX:ReservedCodeCacheSize=1024m -Djava.net.preferIPv4Stack=true -Djava.util.logging.manager=com.dynatrace.gen2.foundation.logging.impl.backend.CustomShutdownLogManager -Dorg.jboss.logging.provider=jdk -Dslf4j.provider=com.dynatrace.gen2.foundation.slf4j.FoundationLoggerServiceProvider -Dslf4j.internal.report.stream=stdout -Dcom.dynatrace.elasticsearch.check=false -Dcom.sun.jndi.ldap.object.disableEndpointIdentification=true -Djdk.tls.ephemeralDHKeySize=2048 -Dlog4j2.formatMsgNoLookups=true -Dorg.bytedeco.javacpp.cachedir=/opt/dynatrace-managed/server/tmp-bin/.javacpp/cache --add-opens=java.base/java.lang=ALL-UNNAMED -Dcom.compuware.apm.WatchDogPort=50000 -agentpath:/opt/dynatrace/oneagent/agent/bin/1.315.58.20250607-103115/linux-x86-64/liboneagentjava.so=loglevelcon=none,datastorage=/var/lib/dynatrace/oneagent/datastorage,logdir=/var/log/dynatrace/oneagent
2025-06-11 19:15:54 UTC INFO    [<server,0x1>] [FoundationLoggerServiceProvider] Custom Dynatrace SLF4J implementation is bound.
2025-06-11 19:17:04 UTC INFO    [<server,0x1>] [<server>, ServerLifecycle] starting Managed classic server

 

Does anyone know what is wrong?

4 REPLIES 4

adam_litwin
Dynatrace Participant
Dynatrace Participant

For upgrade issues, I suggest checking /var/log/dynatrace/install.log or/and /var/opt/dynatrace-managed/log/installer/*

Hi Adam,

Upgrade was completed successfully:

rudy_h_0-1750069021674.png

But the problem is the upgrade version result (1.314.53) is different with the upgrade version target (1.314.70).

You may see the upgrade version in the above log:

2025-06-11 19:15:52 UTC INFO    [<header>] +-----------------------------------------------------------------------------
2025-06-11 19:15:52 UTC INFO    [<header>] + Dynatrace LLC
2025-06-11 19:15:52 UTC INFO    [<header>] +-----------------------------------------------------------------------------
2025-06-11 19:15:52 UTC INFO    [<header>] + Version 1.314.53.20250607-172326
2025-06-11 19:15:52 UTC INFO    [<header>] + server: 0x1; cluster: xxx;
 
And the upgrade version target is:

 

2025-06-11 19:00:21 UTC INFO    [<server,0x1>] [UpgradeManagerWorker] Triggering cluster upgrade to version : 1.314.70.20250607-192122
2025-06-11 19:00:21 UTC INFO    [<server,0x1>] [AutomaticUpgradeServiceImpl] Version 1.314.70.20250607-192122 is present

adam_litwin
Dynatrace Participant
Dynatrace Participant

It should be investigated via RFA ticket. As I see correctly it's already created MGD-5241

Hi Adam,

Can the R&D team reproduce the issue in their own environment? Please recommend temporary solution while the R&D team fix it in an incoming newest installer.

Thanks

Featured Posts