synthetic-vuc Container not transitioning to "Running" Status

[dyn98007]

This is related Synthetics Private Location deployment in a RHEL 9.x AWS EKS cluster ( k8s version 1.30).

synthetic-vuc Container not transitioning to "Running" Status.

Due to which synthetic-vuc-worker readiness probs are failing..

Please advise..Thank you

----------

$ kubectl logs -n dynatrace dynatrace-activegate-synthetic-0 -c synthetic-vuc

+ exec /opt/dynatrace/synthetic/jre/bin/java -classpath '/opt/dynatrace/synthetic/vucontroller/lib/healthcheck/*:/opt/dynatrace/synthetic/vucontroller/lib/*' --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/sun.net.dns=ALL-UNNAMED '-Xlog:gc*:file=/var/log/dynatrace/synthetic/vuc-gc.log:time,uptime,tid:filecount=10,filesize=1000000' -XX:+HeapDumpOnOutOfMemoryError -XX:+ExitOnOutOfMemoryError -XX:-UseGCOverheadLimit -Dsynthetic.process=VUC -Dconf=/var/lib/dynatrace/synthetic/config -DDYNATRACE_INSTALL_DIR=/opt/dynatrace -DDYNATRACE_LOG_DIR=/var/log/dynatrace -DDYNATRACE_TEMP_DIR=/var/tmp/dynatrace -Djava.io.tmpdir=/var/tmp/dynatrace/synthetic -DDYNATRACE_CONFIG_DIR=/var/lib/dynatrace -Djava.security.properties=/var/lib/dynatrace/synthetic/config/enableLegacyTLS.security -Dlog4j.configurationFile=/var/lib/dynatrace/synthetic/config/log4j2.xml -DSYNTHETIC_VUC_DEPLOYMENT_TYPE=private -DSYNTHETIC_VUC_BROWSER=chromium -server -Xms1024m -Xmx1024m -DNODE_SIZE=S -DLOCAL_ACTIVE_GATE_ADDRESS=localhost -DSYNTHETIC_API_PORT=9999 -DSYNTHETIC_VUC_LOG_ROLLING_FILE_SIZE=80MB -Dsynthetic.vuc.isContainerized=true -DDYNATRACE_AG_CONFIG_DIR=/var/lib/dynatrace/gateway/config -DSYNTHETIC_UNSUPPORTED_MONITORING_MODULES= com.ruxit.vuc.VucMain
2025-02-28T18:23:00,648Z INFO [main] VucMain: ==============================
2025-02-28T18:23:00,649Z INFO [main] VucMain: Starting up the engine
2025-02-28T18:23:01,278Z INFO [VUC - MainThread] VucMain: VUC state changed to: Downloading configuration

-------------

Excerpt from - kubectl describe pod -n dynatrace dynatrace-activegate-synthetic-0 

Normal Pulled 13m kubelet Successfully pulled image "12345.dkr.ecr.ap-northeast-1.amazonaws.com/quay.xyz.delivery/apm/dynatrace-activegate:1.291.48" in 180ms (180ms including waiting). Image size: 183674353 bytes.
Normal Created 13m kubelet Created container activegate
Normal Started 13m kubelet Started container activegate
Normal Pulling 13m kubelet Pulling image "12345.dkr.ecr.ap-northeast-1.amazonaws.com/quay.xyz.delivery/apm/dynatrace-synthetic-vuc:1.299.37"
Normal Pulled 13m kubelet Successfully pulled image "507365993774.dkr.ecr.ap-northeast-1.amazonaws.com/quay.xyz.delivery/apm/dynatrace-synthetic-vuc:1.299.37" in 163ms (163ms including waiting). Image size: 176491974 bytes.
Normal Created 13m kubelet Created container synthetic-vuc
Normal Started 13m kubelet Started container synthetic-vuc
Normal Pulling 13m kubelet Pulling image "12345.dkr.ecr.ap-northeast-1.amazonaws.com/quay.cnqr.delivery/apm/dynatrace-synthetic-vuc-worker:1.299.37"
Normal Pulled 13m kubelet Successfully pulled image "12345.dkr.ecr.ap-northeast-1.amazonaws.com/quay.cnqr.delivery/apm/dynatrace-synthetic-vuc-worker:1.299.37" in 142ms (142ms including waiting). Image size: 292945229 bytes.
Warning Unhealthy 3m (x59 over 12m) kubelet Readiness probe failed: HTTP probe failed with statuscode: 503

-----------------------

$ kubectl logs -n dynatrace dynatrace-activegate-synthetic-0 -c synthetic-vuc-worker-1

+ exec /opt/dynatrace/synthetic/jre/bin/java -classpath '/opt/dynatrace/synthetic/vucontroller/lib/*' --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/sun.net.dns=ALL-UNNAMED -XX:+HeapDumpOnOutOfMemoryError -XX:+ExitOnOutOfMemoryError -XX:-UseGCOverheadLimit -Dsynthetic.process=VUC-Worker -Dconf=/var/lib/dynatrace/synthetic/config -DDYNATRACE_INSTALL_DIR=/opt/dynatrace -DDYNATRACE_LOG_DIR=/var/log/dynatrace -DDYNATRACE_TEMP_DIR=/var/tmp/dynatrace -Djava.io.tmpdir=/var/tmp/dynatrace/synthetic -DDYNATRACE_CONFIG_DIR=/var/lib/dynatrace -Djava.security.properties=/var/lib/dynatrace/synthetic/config/enableLegacyTLS.security -Dlog4j.configurationFile=/var/lib/dynatrace/synthetic/config/log4j2.worker.xml -DSYNTHETIC_VUC_DEPLOYMENT_TYPE=private -DSYNTHETIC_VUC_BROWSER=chromium -DSYNTHETIC_BROWSER_PATH=/opt/dynatrace/synthetic/browser -DSYNTHETIC_PLAYBACK_DIR=/opt/dynatrace/synthetic/vucontroller/playback -DSYNTHETIC_WORKER_ID=vuc-worker-1 -server -Xms64m -Xmx64m -DNODE_SIZE=WORKER -DSYNTHETIC_VUC_LOG_ROLLING_FILE_SIZE=80MB -Dsynthetic.vuc.isContainerized=true com.ruxit.vuc.worker.VucWorkerMain
2025-03-02T04:25:06,684Z INFO [worker] VucWorkerMain: ==============================
2025-03-02T04:25:06,689Z INFO [worker] VucWorkerMain: Starting up worker
2025-03-02T04:25:07,162Z INFO [worker] VucWorkerMain: ShutdownWorkerRequest listener registered
2025-03-02T04:28:09,049Z ERROR [worker] VucWorkerMain: Exception during worker launch
java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.net.ConnectException
at com.ruxit.vuc.worker.BrowserExecutorClient.connect(BrowserExecutorClient.java:94) ~[vuc-worker-1.299.6.20240909-132018.jar:?]
at com.ruxit.config.WorkerConfigGuiceModule.lambda$getComplexPropertiesProvider$0(WorkerConfigGuiceModule.java:47) ~[vuc-worker-1.299.6.20240909-132018.jar:?]
at com.google.common.base.Suppliers$NonSerializableMemoizingSupplier.get(Suppliers.java:186) ~[guava-33.2.1-jre.jar:?]
at com.ruxit.config.loaders.SocketPropertiesLoader.load(SocketPropertiesLoader.java:29) ~[vuc-worker-1.299.6.20240909-132018.jar:?]
at com.ruxit.config.sources.PropertiesSource.initialLoad(PropertiesSource.java:75) ~[vuc-config-1.299.6.20240909-132018.jar:?]
at com.ruxit.config.ComplexPropertiesProvider.startup(ComplexPropertiesProvider.java:122) ~[vuc-config-1.299.6.20240909-132018.jar:?]
at com.ruxit.vuc.worker.VucWorkerMain.launch(VucWorkerMain.java:72) ~[vuc-worker-1.299.6.20240909-132018.jar:?]
at com.ruxit.vuc.worker.VucWorkerMain.main(VucWorkerMain.java:50) [vuc-worker-1.299.6.20240909-132018.jar:?]
Caused by: java.util.concurrent.ExecutionException: java.net.ConnectException
at java.util.concurrent.CompletableFuture.reportGet(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture.get(Unknown Source) ~[?:?]
at com.ruxit.vuc.worker.BrowserExecutorClient.connect(BrowserExecutorClient.java:77) ~[vuc-worker-1.299.6.20240909-132018.jar:?]
... 7 more
Caused by: java.net.ConnectException
at jdk.internal.net.http.common.Utils.toConnectException(Unknown Source) ~[java.net.http:?]
at jdk.internal.net.http.PlainHttpConnection.connectAsync(Unknown Source) ~[java.net.http:?]
at jdk.internal.net.http.PlainHttpConnection.checkRetryConnect(Unknown Source) ~[java.net.http:?]
at jdk.internal.net.http.PlainHttpConnection.lambda$connectAsync$1(Unknown Source) ~[java.net.http:?]
at java.util.concurrent.CompletableFuture.uniHandle(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture$UniHandle.tryFire(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture.postComplete(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown Source) ~[?:?]
at com.ruxit.vuc.execute.MDCRunnable.run(MDCRunnable.java:21) ~[vuc-core-1.299.6.20240909-132018.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[?:?]
at com.ruxit.vuc.execute.NamedThreadFactory.lambda$newThread$0(NamedThreadFactory.java:34) ~[vuc-core-1.299.6.20240909-132018.jar:?]
at java.lang.Thread.run(Unknown Source) ~[?:?]
at com.ruxit.vuc.execute.NamedThreadFactory$1.run(NamedThreadFactory.java:43) ~[vuc-core-1.299.6.20240909-132018.jar:?]
Caused by: java.nio.channels.ClosedChannelException
at sun.nio.ch.SocketChannelImpl.ensureOpen(Unknown Source) ~[?:?]
at sun.nio.ch.SocketChannelImpl.beginConnect(Unknown Source) ~[?:?]
at sun.nio.ch.SocketChannelImpl.connect(Unknown Source) ~[?:?]
at jdk.internal.net.http.PlainHttpConnection.lambda$connectAsync$0(Unknown Source) ~[java.net.http:?]
at java.security.AccessController.doPrivileged(Unknown Source) ~[?:?]
at jdk.internal.net.http.PlainHttpConnection.connectAsync(Unknown Source) ~[java.net.http:?]
at jdk.internal.net.http.PlainHttpConnection.checkRetryConnect(Unknown Source) ~[java.net.http:?]
at jdk.internal.net.http.PlainHttpConnection.lambda$connectAsync$1(Unknown Source) ~[java.net.http:?]
at java.util.concurrent.CompletableFuture.uniHandle(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture$UniHandle.tryFire(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture.postComplete(Unknown Source) ~[?:?]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown Source) ~[?:?]
at com.ruxit.vuc.execute.MDCRunnable.run(MDCRunnable.java:21) ~[vuc-core-1.299.6.20240909-132018.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[?:?]
at com.ruxit.vuc.execute.NamedThreadFactory.lambda$newThread$0(NamedThreadFactory.java:34) ~[vuc-core-1.299.6.20240909-132018.jar:?]
at java.lang.Thread.run(Unknown Source) ~[?:?]
at com.ruxit.vuc.execute.NamedThreadFactory$1.run(NamedThreadFactory.java:43) ~[vuc-core-1.299.6.20240909-132018.jar:?]
2025-03-02T04:28:09,055Z INFO [WorkerShutdownHook] VucWorkerMain: Received shutdown signal
2025-03-02T04:28:09,055Z INFO [WorkerShutdownHook] VucWorkerMain: Waiting for VUC to disconnect...

[dyn98007 · Accepted solution]

The issue was resolved by using dynatrace-activegate:1.307 version