topic Re: Oneagent in minikube failing to deploy in Container platforms

OneAgent in Minikube failing to deploy

TomLichti — Thu, 18 Aug 2022 10:10:44 GMT

I am trying to work through the DTU Kubernetes lab, and I am stuck on what feels like the last step. The OneAgent pod will not start, the log is ending with the following:

00:49:55 Started with user: uid=0(root) gid=0(root) groups=0(root)
00:49:55 Error: Container was not launched in host's cgroup namespace
00:49:55 Error: Dynatrace OneAgent requires parameters: --pid, --net and --cgroupns set to 'host'.
00:49:55 If you are not sure how to launch the container please visit: https://www.dynatrace.com/support/help/shortlink/oneagent-docker
00:49:55 Error: Initialization procedure failed

I have googled every error message, combed through yaml files, and I have not been able to figure out if this is the real issue, or something else? I've tried adding the 'useUnprivilegedMode: true' setting in the dynakube.yaml, but it didn't make a difference. I'm fairly new to deploying Dynatrace in K8S, not new to Dynatrace though, this one has me stumped!

Thanks for any help.

Tom

Re: Oneagent in minikube failing to deploy

andre_f — Mon, 15 Aug 2022 09:57:48 GMT

Hi @TomLichti,

Can you give some more information?
E.g. link to the lab or did you use a Dynatrace guide for deployment? If yes, which one? For example, have you used this guide for Kubernetes classicFullStack? Did you use manual or automatic or helm for deployment?

Re: Oneagent in minikube failing to deploy

TomLichti — Mon, 15 Aug 2022 12:23:04 GMT

Hi @andre_f,

I used the automated Dynatrace Operator guide here: Get started with Kubernetes/OpenShift monitoring | Dynatrace Docs

The lab I am working on is this one: https://university.dynatrace.com/assets/23274/LabKubernetes.pdf

I created another full Kubernetes cluster on another completely separate server, and had the exact same problem and error. On the new cluster, before I installed K8S, I had a docker instance, oneagent and activegate installed outside docker and it worked perfectly. I removed oneagent, activegate and docker completely, and started with K8S from scratch, and had the same problem.

As a test I installed the onegent again outside the cluster and that seems to work.

Re: Oneagent in minikube failing to deploy

andre_f — Mon, 15 Aug 2022 19:26:36 GMT

Hi @TomLichti,
I tried to reproduce it, but didn't have these problems. The OneAgent pod was able to start.
My setup looks like this:

created VM with multipass
minikube installed
docker installed
started Minikube
created yaml for the application and run apply command
in the Dynatrace menu in the area Manage
Deploy Dynatrace > Start Installation > click here Kubernetes
enter a name, create Dynatrace operator token (see screenshot - (1) )
download dynakube.yaml and copy file to minikube VM or copy content to a file dynakube.yaml on the vm
I copied the commands in the window (see screenshot - (2) ) individually and executed them one after the other
Wait until pods Operator, ActiveGate and OneAgent(s) are running
"kubectl get all -n dynatrace" or "minikube kubectl -- get all -n dynatrace" should show this

It was a new VM only minikube and docker were installed according to instructions.

Is it possible that you have also executed steps from this documentation?

Re: Oneagent in minikube failing to deploy

TomLichti — Mon, 15 Aug 2022 20:01:58 GMT

I followed the exact same steps that you did. The only difference, and this may be the root cause, is that on the new server I had previously installed Docker (not Kubernetes), and standalone (not containerized) ActiveGate and OneAgent. I thought I had removed all of those components and started fresh, but it was still on the same server. Having said that, my first attempt was on a VirtualBox VM that I don't think had anything other than a K8S deployment, but I will start that from scratch with a new VM and see how it goes.

Thank you for investigating!

Re: Oneagent in minikube failing to deploy

techean — Tue, 16 Aug 2022 05:01:52 GMT

Tom just to confirm and also @andre_f ,

What are the underline OS being used in your VMs? is it open source Linux or red hat linux

Re: Oneagent in minikube failing to deploy

andre_f — Tue, 16 Aug 2022 05:43:21 GMT

@TomLichti Yes, you are probably right and it is related to one of the previously installed components that some of it was not completely uninstalled. Difficult to say. Hope the attempt with a new VM will work.

@techean I used ubuntu 20.04

Re: Oneagent in minikube failing to deploy

techean — Tue, 16 Aug 2022 06:17:01 GMT

Should work !😉

Re: Oneagent in minikube failing to deploy

TomLichti — Tue, 16 Aug 2022 11:41:50 GMT

Both of my tests were Ubuntu, the first 20.04 LTS and the second 22.04 LTS.

Re: Oneagent in minikube failing to deploy

TomLichti — Wed, 17 Aug 2022 14:20:49 GMT

I just re-did the whole thing from scratch and I get the same error again:

The only difference I can see is that I used Ubuntu 22.04. I guess the last thing to try would be to use 20.04 as that is literally the only thing that is different. I would appreciate if anyone else who has used Ubuntu 22.04 and Dynatrace K8S via the Operator would chime in to see if it's just me.

Re: Oneagent in minikube failing to deploy

TomLichti — Wed, 17 Aug 2022 16:05:46 GMT

I built a new VM on Ubunto server 20.04 with microk8s and it works. So it seems like there is something either with 22.04 or 22.04 Desktop that it didn't like.

Thanks everyone!

Re: Oneagent in minikube failing to deploy

techean — Thu, 18 Aug 2022 05:24:22 GMT

Yes @TomLichti .

I believe we can report this to support to fix it. Not working for my Vm too on 22.04.

Re: Oneagent in minikube failing to deploy

andre_f — Thu, 18 Aug 2022 07:30:49 GMT

Hi @TomLichti, @techean

I also tried it with Ubuntu 22.04. It works. My ActiveGate doesn't run because I do not have enough CPU 😇. But the agent works. However, I am surprised that the agent shows me Ubuntu 20.04 as OS, but it was set up in VM 22.04.

I don't know what the difference is to your attempts. But as I said, the detection of the OS also makes me wonder 🤔.

Re: Oneagent in minikube failing to deploy

TomLichti — Thu, 18 Aug 2022 11:41:05 GMT

That is very strange. Did you use Ubuntu Desktop or Server? I was using 22.04 Desktop and it failed every time. I used 20.04 Server and it worked. If I get time I'll try 22.04 Server.

Re: Oneagent in minikube failing to deploy

andre_vdveen — Thu, 18 Aug 2022 12:45:24 GMT

@andre_f I followed the exact same steps, but for some reason, my AG pod doesn't get created/doesn't start up - any idea why that would be? I've tried it using EC2 instances as well as local VMs. Do I need to change anything in the dynakube.yaml file, or use it as is from the deployment screen?

Re: Oneagent in minikube failing to deploy

andre_f — Thu, 18 Aug 2022 13:04:44 GMT

I used the default dynakube.yaml file and didn't customize anything. Did you try a "describe" to see what the problem might be?

kubectl describe pod/<AG-POD-NAME> -n dynatrace

Re: Oneagent in minikube failing to deploy

andre_f — Thu, 18 Aug 2022 13:05:07 GMT

I used the Desktop version

Re: Oneagent in minikube failing to deploy

andre_vdveen — Thu, 18 Aug 2022 14:20:59 GMT

If I run "kubectl get all -n dynatrace" the AG pod doesn't show up at all, so "describe" won't work, as I need the pod name, right?

Re: Oneagent in minikube failing to deploy

andre_f — Thu, 18 Aug 2022 14:31:35 GMT

Ah okay. Sorry about that. I thought that the pod was there but would not come into the status "running".
If you download the dynakube.yaml here (see screenshot), you should not need to adjust anything.

This part is already included there (I have removed some comments here):

# Configuration for ActiveGate instances. activeGate: # Enables listed ActiveGate capabilities capabilities: - routing - kubernetes-monitoring resources: requests: cpu: 500m memory: 512Mi limits: cpu: 1000m memory: 1.5Gi

Re: Oneagent in minikube failing to deploy

andre_f — Thu, 18 Aug 2022 14:37:13 GMT

@TomLichti After restarting the VM, I have the error as well.

14:11:41 Started with capabilities: self: cap_chown,cap_dac_override,cap_dac_read_search,cap_fowner,cap_fsetid,cap_kill,cap_setgid,cap_setuid,cap_net_admin,cap_net_raw,cap_sys_chroot,cap_sys_ptrace,cap_sys_admin,cap_sys_resource,cap_setfcap=ep 14:11:41 Started with user: uid=0(root) gid=0(root) groups=0(root) 14:11:41 Error: Container was not launched in host's cgroup namespace 14:11:41 Error: Dynatrace OneAgent requires parameters: --pid, --net and --cgroupns set to 'host'. 14:11:41 If you are not sure how to launch the container please visit: https://www.dynatrace.com/support/help/shortlink/oneagent-docker 14:11:41 Error: Initialization procedure failed

Until now I had always started with a new VM and reinstalled everything. The error did not occur. After a reboot now it does.