topic Re: Troubleshoot Kubernetes ErrorImagePullBackOff in Container platforms

Troubleshoot Kubernetes ErrorImagePullBackOff

echwallah — Fri, 24 Mar 2023 07:54:15 GMT

ImagePullBackoff error on OneAgent and ActiveGate pods

The underlying host's container runtime doesn't contain the certificate presented by your endpoint.

Note: The skipCertCheck field in the DynaKube YAML does not control this certificate check.

Example error (the error message may vary):

copydownload

desc = failed to pull and unpack image "<environment>/linux/activegate:latest": failed to resolve reference "<environment>/linux/activegate:latest": failed to do request: Head "<environment>/linux/activegate/manifests/latest": x509: certificate signed by unknown authority
Warning Failed ... Error: ErrImagePull
Normal BackOff ... Back-off pulling image "<environment>/linux/activegate:latest"
Warning Failed ... Error: ImagePullBackOff

In this example, if the description on your pod shows x509: certificate signed by unknown authority, you must fix the certificates on your Kubernetes hosts, or use the private repository configuration to store the images.

The documentation does not explicitly describe how to fix the Certificates on Kubernetes Hosts but just mention they need to be fixed.

Does anyone have a stepwise guide on how to fix this by resolving the certificate issue

Re: Troubleshoot Kubernetes ErrorImagePullBackOff

shahinm — Fri, 24 Mar 2023 08:26:33 GMT

The documentation does not describe the fix because 1) it is not Dynatrace product-related issue, 2) each environment has security requirements and technology dependency. The issue occurs because your container runtime client, which is responsible for pulling images from an image repository, does not trust the cert provided by that resource.

To solve this certificate issue, you need to add the certificate of the private image repository to the trusted CA (Certificate Authority) of your Kubernetes/Openshift cluster.

Re: Troubleshoot Kubernetes ErrorImagePullBackOff

CosmicDu5t — Wed, 29 Mar 2023 12:56:29 GMT

I had a similar issue and resolved it by putting the Certificate Authority certificate in a file called ca.crt under /etc/docker/certs.d/<environment URL:port>

Re: Troubleshoot Kubernetes ErrorImagePullBackOff

steven_torres — Tue, 13 Jun 2023 17:03:22 GMT

We are having the same issue in Openshift 4.x. We confirmed the skip auth is set to true in the yaml. Per your solution, I have the ca.cert but I don't know where do I place this ca.cert bundle from the openshift end to get this resolved?

Re: Troubleshoot Kubernetes ErrorImagePullBackOff

Julius_Loman — Tue, 13 Jun 2023 20:25:33 GMT

I believe this is what you are looking for https://docs.openshift.com/container-platform/4.10/openshift_images/image-configuration.html and look for additionalTrustedCA