https://community.dynatrace.com/t5/Troubleshooting/How-to-ingest-additional-Kubernetes-Custom-Resources-CRs-from-a/ta-p/300022 <P><STRONG>Table of Contents</STRONG></P> <UL> <LI><A href="https://community.dynatrace.com/t5/Troubleshooting/How-to-ingest-additional-Kubernetes-Custom-Resources-CR-from-a/ta-p/300018#toc-hId-1869723845" target="_blank" rel="nofollow noopener noreferrer">Summary</A></LI> <LI><A href="https://community.dynatrace.com/t5/Troubleshooting/How-to-ingest-additional-Kubernetes-Custom-Resources-CR-from-a/ta-p/300018#toc-hId-1060377219" target="_blank" rel="nofollow noopener noreferrer">Problem</A></LI> <LI><A href="https://community.dynatrace.com/t5/Troubleshooting/How-to-ingest-additional-Kubernetes-Custom-Resources-CR-from-a/ta-p/300018#toc-hId-251030593" target="_blank" rel="nofollow noopener noreferrer">Workaround</A></LI> <LI><A href="https://community.dynatrace.com/t5/Troubleshooting/How-to-ingest-additional-Kubernetes-Custom-Resources-CR-from-a/ta-p/300018#toc-hId-1184494302" target="_blank" rel="nofollow noopener noreferrer">What's next</A></LI> </UL> <DIV class="lia-message-template-content-zone"> <DIV class="lia-message-template-content-zone"> <H1 id="toc-hId-1869723845">Summary</H1> <P><I>Kubernetes Platform Monitoring is ingesting a set of Kubernetes resources from the Kube-APIserver on the monitored Kubernetes cluster and present those resources as metrics in Dynatrace, e.g(workload metrics (CPU, Memory), namespace resource quotas,......,etc)</I></P> <P>In some scenarios, those&nbsp;<I>Kubernetes resources are not enough and customers might need to ingest additional Kubernetes resources from a monitored cluster, and setup an alert based on the ingested resources metric value.</I></P> <H4 id="toc-hId--1271973631">&nbsp;</H4> <H1 id="toc-hId-1060377219">Problem</H1> <P><I>Ingesting additional Kubernetes Custom Resources (CRs) from a monitored Kubernetes cluster that is not ingested into Dynatrace out of the box and present this Custom Resources as a metric in Dynatrace to be able to setup an alerting if the value of this metric breached a configured threshold value.</I></P> <H4 id="toc-hId--2081320257">&nbsp;</H4> <H1 id="toc-hId-251030593">Workaround</H1> <P><SPAN>Ingesting additional Custom Resources from Kubernetes cluster as Smartscape nodes:</SPAN></P> <H3 id="prerequisites" class="_5ei34w0-3-2-1 _5ei34w2-3-2-1 _19eqqo2 _19eqqo0 _19eqqo7" data-dt-component="Heading" data-testid="heading">Prerequisites</H3> <DIV class="_1jhjaj90"> <UL class="_rup8ap0-3-2-1 _16276mt0-3-2-1 list" data-dt-component="List"> <LI class="_16276mt1-3-2-1"><SPAN class="_rup8ap0-3-2-1" data-dt-component="Text">Dynatrace SaaS environment powered by Grail and AppEngine</SPAN></LI> <LI class="_16276mt1-3-2-1"><A class="_1iksxp40-3-2-1 _z0fq9b4-3-2-1 _z0fq9bd-3-2-1 _z0fq9b5-3-2-1 _z0fq9b8-3-2-1 _1dg53j00" title="About Dynatrace Platform Subscription (DPS), the licensing model for all Dynatrace capabilities." href="https://docs.dynatrace.com/docs/license" target="_blank" rel="noopener noreferrer" data-dt-component="Link">DPS license</A><SPAN>&nbsp;</SPAN>that includes the<SPAN>&nbsp;</SPAN><A class="_1iksxp40-3-2-1 _z0fq9b4-3-2-1 _z0fq9bd-3-2-1 _z0fq9b5-3-2-1 _z0fq9b8-3-2-1 _1dg53j00" title="Learn how your consumption of the Dynatrace Kubernetes Platform Monitoring DPS capability is billed and charged." href="https://docs.dynatrace.com/docs/license/capabilities/container-monitoring/kubernetes-platform-monitoring" target="_blank" rel="noopener noreferrer" data-dt-component="Link"><STRONG class="_wxp4dd0-3-2-1 _1q7lrma0" data-dt-component="Strong">Kubernetes Platform Monitoring</STRONG><SPAN>&nbsp;</SPAN>capability</A></LI> <LI class="_16276mt1-3-2-1"><A class="_1iksxp40-3-2-1 _z0fq9b4-3-2-1 _z0fq9bd-3-2-1 _z0fq9b5-3-2-1 _z0fq9b8-3-2-1 _1dg53j00" title="Overview of user and tailoring permissions." href="https://docs.dynatrace.com/docs/observe/infrastructure-observability/kubernetes-app/reference/permissions" target="_blank" rel="noopener noreferrer" data-dt-component="Link">Sufficient permissions</A><SPAN>&nbsp;to use the New&nbsp;<STRONG class="_wxp4dd0-3-2-1 _1q7lrma0" data-dt-component="Strong">Kubernetes</STRONG>&nbsp;app within your Dynatrace environment</SPAN></LI> <LI class="_16276mt1-3-2-1"><SPAN>ActiveGate version 1.335+</SPAN></LI> <LI class="_16276mt1-3-2-1"><STRONG>Enabling this feature&nbsp;will increase the ActiveGate's resource consumption, so make sure to watch for this and adapt resource's requests/limits accordingly.</STRONG></LI> </UL> </DIV> <P><SPAN>For the below steps, we will&nbsp;Ingest additional Custom Resource (<STRONG>ClusterResourceQuota</STRONG>) from a monitored&nbsp;<STRONG>OpenShift</STRONG>&nbsp;Cluster as an example:</SPAN></P> <P><SPAN><STRONG>Step 1</STRONG>: Add the new permissions to the ClusterRole:</SPAN></P> <P>Please refer to <A href="https://docs.dynatrace.com/docs/shortlink/enable-k8s-clusters#add-permissions-clusterroles" target="_blank" rel="noopener">this link</A> to<SPAN>&nbsp;extend the permissions for Kubernetes Platform monitoring, by creating a ClusterRole with the required permissions and bind it to the&nbsp;</SPAN><CODE class="_1v51izp0-3-2-1" data-dt-component="Code">dynatrace-activegate</CODE><SPAN>&nbsp;service account using a ClusterRoleBinding, below are the needed permissions to ingest&nbsp;<STRONG>ClusterResourceQuota </STRONG>CR&nbsp;from a monitored&nbsp;<STRONG>OpenShift</STRONG>&nbsp;Cluster:</SPAN></P> <PRE>- verbs: - list - watch - get apiGroups: - <A href="https://quota.openshift.io/" target="_blank" rel="noopener nofollow noreferrer">quota.openshift.io</A> resources: - clusterresourcequotas</PRE> <P>&nbsp;</P> <P><STRONG>Step 2</STRONG><SPAN>:&nbsp;</SPAN><SPAN>Modify the ActiveGate's customProperties to&nbsp;</SPAN><SPAN>include&nbsp;<EM>kubernetes_smartscape_monitored_custom_resources</EM>&nbsp;parameter for Kubernetes monitoring in the DynaKube YAML file:</SPAN></P> <P><SPAN>Please refer to <A style="font-family: inherit; background-color: #ffffff;" href="https://docs.dynatrace.com/docs/observe/infrastructure-observability/kubernetes-app/enable-k8s-experience#add-permissions-clusterroles:~:text=Extend%20monitoring%20of%20custom%20resources%20(CRs)" target="_self">this link</A>&nbsp;to extend monitoring of custom resources (CRs) using&nbsp;<EM>kubernetes_smartscape_monitored_custom_resources</EM>&nbsp;parameter on&nbsp;the ActiveGate's customProperties,&nbsp;below are the parameter's values needed to ingest&nbsp;<STRONG>ClusterResourceQuota </STRONG>CR&nbsp;from a monitored&nbsp;<STRONG>OpenShift</STRONG>&nbsp;Cluster:</SPAN></P> <PRE>spec: activeGate: capabilities: - kubernetes-monitoring customProperties: value: | [kubernetes_monitoring] kubernetes_smartscape_monitored_custom_resources = [{ "resource": "clusterresourcequotas"\, "kind": "ClusterResourceQuota"\, "apiGroup": "<A href="https://quota.openshift.io/" target="_blank" rel="noopener nofollow noreferrer">quota.openshift.io</A>"\, "version": "v1"\, "namespaced": false\, "usePreferredApiVersion": false }]</PRE> <P><SPAN><STRONG>Note:</STRONG>&nbsp;The&nbsp;<CODE class="_1v51izp0-3-2-1" data-dt-component="Code">resource</CODE>&nbsp;value must be the lowercase plural name of the resource, and&nbsp;<CODE class="_1v51izp0-3-2-1" data-dt-component="Code">kind</CODE>&nbsp;must match the Kubernetes kind exactly (PascalCase). Optionally, set&nbsp;<CODE class="_1v51izp0-3-2-1" data-dt-component="Code">usePreferredApiVersion</CODE>&nbsp;for ActiveGate to use the preferred API version (if the preferred version can’t be determined, the version specified in&nbsp;<CODE class="_1v51izp0-3-2-1" data-dt-component="Code">version</CODE>&nbsp;is used as a fallback).</SPAN></P> <P><SPAN>Once the new permissions has been added to the ClusterRole and the ActiveGate's customProperties modified to include the kubernetes_smartscape_monitored_custom_resources parameter successfully, you can query the data via the below DQL query:</SPAN></P> <PRE>smartscapeNodes K8S_CLUSTERRESOURCEQUOTA</PRE> <P>&nbsp;</P> <P><STRONG>Step 3</STRONG>:&nbsp; After successfully querying the<SPAN>&nbsp;</SPAN><SPAN>K8S_CLUSTERRESOURCEQUOTA via the provided DQL query, you can create a workflow to read the smartscapeNode 'K8S_CLUSTERRESOURCEQUOTA' every 1 minute or so, extract the data and ingest it as custom metric:</SPAN></P> <P><SPAN>Please refer to <A href="https://docs.dynatrace.com/docs/analyze-explore-automate/workflows/default-workflow-actions" target="_blank" rel="noopener">this link</A> to create a Workflow with DQL query and HTTP request actions, a</SPAN><SPAN>ttached to the article an example Workflow JSON file 'clusterresourcequota-pods-used-metric.workflow.json'&nbsp;that can be uploaded to a Dynatrace environment on the Workflow app to perform the below:<BR /></SPAN></P> <DIV> <DIV>1) The Workflow gets triggered every 1 minute.<BR />2) Reads ClusterResourceQuota Smartscape nodes and calculates used pods in percent.<BR />3) Ingest the result as metric via REST API.<BR /><BR /><STRONG>Notes:</STRONG></DIV> <UL> <LI><SPAN>Please replace the below placeholders with the actual values on the Workflow:</SPAN> <OL> <LI><SPAN><FONT color="#000000"><STRONG><CODE>&lt;DT-SaaS-FQDN&gt;</CODE></STRONG></FONT>&nbsp;with the FQDN of your SaaS environment.&nbsp;<STRONG><CODE></CODE></STRONG></SPAN></LI> <LI><SPAN><STRONG><CODE>&lt;OCP-CLUSTER-NAME&gt;</CODE></STRONG>&nbsp;with the name of the OpenShift cluster where you modified the ActiveGate's customProperties for Kubernetes monitoring in the DynaKube YAML to include&nbsp;kubernetes_smartscape_monitored_custom_resources parameter and added the new permissions to the ClusterRole,</SPAN></LI> <LI><SPAN><STRONG><CODE>&lt;token-value&gt;</CODE></STRONG>&nbsp;with an access token with metrics.ingest scope</SPAN></LI> </OL> </LI> <LI>This Workflow is just a starting point and must be adapted based on your desired outcome.</LI> <LI>The Workflow can only handle one ClusterResourceQuota object.</LI> <LI>You might need to adjust the max result limits, and other parameters on the Workflow.</LI> </UL> </DIV> <H4 id="toc-hId--1147856548">&nbsp;</H4> <H1 id="toc-hId-1184494302">What's next</H1> <UL> <LI><SPAN>Up to 5 extra Custom Resources types can be ingested as Smartscape nodes.</SPAN></LI> <LI>We are working on a more easier way to extend monitoring of custom resources (CRs) that can be done via the Dynatrace UI, However, there is still no ETA yet on when this feature will be available.</LI> <LI> <P>References:</P> </LI> </UL> <P class="lia-indent-padding-left-30px"><A href="https://docs.dynatrace.com/docs/shortlink/operator-security-rbac#activegate" target="_blank" rel="noopener noreferrer">https://docs.dynatrace.com/docs/shortlink/operator-security-rbac#activegate</A>&nbsp;</P> <P class="lia-indent-padding-left-30px"><A href="https://docs.dynatrace.com/docs/shortlink/custom-properties-file" target="_blank" rel="noopener noreferrer">https://docs.dynatrace.com/docs/shortlink/custom-properties-file</A>&nbsp;</P> <P class="lia-indent-padding-left-30px"><A href="https://docs.dynatrace.com/docs/shortlink/semantic-dictionary-smartscape-kubernetes" target="_blank" rel="noopener noreferrer">https://docs.dynatrace.com/docs/shortlink/semantic-dictionary-smartscape-kubernetes</A>&nbsp;</P> <P class="lia-indent-padding-left-30px"><A href="https://docs.dynatrace.com/docs/shortlink/workflows" target="_blank" rel="noopener noreferrer">https://docs.dynatrace.com/docs/shortlink/workflows</A>&nbsp;</P> <P class="lia-indent-padding-left-30px"><A href="https://docs.dynatrace.com/docs/manage/identity-access-management/access-tokens-and-oauth-clients/access-tokens#scopes" target="_blank" rel="noopener">https://docs.dynatrace.com/docs/manage/identity-access-management/access-tokens-and-oauth-clients/access-tokens#scopes</A>&nbsp;</P> <P class="lia-indent-padding-left-30px"><A style="font-family: inherit; background-color: #ffffff;" href="https://docs.dynatrace.com/docs/observe/infrastructure-observability/kubernetes-app/enable-k8s-experience#add-permissions-clusterroles:~:text=Extend%20monitoring%20of%20custom%20resources%20(CRs)" target="_blank" rel="noopener">https://docs.dynatrace.com/docs/observe/infrastructure-observability/kubernetes-app/enable-k8s-experience#add-permissions-clusterroles:~:text=Extend%20monitoring%20of%20custom%20resources%20(CRs)</A><SPAN>&nbsp;</SPAN></P> </DIV> </DIV> Thu, 04 Jun 2026 17:53:28 GMT sheriflashin 2026-06-04T17:53:28Z https://community.dynatrace.com/t5/Troubleshooting/How-to-ingest-additional-Kubernetes-Custom-Resources-CRs-from-a/ta-p/300022 <P><I>Ingesting additional Kubernetes Custom Resources (CR) from a monitored Kubernetes cluster that is not ingested into Dynatrace out of the box and present this Custom Resources as a metric in Dynatrace to be able to setup an alerting if the value of this metric breached a configured threshold value.</I></P> <P><LI-TOC indent="15" liststyle="disc" maxheadinglevel="2"></LI-TOC></P> Thu, 04 Jun 2026 17:53:28 GMT https://community.dynatrace.com/t5/Troubleshooting/How-to-ingest-additional-Kubernetes-Custom-Resources-CRs-from-a/ta-p/300022 sheriflashin 2026-06-04T17:53:28Z