# \#ai-observability

**URL:** https://community.dynatrace.com/tag/ai-observability/953.md

[Latest](https://community.dynatrace.com/latest.md) · [Categories](https://community.dynatrace.com/categories.md) · [Tags](https://community.dynatrace.com/tags.md)

---

## [Cost calculation for free models](https://community.dynatrace.com/t/cost-calculation-for-free-models/56744)

<div class="topic-metadata">

**Author:** [@radek\_jasinski](https://community.dynatrace.com/u/radek_jasinski)\
**Replies:** 0\
**Last updated:** [August 18, 2026, 1:09pm UTC](https://community.dynatrace.com/t/cost-calculation-for-free-models/56744 "2026-08-18T13:09:02Z")

</div>

Hi, My team has prepared an integration with a few AI models. We want to understand how Dynatrace calculates “Overall cost” for free models? What does this cost include and how is it calculated? For commercial models th…

---

## [Arize AX AI Acquisition & Integration Roadmap for Dynatrace Managed Environments — What to Expect?](https://community.dynatrace.com/t/arize-ax-ai-acquisition-integration-roadmap-for-dynatrace-managed-environments-what-to-expect/56734)

<div class="topic-metadata">

**Author:** [@Aboud1](https://community.dynatrace.com/u/Aboud1)\
**Replies:** 0\
**Last updated:** [August 17, 2026, 1:17pm UTC](https://community.dynatrace.com/t/arize-ax-ai-acquisition-integration-roadmap-for-dynatrace-managed-environments-what-to-expect/56734 "2026-08-17T13:17:21Z")

</div>

Hi Community, With the exciting news regarding the acquisition of Arize AI, many enterprise teams running Dynatrace Managed are eager to understand how this integration will fit into our private infrastructure and AI ob…

---

## [Agentic AI cost limits and per-user consumption monitoring](https://community.dynatrace.com/t/agentic-ai-cost-limits-and-per-user-consumption-monitoring/56659)

<div class="topic-metadata">

**Author:** [@ChrysanthosK](https://community.dynatrace.com/u/ChrysanthosK)\
**Replies:** 3\
**Last updated:** [August 11, 2026, 8:31am UTC](https://community.dynatrace.com/t/agentic-ai-cost-limits-and-per-user-consumption-monitoring/56659 "2026-08-11T08:31:34Z")

</div>

Hello Dynatrace Community, We are currently evaluating the governance and cost-control options available for Agentic AI under a Dynatrace Platform Subscription. Dynatrace Support informed us that it is currently not po…

---

## [Any options for monitoring MS Copilot agents?](https://community.dynatrace.com/t/any-options-for-monitoring-ms-copilot-agents/56441)

<div class="topic-metadata">

**Author:** [@jlcaam](https://community.dynatrace.com/u/jlcaam)\
**Replies:** 2\
**Last updated:** [July 22, 2026, 1:50pm UTC](https://community.dynatrace.com/t/any-options-for-monitoring-ms-copilot-agents/56441 "2026-07-22T13:50:29Z")

</div>

Hi, We have some agents developed using Microsoft Copilot Studio that we’d like to monitor with Dynatrace. So far the only option i have found involve sending Copilot Studio telemetry to another service, Application In…

---

## [Architecting an LLM-as-a-Judge Evaluation Framework using Dynatrace MCP & OpenTelemetry Traces (Dynatrace Managed)](https://community.dynatrace.com/t/architecting-an-llm-as-a-judge-evaluation-framework-using-dynatrace-mcp-opentelemetry-traces-dynatrace-managed/56511)

<div class="topic-metadata">

**Author:** [@Aboud1](https://community.dynatrace.com/u/Aboud1)\
**Replies:** 0\
**Last updated:** [July 20, 2026, 3:48pm UTC](https://community.dynatrace.com/t/architecting-an-llm-as-a-judge-evaluation-framework-using-dynatrace-mcp-opentelemetry-traces-dynatrace-managed/56511 "2026-07-20T15:48:27Z")

</div>

Hi everyone, I’m designing an automated LLM-as-a-Judge evaluation framework for our production chatbot app, and I’d love to gather some architectural insights or approaches from the community. The Current Architecture: …

---

## [Introducing dt-evals: an open source continuous evaluation tool for LLM apps in Dynatrace AI Observability](https://community.dynatrace.com/t/introducing-dt-evals-an-open-source-continuous-evaluation-tool-for-llm-apps-in-dynatrace-ai-observability/56035)

<div class="topic-metadata">

**Author:** [@krismuhi](https://community.dynatrace.com/u/krismuhi)\
**Replies:** 0\
**Last updated:** [June 12, 2026, 7:46am UTC](https://community.dynatrace.com/t/introducing-dt-evals-an-open-source-continuous-evaluation-tool-for-llm-apps-in-dynatrace-ai-observability/56035 "2026-06-12T07:46:07Z")

</div>

TL;DR: We open-sourced dt-evals, a CLI toolkit for evaluating LLM and agent quality using real GenAI traces in Dynatrace AI Observability. Run evaluations on live or recent gen\_ai.\* spans, score responses with an LLM jud…

---

## [MCP Server Challenge entry #7: An MCP-Powered Framework for Federal and Enterprise Environments \[UPDATED\]](https://community.dynatrace.com/t/mcp-server-challenge-entry-7-an-mcp-powered-framework-for-federal-and-enterprise-environments-updated/55711)

<div class="topic-metadata">

**Author:** [@RWC](https://community.dynatrace.com/u/RWC)\
**Replies:** 5\
**Last updated:** [June 8, 2026, 1:13am UTC](https://community.dynatrace.com/t/mcp-server-challenge-entry-7-an-mcp-powered-framework-for-federal-and-enterprise-environments-updated/55711 "2026-06-08T01:13:41Z")

</div>

★ UPDATE — May 4, 2026 ★This submission has been significantly updated with 13 sections including new Section 4 (Regulatory Landscape: Federal AI Governance Mandate Convergence), expanded Section 9 (Scenario-based LOCATE…

---

## [Introducing the new AI-focused forum 🤖](https://community.dynatrace.com/t/introducing-the-new-ai-focused-forum/55718)

<div class="topic-metadata">

**Author:** [@Gosia\_Murawska](https://community.dynatrace.com/u/Gosia_Murawska)\
**Replies:** 6\
**Last updated:** [May 29, 2026, 8:09am UTC](https://community.dynatrace.com/t/introducing-the-new-ai-focused-forum/55718 "2026-05-29T08:09:26Z")

</div>

For us, AI isn’t a future concept — it’s in production, shaping user experiences, triggering alerts, and showing up in incident calls. That’s why we created this forum: a shared space to learn how to use AI more effecti…

---

## [Useful resources: AI Observability & AIOps](https://community.dynatrace.com/t/useful-resources-ai-observability-aiops/56011)

<div class="topic-metadata">

**Author:** [@Gosia\_Murawska](https://community.dynatrace.com/u/Gosia_Murawska)\
**Replies:** 0\
**Last updated:** [May 27, 2026, 10:07am UTC](https://community.dynatrace.com/t/useful-resources-ai-observability-aiops/56011 "2026-05-27T10:07:26Z")

</div>

We’ve put together a list of resources that actually help you get started with AI: courses, tutorials, real-world case studies, and a few things worth bookmarking before they get buried under the next wave of content.…

---

## [Building GenAI Apps with Open Source](https://community.dynatrace.com/t/building-genai-apps-with-open-source/49836)

<div class="topic-metadata">

**Author:** [@flo\_lettner](https://community.dynatrace.com/u/flo_lettner)\
**Replies:** 1\
**Last updated:** [May 21, 2026, 10:14am UTC](https://community.dynatrace.com/t/building-genai-apps-with-open-source/49836 "2026-05-21T10:14:29Z")

</div>

Building an AI application doesn’t have to break the bank. The top AI development tools are open-source, fostering an evolving ecosystem that democratizes AI for everyone. Here are the essential elements of this open-so…

---

## [MCP Server Challenge entry #8: Autonomous SRE Analysis by logs patterns](https://community.dynatrace.com/t/mcp-server-challenge-entry-8-autonomous-sre-analysis-by-logs-patterns/55731)

<div class="topic-metadata">

**Author:** [@rgarzon1](https://community.dynatrace.com/u/rgarzon1)\
**Replies:** 4\
**Last updated:** [May 13, 2026, 3:15pm UTC](https://community.dynatrace.com/t/mcp-server-challenge-entry-8-autonomous-sre-analysis-by-logs-patterns/55731 "2026-05-13T15:15:43Z")

</div>

Autonomous SRE Analysis: How We Built the C.A.R. Multi-Agent Framework to Automate Root-Cause Analysis via Dynatrace MCP Ruben Dario Garzon Toro Observability Specialist & Pre-Sales Consultant Submitted for the MCP Ser…

---

## [MCP Server Challenge entry #6: My very first App - A Kubernetes Cluster Performance & Capacity Report](https://community.dynatrace.com/t/mcp-server-challenge-entry-6-my-very-first-app-a-kubernetes-cluster-performance-capacity-report/55702)

<div class="topic-metadata">

**Author:** [@dannemca](https://community.dynatrace.com/u/dannemca)\
**Replies:** 2\
**Last updated:** [May 12, 2026, 5:32pm UTC](https://community.dynatrace.com/t/mcp-server-challenge-entry-6-my-very-first-app-a-kubernetes-cluster-performance-capacity-report/55702 "2026-05-12T17:32:50Z")

</div>

Inspired by this excelent video in Dynatrace YouTube channel, I started to put in practice something that I was always trying to do but never had the guts to complete. To create my very first App in Dynatrace. I am not …

---

## [MCP Server Challenge entry #9: R.E.A.D.Y. - Reliability Evidence Assessment for Dynatrace Readiness](https://community.dynatrace.com/t/mcp-server-challenge-entry-9-r-e-a-d-y-reliability-evidence-assessment-for-dynatrace-readiness/55794)

<div class="topic-metadata">

**Author:** [@MaximilianoML](https://community.dynatrace.com/u/MaximilianoML)\
**Replies:** 3\
**Last updated:** [May 11, 2026, 2:20pm UTC](https://community.dynatrace.com/t/mcp-server-challenge-entry-9-r-e-a-d-y-reliability-evidence-assessment-for-dynatrace-readiness/55794 "2026-05-11T14:20:52Z")

</div>

R.E.A.D.Y. Project Use Case Write-Up R.E.A.D.Y. is a Dynatrace-native app that uses Dynatrace Remote MCP, DQL, and Dynatrace platform APIs to transform observability data into two practical operator workflows: Problems…

---

## [What is AI and LLM Observability?](https://community.dynatrace.com/t/what-is-ai-and-llm-observability/49834)

<div class="topic-metadata">

**Author:** [@flo\_lettner](https://community.dynatrace.com/u/flo_lettner)\
**Replies:** 2\
**Last updated:** [May 4, 2026, 5:24pm UTC](https://community.dynatrace.com/t/what-is-ai-and-llm-observability/49834 "2026-05-04T17:24:04Z")

</div>

AI observability is a modern, complete approach to understanding how your AI applications behave, how data flows, and how performance changes over time. At Dynatrace, we provide advanced model observability with predict…

---

## [Introducing dtctl: Your Dynatrace Platform, One Command Away](https://community.dynatrace.com/t/introducing-dtctl-your-dynatrace-platform-one-command-away/55148)

<div class="topic-metadata">

**Author:** [@Christoph\_Neum](https://community.dynatrace.com/u/Christoph_Neum)\
**Replies:** 6\
**Last updated:** [April 20, 2026, 7:16pm UTC](https://community.dynatrace.com/t/introducing-dtctl-your-dynatrace-platform-one-command-away/55148 "2026-04-20T19:16:35Z")

</div>

TL;DR: We open-sourced dtctl, a CLI for Dynatrace that brings terminal-native workflows and AI agent integration to the platform. Manage workflows, dashboards, SLOs, and 20+ resource types from your terminal or let your …

---

## [Dynatrace MCP to problems App redirection.](https://community.dynatrace.com/t/dynatrace-mcp-to-problems-app-redirection/55480)

<div class="topic-metadata">

**Author:** [@Maheedhar\_T](https://community.dynatrace.com/u/Maheedhar_T)\
**Replies:** 1\
**Last updated:** [April 6, 2026, 1:26pm UTC](https://community.dynatrace.com/t/dynatrace-mcp-to-problems-app-redirection/55480 "2026-04-06T13:26:26Z")

</div>

Hi Team, I’ve been experimenting with Dynatrace MCP recently and it’s pretty awesome when it explains things related to problems and the root cause. One thing I found quite annoying is that the URL it would return in th…

---

## [Explore hands-on demo for AI Observability - Demo App](https://community.dynatrace.com/t/explore-hands-on-demo-for-ai-observability-demo-app/55301)

<div class="topic-metadata">

**Author:** [@agata.wlodarczyk](https://community.dynatrace.com/u/agata.wlodarczyk)\
**Replies:** 0\
**Last updated:** [March 18, 2026, 12:05pm UTC](https://community.dynatrace.com/t/explore-hands-on-demo-for-ai-observability-demo-app/55301 "2026-03-18T12:05:34Z")

</div>

Check out our hands-on demo for AI Observability - Demo App Visit GitHub to explore

---

## [AI and LLM Observability - Documentation](https://community.dynatrace.com/t/ai-and-llm-observability-documentation/55300)

<div class="topic-metadata">

**Author:** [@agata.wlodarczyk](https://community.dynatrace.com/u/agata.wlodarczyk)\
**Replies:** 0\
**Last updated:** [March 18, 2026, 12:00pm UTC](https://community.dynatrace.com/t/ai-and-llm-observability-documentation/55300 "2026-03-18T12:00:39Z")

</div>

AI observability is the practice of collecting, analyzing, and correlating telemetry across your tech stack to understand how AI systems, agents, and LLMs behave in all environments including production. It enables real-…

---

## [A complete overview of supported AI technologies - Dynatrace Hub](https://community.dynatrace.com/t/a-complete-overview-of-supported-ai-technologies-dynatrace-hub/55299)

<div class="topic-metadata">

**Author:** [@agata.wlodarczyk](https://community.dynatrace.com/u/agata.wlodarczyk)\
**Replies:** 0\
**Last updated:** [March 18, 2026, 11:52am UTC](https://community.dynatrace.com/t/a-complete-overview-of-supported-ai-technologies-dynatrace-hub/55299 "2026-03-18T11:52:37Z")

</div>

AI and LLM Observability Achieve complete visibility and insights across every layer of your AI and LLM ecosystem – from data ingestion and vector stores to agentic frameworks and prompt engineering – ensuring optimal p…

---

## [AI tools integration with Dynatrace](https://community.dynatrace.com/t/ai-tools-integration-with-dynatrace/55248)

<div class="topic-metadata">

**Author:** [@abhishek\_shedge](https://community.dynatrace.com/u/abhishek_shedge)\
**Replies:** 1\
**Last updated:** [March 13, 2026, 1:41pm UTC](https://community.dynatrace.com/t/ai-tools-integration-with-dynatrace/55248 "2026-03-13T13:41:51Z")

</div>

Hello, I am trying to integrate my Dynatrace dashboard with AI tools like Microsoft Co-Pilot Studio/M365 Co-Pilot/ MCP server, etc., with the help of the Dynatrace API. The goal is to create a chat assistant that can gi…

---

## [End-to-End Tracing & Debugging \[AIObs\] NVIDIA NIM](https://community.dynatrace.com/t/end-to-end-tracing-debugging-aiobs-nvidia-nim/52309)

<div class="topic-metadata">

**Author:** [@MichalBojko](https://community.dynatrace.com/u/MichalBojko)\
**Replies:** 0\
**Last updated:** [July 2, 2025, 10:19am UTC](https://community.dynatrace.com/t/end-to-end-tracing-debugging-aiobs-nvidia-nim/52309 "2025-07-02T10:19:03Z")

</div>

I am looking at the \[AIObs\] NVIDIA NIM dashboard and top 10 expensive prompts. Some of the prompts are repeating. Do we have or do we think about having deep dive analysis on the results? For example, for repeating co…

---

## [📚 Understand the latest AI revolution: Agentic AI, Model Context Protocol (MCP) and all that jazz](https://community.dynatrace.com/t/understand-the-latest-ai-revolution-agentic-ai-model-context-protocol-mcp-and-all-that-jazz/51658)

<div class="topic-metadata">

**Author:** [@krismuhi](https://community.dynatrace.com/u/krismuhi)\
**Replies:** 1\
**Last updated:** [May 15, 2025, 4:18pm UTC](https://community.dynatrace.com/t/understand-the-latest-ai-revolution-agentic-ai-model-context-protocol-mcp-and-all-that-jazz/51658 "2025-05-15T16:18:08Z")

</div>

Summary: This article explains the concepts of Agentic AI, Model Context Protocol (MCP), and how they influence AI operations. It highlights how Dynatrace enables visibility, governance, and performance insights into AI-…

---

## [Use Dynatrace Intelligence - Simple text to DQL conversion](https://community.dynatrace.com/t/use-dynatrace-intelligence-simple-text-to-dql-conversion/50330)

<div class="topic-metadata">

**Author:** [@RohitBisht](https://community.dynatrace.com/u/RohitBisht)\
**Replies:** 0\
**Last updated:** [February 19, 2025, 1:36am UTC](https://community.dynatrace.com/t/use-dynatrace-intelligence-simple-text-to-dql-conversion/50330 "2025-02-19T01:36:43Z")

</div>

Sharing a recent example where i made use of Dynatrace Intelligence and saved me a lot of time building the query. One of the requirements was to exclude weekend datapoints from a metric. A common ask with Customers. H…

---

## [AI Observability - new challenge](https://community.dynatrace.com/t/ai-observability-new-challenge/50307)

<div class="topic-metadata">

**Author:** [@radek\_jasinski](https://community.dynatrace.com/u/radek_jasinski)\
**Replies:** 0\
**Last updated:** [February 18, 2025, 8:00am UTC](https://community.dynatrace.com/t/ai-observability-new-challenge/50307 "2025-02-18T08:00:18Z")

</div>

Hi, I made up my mind a new challenge to prepare deep monitoring for a few Generative AI models. In my case, I need to monitor all key operations. Do you have any experience with this? Maybe someone would like to join …

---

## [Perform 2025: AI-powered operational excellence](https://community.dynatrace.com/t/perform-2025-ai-powered-operational-excellence/50104)

<div class="topic-metadata">

**Author:** [@Gosia\_Murawska](https://community.dynatrace.com/u/Gosia_Murawska)\
**Replies:** 0\
**Last updated:** [February 5, 2025, 8:34am UTC](https://community.dynatrace.com/t/perform-2025-ai-powered-operational-excellence/50104 "2025-02-05T08:34:38Z")

</div>

With over a decade of AI leadership, Dynatrace provides customers with unrivaled insight into their AI-native applications to drive reliability, cost-effectiveness, and compliance. Dynatrace ensures that AI initiative…

---

## [AI Observability user group is waiting for you to join!](https://community.dynatrace.com/t/ai-observability-user-group-is-waiting-for-you-to-join/50032)

<div class="topic-metadata">

**Author:** [@agata.wlodarczyk](https://community.dynatrace.com/u/agata.wlodarczyk)\
**Replies:** 1\
**Last updated:** [January 31, 2025, 6:21pm UTC](https://community.dynatrace.com/t/ai-observability-user-group-is-waiting-for-you-to-join/50032 "2025-01-31T18:21:43Z")

</div>

AI observability is a modern, complete approach to understanding how your AI applications behave, how data flows, and how performance changes over time. Leverage best-in-class observability to improve the performance, e…

---

## [OpenLLMetry semantic conventions are now part of OpenTelemetry](https://community.dynatrace.com/t/openllmetry-semantic-conventions-are-now-part-of-opentelemetry/49837)

<div class="topic-metadata">

**Author:** [@flo\_lettner](https://community.dynatrace.com/u/flo_lettner)\
**Replies:** 0\
**Last updated:** [January 21, 2025, 10:35am UTC](https://community.dynatrace.com/t/openllmetry-semantic-conventions-are-now-part-of-opentelemetry/49837 "2025-01-21T10:35:44Z")

</div>

We’re thrilled to announce that the OpenLLMetry semantic conventions have officially become part of OpenTelemetry! This milestone is a significant step in standardizing the observability of large language model (LLM) bas…

---

## [Getting started with AI Observability](https://community.dynatrace.com/t/getting-started-with-ai-observability/49835)

<div class="topic-metadata">

**Author:** [@flo\_lettner](https://community.dynatrace.com/u/flo_lettner)\
**Replies:** 0\
**Last updated:** [January 21, 2025, 10:11am UTC](https://community.dynatrace.com/t/getting-started-with-ai-observability/49835 "2025-01-21T10:11:00Z")

</div>

Dynatrace leverages OpenLLMetry to ingest telemetry data of your AI workloads. OpenLLMetry is a set of extensions built on top of OpenTelemetry that gives you complete observability over your LLM application. Simply ins…
