topic Re: "Successes" in Davis Copilot Chat? in AI

"Successes" in Davis Copilot Chat?

mmevanson — Wed, 15 Apr 2026 08:24:31 GMT

Why does the CoPilot Adoption Ready-Made dashboard show successes in Chat, when the response is "Sorry I can't do X"

Re: "Successes" in Davis Copilot Chat?

JeanBlanc — Wed, 12 Nov 2025 11:12:36 GMT

In Dynatrace’s CoPilot Adoption dashboard, I think the “Success” count isn’t a measure of whether the AI actually fulfilled the user’s request, it’s simply a count of how many chat‐API calls returned a valid response payload (HTTP 200). Even a “Sorry, I can’t do X” message is still a successful API call from the platform’s point of view, so it gets tallied under “Success.”

Maybe you could parse the JSON response for error codes or “cannot” keywords and treat those as partial-failures.

Regards,

Re: "Successes" in Davis Copilot Chat?

mmevanson — Mon, 17 Nov 2025 18:27:32 GMT

Thanks for the suggestion. My post was more about the method of calling something successful in the technical manner vs. providing a meaningful answer.
"Sorry, I can't help you with that" is not a success in my eyes, or my customers eyes. This truly is not a success in providing meaningful/applicable responses to your prompt.
Matt