cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

This product reached the end of support date on March 31, 2021.

Missing performance metrics for Maven build

Enrico_F
DynaMight Pro
DynaMight Pro


We are currently running a PoC regarding the test automation features using Jenkins and Maven and are having some trouble with getting test cases to show up as we would like.


The setup seems correct as far as the agent connectivity goes e.g. the agent shows up and the tests appear in the Test Results dashlet under category "Unit Test". However, we would like to see performance metrics like Purepath response time, duration etc. For that reason we have configured the test category "performance" in the pom.xml. However, all we get is the metric "Failed Transaction Count", which is always 0...


Granted, the code being tested is very simple and does not contain anything fancy like remoting or DB calls.


In the build output we see the following messages at the end:


Dynatrace AppMon Plugin - build tear down...
channel stopped
Sleeping for the configured delay of 10 seconds before retrieving test run data from Dynatrace Server...
Connecting to Dynatrace Server REST interface...
The test runs don't contain any test execution!
Sleeping for the configured delay of 10 seconds before retrieving test run data from Dynatrace Server... re-try 1 out of 3
Connecting to Dynatrace Server REST interface...
The test runs don't contain any test execution!
Sleeping for the configured delay of 10 seconds before retrieving test run data from Dynatrace Server... re-try 2 out of 3
Connecting to Dynatrace Server REST interface...
The test runs don't contain any test execution!
Sleeping for the configured delay of 10 seconds before retrieving test run data from Dynatrace Server... re-try 3 out of 3
Connecting to Dynatrace Server REST interface...
The test runs don't contain any test execution!
Fetching data from Dynatrace Server REST interface failed
java.util.NoSuchElementException: No matching test run with test executions has been recorded by the configured Dynatrace Server


On the AppMon server I noticed these messages in the log:


2017-03-10 15:46:07 INFO [CIPathAnalyzer] Invalid UUID provided (testRunPOC), using current testRun
2017-03-10 15:46:18 WARNING [XmlRestManagementService] No test metadata was set or no testrun occurred between 1970-01-01T01:00:00 (timestamp: 0) and 2017-03-10T15:46:18 (timestamp: 1,489,157,178,404) with additional parameters: [startTime=0, endTime=1489157178404, extendLevel=RUNS, lastNTestruns=null, lastNBuilds=null, statuses=null, metadata={VERSION_BUILD=[49]}]


The Jenkins plugin is installed correctly as far as we can tell (connection tests to the AppMon server were successful).


This is with AppMon 6.5, Maven 3.3 and Jenkins 1.651.3


Any idea what we could be missing?


I'm attaching the pom.xml (slightly edited for anonymity).


Thanks in advance for any help!

Enrico

4 REPLIES 4

Enrico_F
DynaMight Pro
DynaMight Pro

We managed to solve the problem by adding a pre-build step to the build config on Jenkins in order to register the test run including the category:

Thanks for the update! The other option would be that you register that test run in your maven script itself

Thanks for the input Andi - yes in fact I assume configuring everything in the pom.xml is probably the cleaner way to do this (version control etc.). I also assume any settings in pom.xml will take precedence over the build config done in Jenkins, can you confirm?

Curiously, is it possible to register the same test case for multiple categories? Say we would like to run a unit test and get both architectural and performance metrics in the Test Results dashlet without having to register it twice - is that possible?

Regarding multiple test categories:

That's not currently possible. In order to do that, you'd need to register a separate test run for both categories and execute the test suite twice, providing each test run ID.