At our customer we are performing Integration Tests on an application with TFS using the TFS Plugin on different environments. The development environment and a more stable test environment.
Both these environments are instrumented and the test automation features of AppMon are applied. Currently they all end-up in the same system profile since they share certain services. So, in the Test Automation dashlet you see both the dev as test testruns. The only thing they have different is the version. We added the environment within the versionBuild. So I guess that they currently both contribute to the same test metrics and both influence the corridor since only the version is different.
My Question: Is there a property we can use (maybe "Platform") to get a clear separation between the tests without the need for a new System Profile?
I am pointing to the rest interface here to register the test-run:
Solved! Go to Solution.
You are right, adding environment name to the version build field doesn't separate metrics, so in the test results view you'll see both in the same chart. If you're unable to use separate system profiles, I think using the platform field would be the second best approach. That will cause all the tests to be listed separately for each platform in the Test Results view.
Please note that in the Tests Overview dashlet you can use the platform field as a filter, so you can see the overview for each platform separately (you may want to save a dashboard for that).
This might be a secondary concern but to the question of whether it will affect the test corridor, each metric is automatically baselined on the basis of the agent instance (agentname@host) so in this regard it's already being split out like that