cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

This product reached the end of support date on March 31, 2021.

How baseline is generated for test automation metrics?

wei_ding
Dynatrace Organizer
Dynatrace Organizer

Dear all,

Compared to the Business Transaction baseline, which is calculated by the past 7 days of data, how is the baseline of test result metric calculated in test automation ?

Any comment is appreciated.

Thanks,

Wei

1 REPLY 1

rick_boyd
Mentor

Hey Wei,

If you look in the "calibration runs" setting in the Test Automation dialog of your system profile, you'll see how many test runs (for each case, on each host, for each measurement) need to occur in order to establish a baseline. I'm not sure the exact math that's used to create the corridor of expected performance, but it's likely a median +/- some multiplier of standard deviation for each measure. This would explain why the corridor tends to narrow over time, and why if the measurement is always the same there is essentially only one value in the corridor (if you always have one exception in your JUnit test, for example, the corridor will only contain '1')

Hope that helps,

Rick B