cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Custom Metrics in UI-Driven Tests

Hi,

Is there a documentation explaining which measures are used for the test results?

In my case custom measures for the method group are showing up, but I also would like to see User Action Response Time and maybe also Purepath Response Time. Is that somehow possible?

regards,

Gerald

14 REPLIES 14

andreas_grabner
Dynatrace Leader
Dynatrace Leader

Hi Gerald

I think I have a youtube tutorial where we demo UI-Driven Tests: https://www.youtube.com/watch?v=-OSSKwD4WKQ&t=2s&i...

As for metrics. They are listed here: https://community.dynatrace.com/community/display/...

Andi

Hi Andreas,

Thank you for the info. Do you know why there are no repsonse time measures available for UI-Testing?Further I can't see measures of the category W3C TimingsW3C Resource Timings

regards,

Gerald

Hello Gerald,

Did you enable the UEM? if yes then check the following link to enable the W3C resource timings on each dynatrace version.

https://community.dynatrace.com/community/display/DOCDT65/W3C+Resource+Timing+Metrics

Regards,

Babar

Hi Babar,

Yes I can see the metrics of the W3C Resource Count group, but no timing stuff.

regards

Gerald

Hello Gerald,

Which version of APM do you have?

What about the User Experince setting for the W3C metrics?

Did you check the following link:

https://community.dynatrace.com/community/display/DOCDT65/UI-Driven+Browser+Test

Regards,

Babar

Hi Babar,

I'm on version 6.5.7.1500

Well I didn't change anything myself, I just applied the "Configure" on the Test Automation screen

Which settings do you want to see?

regards,

Gerald

Please double check your W3C Resouce Timing metrics and make sure they are all split by Agent. This is another requirement we have for metrics. Some metrics are NOT split by agent by default. You can configure that by editing your measures -> go to the details tab -> check the splittings

Hi @Andreas G.,

I'm not able to change the setting:

I pinged the engineering team to get some clarification on this. stay tuned

Sounds good, thank you 😉

sorry for the late reply. engineering just confirmed that right now we really only analyze the count metrics. I will see what else I can claim into a future release. If you have any recommendations on additional metrics let me know

Hi Andi,

Thank you for the info.

Well I think for us the most important metrics are timing informations of user actions. Of course it also would be nice if we would have settings for choosing which measures should be used for which tests.

Maybe some customers cannot rely on reproducible browser and network speeds of the test clients and then timing metrics would destroy the tests.

regards,

Gerald

Thanks. the only issue with user action metrics is that right now we look at the full Visit. So - would you want to have the total sum of timing metrics for all user actions? or the average? Or do you intend to run single user action tests?

Hi Andi,

I was looking for an average for the whole test run.

thx,

Gerald