Can anyone let me know on what basis are metrics are shown in Test Results Dashlet? Is it based on the Test Category? or is it based on the individual requests? When I checked each requests seem to have different metrics captured.
Also how do we specify custom measures in the Register test run web api call?
Correct, it's based on the test category. At the bottom of each page for each category is what measures are collected. The external test category lets you specify custom metrics to baseline, but does not collect any automatically. Only metrics you tell it are captured. I don't believe other test categories let you specify additional metrics. That would be a great feature though. That would possibly allow capturing measures such as database queries when the database is faked/mocked.
But in the API documentation it says:
It doesn't say anywhere that it is only for external tests. Is there a link to the API documentation other than this?