Information:

Environment

  • Dynatrace Portal
  • Synthetic Monitoring Backbone
Solution

Each time a test runs at a node:

  1. The result is compared to the alert setting.
  2. If that result has exceeded the alert threshold, that node goes into alert status.
  3. When that change of status occurs, the node threshold is checked.
  4. If the number of nodes in alert status for that test meets the node threshold, the alert is triggered.

If the node was already in an alert status when the test runs:

  1. If the returned data no longer exceeds the threshold, the status changes back to 'good' .
  2. When that alert status changes, the node threshold is checked.
  3. If the node threshold is no longer being met, an Improved alert is sent.

For example, a test running from 5 nodes has been configured with Transaction Failure alerting with a node threshold of 3.

When the test starts running, presumably it is not failing. So, the status of each of the nodes is GOOD.

Node 1: GOOD 
Node 2: GOOD 
Node 3: GOOD 
Node 4: GOOD 
Node 5: GOOD

As a test run is completed, its status is reported back to the main data center. As tests begin to fail, the status is updated and compared to the alert thresholds.

Node 1: GOOD 
Node 2: FAILED 
Node 3: GOOD 
Node 4: GOOD 
Node 5: FAILED

In the example above, 2 nodes are in a FAILED status. When the status of nodes 2 and 5 changed from GOOD to FAILED, the threshold and current number in FAILED are checked. Since in this case the threshold of 3 nodes has not yet been met, no alert is sent. If a third node fails at the same time (as in the example below), an Alert would be sent.

Node 1: GOOD 
Node 2: FAILED 
Node 3: FAILED
Node 4: GOOD
Node 5: FAILED

If a fifth node fails, an 'All Sites' alert would then be triggered as well. It is important to note, however, that the overall alert status is determined by total number of nodes in a failed status at one time. If two nodes fail, and then those nodes return GOOD data prior to the next node failing, an alert will not be sent.

Note that an alert notification is based on the account, test type, and individual test settings.

 

 

  • No labels