Custom alert for physical hosts with low disk space

[Elena_Masotta]

I am trying to make it possible so that certain machines inform me when they are under 200GB disk space. The end goal is to alert if Available Disk drops below 200GB for all drives that have a capacity of 1TB or more and only for machines tagged as Physical.

I have tried using the following:

1. Global Disk Usage Anomaly
2. Host Disk Usage Anomaly
3. Create Custom Event for Alerting
4. Building query in Data Explorer

These options only allow me to enter a % (% that disk space drops below to be alerted on), where I need to enter "200GB". The custom event for alerting option allows me to enter 200GB, but I cannot split by host, only by disk, so this won't work. Can anyone help me with this?

[paul_ingle]

I believe the disk available metric "builtin:host.disk.avail" will alert on the sum of disks on a host, so if you set a threshold for 200GB using that metric as a custom event for alerting, a problem should be generated for each host (sum of disks) that crosses the threshold 

[ChadTurner · Accepted solution]

You might need to incorporate a few different things. First I don't think we can leverage auto tags based off of drive size - RFE could be put in for that. What you could do is set a manual tag; "Drive Size:>1TB" I've also added a tag manually called physical for your use case but you can leverage this via auto tags. 

Once you have tagged (manually) the Hosts that have a drive space larger then 1TB, you can then set a Management Zone. You can call it what ever you want, I just call it Drive Space > 1TB. 

You don't need to have the extra condition of physical if you want to grab everything > 1TB, but if you want to isolate pHysical vs virtual and or cloud then you can add in that condition. 

This Management Zone can be, but isn't going to be used in the conventional sense. Its more so for the custom event for alerting. 

Navigate to the custom event for alerting and set it as the following: 

Now feel free to adjust it as you see fit. the core aspect is to set the Management Zone as this reduces your scope to the hosts included in that MZ. You could also leverage the Tag as a rule based filter but its only one rule at a time so you cant have one with Physical and >1TB, hence the MZ method. 

I hope this helps! Granted it might be a big ask to tag each host one by one with the tag. You could always leverage auto tags and provide a condition as long as the host names contain Regex = <Values> but that's up to you. If its a handful of servers it might not be a problem for manual tagging

[monique_vanwall]

Currently, we are struggling with file system alerting.  There are 2 possibilities, Thresholds on % or Thresholds on values.
As we have different types of filesystems (smaller ones & bigger ones) it is no option to choose between these options.  A threshold of 85% on a 5Gb  filesystem is ok, but on a 1TB filesystem, it means that 150 Gb remains, which is not a good threshold.  
For the same reasons, a threshold on values is not valuable for both kinds of filesystems.

Does anyone have a solution for this situation?  We get the response, works as designed, but this design does not work for our environment.

-Monique-

[ChadTurner · Accepted solution]

You could allow Davis to baseline the disks from the settings and/or from a custom event for alerting. 

[ct_27]

A similar discussion is occurring over here: https://community.dynatrace.com/t5/Dynatrace-Open-Q-A/Custom-Alert-for-Available-Disk-Space/m-p/1744...

[Karolina_Linda]

I've merged the two 🙂