A work around would be adjusting these sliding windows here which will decrease the amount of email notifications recieved, depending on the settings you choose. So default would be an email about every 5 minutes, but this can be adjusted. Out of the box functionality of Dynatrace sends notifications until the problem has closed. Please also include your alerting profile and problem notifcation settings so we can take a closer look at your configurations for clarity.
Exactly like @kobecharles said. Also you can adjust alert delay in Problem alerting profiles. So you can basically use “advanced model properties” in “Metric events” and “Problem alerting profiles” to specify when alerts should raise and send email