You can use the Smart Alerting option
Smart Alerting: Sends email just once if multiple incidents occur, until the raised incident is confirmed by a user. Otherwise notification goes out for each incident.
As NJ said above, we would need some more info to help you figure out this issue. Can you provide what he asked for? Alternatively, you could open a support ticket (https://www.dynatrace.com/support/) to have someone look at this with you. They will require the same information to triage as well.