@Malaik What monitoring segment is alerting? Service/Process/App? I just want to be sure i point you in the right direction. My assumption is that its App level, and if thats correct you can exclude it per app:
If you are looking to block it at the service layer you might not be able to target the given IP but the request in general by muting it.