A user needs 'change monitoring settings' permissions either at the tenant level or at least in a management zone that includes that application entity. Basically you just need to be able to get to the application entity specific settings page. There's also an API token permission that's limited to just managing this you could use in a CI/CD pipeline.
