If you get too much notifications on fail for let´s say a temporary problem, you could configure repeated tests with which you will get repeated notifications. That will stop sending you notifications if the problem no longer exist so you don´t need to care.
We use this for high load notifications which are nearly always only for a short period of time.