Do not try to send notification if there is no-one to send to
Since we now remove the person doing the action from the notifications,
we can see the situation where it was the only person listed to be
notified in which case the to_mail list is empty.
In such case, just return