You don't have to be bothered with a never-ending stream of needles alerts.
You can change notification sounds for emails and calendar events directly within the new Outlook app for Windows. In classic Outlook, you can choose whether to play a sound when a new email arrives.