When the alerts are running, The "Start Monitoring with Alerts" button under the Preview window changes to "Stop Monitoring".