DataRobot provides automated monitoring with a notification system. You can configure notifications to alert you when service health, data drift status, model accuracy, or fairness values exceed your defined acceptable levels. Notifications can trigger in-app alerts, emails, and webhooks. They are off by default but can be enabled by a deployment Owner in the deployment settings. Keep in mind that notifications only control whether emails are sent to subscribers. If notifications are disabled, monitoring of service health, data drift, accuracy, and fairness statistics still occurs. You can also schedule deployment reports on the Notifications tab.
A deployment Consumer only receives a notification when a deployment is shared with them and when a previously shared deployment is deleted. They are not notified about other events.
To set the types of notifications you want to receive:
In the Deployments inventory, open a deployment and click the Notifications tab.
Select whether to email notifications and, if so, whether to send them for all events or just critical events, then, click Save.
The monitoring actions are located on the deployment settings pages, and your control over those settings depends on your deployment role—Owner or User. Both roles can set personal Notification Settings; however, only deployment Owners can set up schedules and thresholds to monitor the following:
Notifications are delivered as emails and must be set up for each deployment you want to monitor.
You can also schedule deployment reports on the Notifications tab.