Skip to content

On-premise users: click in-app to access the full platform documentation for your version of DataRobot.

Configure notifications

To set the types of notifications you want to receive and how you receive them, in the Deployments inventory, open a deployment and click the Settings > Notifications tab.

DataRobot provides automated monitoring with a configurable notification system, alerting you when service health, data drift status, model accuracy, or fairness values exceed your defined acceptable levels. Notifications can trigger in-app alerts, emails, and webhooks. They are off by default but can be enabled by a deployment owner. Keep in mind that notifications only control whether emails are sent to subscribers; if notifications are disabled, monitoring of service health, data drift, accuracy, and fairness statistics still occurs. By default, notifications occur in real time for your configured status alerts, allowing your organization to quickly respond to changes in model health without waiting for scheduled health status notifications; however, you can choose to send notifications on the monitoring schedule.

Note

A deployment consumer only receives a notification when a deployment is shared with them and when a previously shared deployment is deleted. They are not notified about other events.

Tip

You can schedule deployment reports on the Monitoring > Reports tab.

Configure monitoring definitions

Monitoring definitions are located on the deployment settings pages, and your control over those settings depends on your deployment roleowner or user. Both roles can set personal notification settings; however, only deployment owners can set up schedules and thresholds to monitor the following:

Enable notification policies

To configure deployment notifications through the creation of notification policies, you can configure and combine notification channels and templates. The notification template determines which events trigger a notification, and the channel determines which users are notified. When you create a notification policy for a deployment, you can use a policy template without changes or as the basis of a new policy with modifications. You can also create an entirely new notification policy.

To use notification policies for a deployment, in the Notification configuration section, click Enable notifications configuration:

Create notification policies

After you enable notification configuration, click Create policy to add or define a policy for the deployment. You can use a policy template without changes or as the basis of a new policy with modifications. You can also create an entirely new notification policy:

Option Description
Use template Create a policy from a template, without changes.
Use template with modifications Create a policy from a template, with changes.
Create new Create a new policy and optionally save it as a template.

Under Policy summary, click the edit icon to edit the policy name, and then configure the required settings for the creation method you selected:

Use template

In the Use template panel, select a policy, and then click Save policy:

Use template with modifications

In the Use template with modifications panel, on the Select template tab, select a policy template, then click Next. On the Select trigger tab, select an Event group or a Single event and click Next:

On the Select channel tab, select a Channel template or a custom Deployment channel. Alternatively, if you haven't configured an appropriate channel, click Create deployment channel, configure the following channel settings, and then click Create channel to add and select a new custom channel for the current deployment:

Channel type Fields
External
Webhook
  • Payload URL: Enter the URL that should receive notification payloads.
  • Content type: Select application/json (when the payload URL requires JSON) or application/x-www-form-urlencoded (when the payload URL requires URL encoded data).
  • Secret token: (Optional) If required by the webhook, enter the secret token.
  • Enable SSL verification: By default, DataRobot verifies SSL certificates when delivering payloads and doesn't recommend disabling this option.
  • Show advanced options: Define Custom headers for the HTTP request.
  • Test connection: This type of connection must pass testing before it can be saved
Email
  • Email address: Enter the email address that should receive notifications.
Slack
  • Slack Incoming Webhook URL: Enter an incoming webhook URL, generated through your Slack workspace. For more information, see the Slack documentation.
  • Test connection: This type of connection must pass testing before it can be saved
Microsoft Teams
  • Microsoft Teams Incoming Webhook URL: Enter an incoming webhook URL, generated through your Microsoft Teams channel. For more information, see the Microsoft Teams documentation.
  • Test connection: This type of connection must pass testing before it can be saved.
DataRobot
User Enter one or more existing DataRobot usernames to add those users to the channel. To remove a user, in the Username list, click the remove icon .
Group Enter one or more existing DataRobot group names to add those groups to the channel. To remove a group, in the Group name list, click the remove icon .
Custom job If you've configured a custom job for notifications, select the custom job from the list.

Optionally, select Save as template to save the policy configuration as a template for future use.

Click Save policy. The new policy appears in the table under Notification policies applied to this deployment.

Create new

In the Create new panel, on the Select trigger tab, select an Event group or a Single event, and then click Next.

On the Select channel tab, select a channel Template or a Custom channel associated with the deployment. Alternatively, if you haven't configured an appropriate channel, click Create new, configure the following channel settings, and then click Create channel to add and select a new custom channel:

Channel type Fields
External
Webhook
  • Payload URL: Enter the URL that should receive notification payloads.
  • Content type: Select application/json (when the payload URL requires JSON) or application/x-www-form-urlencoded (when the payload URL requires URL encoded data).
  • Secret token: (Optional) If required by the webhook, enter the secret token.
  • Enable SSL verification: By default, DataRobot verifies SSL certificates when delivering payloads and doesn't recommend disabling this option.
  • Show advanced options: Define Custom headers for the HTTP request.
  • Test connection: This type of connection must pass testing before it can be saved
Email
  • Email address: Enter the email address that should receive notifications.
Slack
  • Slack Incoming Webhook URL: Enter an incoming webhook URL, generated through your Slack workspace. For more information, see the Slack documentation.
  • Test connection: This type of connection must pass testing before it can be saved
Microsoft Teams
  • Microsoft Teams Incoming Webhook URL: Enter an incoming webhook URL, generated through your Microsoft Teams channel. For more information, see the Microsoft Teams documentation.
  • Test connection: This type of connection must pass testing before it can be saved.
DataRobot
User Enter one or more existing DataRobot usernames to add those users to the channel. To remove a user, in the Username list, click the remove icon .
Group Enter one or more existing DataRobot group names to add those groups to the channel. To remove a group, in the Group name list, click the remove icon .
Custom job If you've configured a custom job for notifications, select the custom job from the list.

Optionally, select Save as template to save the policy configuration as a template for future use.

Click Save policy. The new policy appears in the table under Notification policies applied to this deployment.


Updated April 10, 2024