Prediction monitoring jobs¶
To integrate more closely with external data sources, monitoring job definitions allow DataRobot to monitor deployments running and storing feature data and predictions outside of DataRobot. For example, you can create a monitoring job to connect to Snowflake, fetch raw data from the relevant Snowflake tables, and send the data to DataRobot for monitoring purposes.
Service health information for external models and monitoring jobs
Service health information such as latency, throughput, and error rate is unavailable for external, agent-monitored deployments or when predictions are uploaded through a prediction monitoring job.
Time series model consideration
Monitoring jobs don't support monitoring predictions made by time series models.
Method | Description |
---|---|
Create monitoring jobs | Use the job definition UI to create monitoring jobs, allowing DataRobot to monitor deployments running and storing feature data and predictions outside of DataRobot. |
Monitoring jobs API | Use the Batch Monitoring API to create monitoring job definitions, allowing DataRobot to monitor deployments running and storing feature data and predictions outside of DataRobot. |
Manage monitoring job definitions | Use a deployment's Monitoring Jobs tab to manage the monitoring job definitions you create. |
View and manage batch jobs | Use the Batch Jobs tab to view and manage monitoring and prediction jobs. |