Make a one-time batch prediction¶
Use the Deployments > Make Predictions tab to efficiently score datasets with a deployed model by making batch predictions.
To make predictions with a model before deployment, select the model from the Leaderboard and navigate to Predict > Make Predictions.
Batch predictions are a method of making predictions with large datasets, in which you pass input data and get predictions for each row. DataRobot writes these predictions to output files. You can also:
Schedule Batch Prediction Jobs by specifying the prediction data source and destination and determining when DataRobot runs the predictions.
Make predictions with the Batch Prediction API.
Select a prediction source¶
To view the Make Predictions page options, you must first upload data for the model to score. To upload a Prediction source, take either of the following steps:
Click and drag a file into the Prediction source group box.
Click Choose file to upload a Local file or a dataset stored in the AI Catalog.
When uploading a prediction dataset, it is automatically stored in the AI Catalog once the upload is complete. Be sure not to navigate away from the page during the upload, or the dataset will not be stored in the catalog. If the dataset is still processing after the upload, that means DataRobot is running EDA on the dataset before it becomes available for use.
Make predictions with a deployment¶
This section explains how to make batch predictions for standard and for time series deployments.
To make batch predictions with a deployed model, navigate to the deployment's Predictions > Make Predictions tab.
|Prediction source||Select a prediction source by uploading a local file or importing a dataset from the AI Catalog.|
|Time series options||Specify and configure a time series prediction method.|
|Prediction options||Configure the prediction options.|
|Compute and download predictions||Score the data and download the predictions.|
|Your recent predictions||View your recent batch predictions and download the results. These predictions are available for download for 48 hours.|
Set time series options¶
Configure the Time series options by choosing the prediction method: forecast point or forecast range.
Select Forecast point to choose the specific date from which you want to begin making predictions.
- If you choose Automatically, DataRobot selects the forecast point for you based on the scoring data.
If you choose Manual, you can select the forecast point date.
Select Forecast range if you intend to make bulk, historical predictions (instead of forecasting future rows from the forecast point). By default, predictions use all forecast distances within the selected time range. Alternatively, you can specify a specific date range using the date selector.
Set prediction options¶
Once the file is uploaded, configure the Prediction options. Optionally, you can click Show advanced options to configure additional options.
|Include input features||Writes input features to the prediction results file alongside predictions. To add specific features, enable the Include input features toggle, select Specific features, and type feature names to filter for and then select features. To include every feature from the dataset, select All features. You can only append a feature (column) present in the original dataset, although the feature does not have to have been part of the feature list used to build the model. Derived features are not included.|
|Include prediction explanations||Adds columns for prediction explanations to your prediction output.|
|Include prediction outlier warning||Includes warnings for outlier prediction values (only available for regression model deployments).|
|Track data drift, accuracy, and fairness for predictions||Tracks data drift, accuracy, and fairness (if enabled for the deployment).|
|Chunk size||Adjusts the chunk size selection strategy. By default, DataRobot automatically calculates the chunk size; only modify this setting if advised by your DataRobot representative. For more information, see What is chunk size?|
|Concurrent prediction requests||Limits the number of concurrent prediction requests. By default, prediction jobs utilize all available prediction server cores. To reserve bandwidth for real-time predictions, set a cap for the maximum number of concurrent prediction requests.|
|Include prediction status||Adds a column containing the status of the prediction.|
|Use default prediction instance||Lets you change the prediction instance. Turn the toggle off to select a prediction instance.|
What is chunk size?
The batch prediction process chunks your data into smaller pieces and scores those pieces one by one, allowing DataRobot to score large batches. The Chunk size setting determines the strategy DataRobot uses to chunk your data. DataRobot recommends the default setting of Auto chunking, as it performs the best overall; however, other options are available:
Fixed: DataRobot identifies an initial, effective chunk size and continues to use it for the rest of the model scoring process.
Dynamic: DataRobot increases the chunk size while model scoring speed is acceptable and decreases the chunk size if the scoring speed falls.
Custom: A data scientist sets the chunk size, and DataRobot continues to use it for the rest of the model scoring process.
Compute and download predictions¶
Once configured, click Compute and download predictions to start scoring the data.
When scoring completes, click Download Predictions to download a predictions file.
If the prediction job fails, click View logs to view and optionally copy the run details.
Predictions are available for download on the Predictions > Make Predictions page for the next 48 hours. You can also view and download predictions and logs on the Deployments > Prediction Jobs tab.
Cancel a batch prediction job
Click the orange X while the job is running to cancel it. Once canceled, you can click the arrow to view the logs for the job.