Skip to content

Restore inference servers

DataRobot uses inference servers as part of its serverless predictions offering. If the associated serverless resources aren't restored, you are unable to make predictions using model deployments created prior to the backup.

To ensure inference servers are properly restored, you must include the following Kubernetes Custom Resource Definitions (CRDs) in your restore procedure:

  • executionenvironments.predictions.datarobot.com
  • inferenceservers.predictions.datarobot.com

Note

Starting with DataRobot 11.3, the executionenvironments.predictions.datarobot.com CRD was removed. If you are running DataRobot 11.3 or later, you can skip restoring this CRD.

Kubernetes CRDs

Note

You must fulfill the prerequisites before proceeding.

The Kubernetes CRDs can be restored using the following script:

echo "executionenvironments.predictions.datarobot.com restore started"
for ee in $(ls $BACKUP_LOCATION/predictions/executionenvironments); do
    echo $ee;
    kubectl apply -n $NAMESPACE -f $BACKUP_LOCATION/predictions/executionenvironments/$ee;
done
echo "executionenvironments.predictions.datarobot.com restore finished"


echo "inferenceservers.predictions.datarobot.com restore started"
for is in $(ls $BACKUP_LOCATION/predictions/inferenceservers); do
    echo $is;
    kubectl apply -n $NAMESPACE -f $BACKUP_LOCATION/predictions/inferenceservers/$is
done
echo "inferenceservers.predictions.datarobot.com restore finished"