Timeliness indicators for predictions and actuals¶

Deployments have several statuses to define the general health of a deployment, including Service Health, Data Drift, and Accuracy. These statuses are calculated based on the most recent available data. For deployments relying on batch predictions made in intervals greater than 24 hours, this method can result in a Gray / Unknown status on the Prediction Health indicators in the deployment inventory. Now available for Public Preview, those deployment health indicators can retain the most recently calculated health status, presented along with timeliness status indicators to reveal when they are based on old data. You can determine the appropriate timeliness intervals for your deployments on a case-by-case basis.

Define timeliness settings¶

You can configure timeliness tracking on the Usage tab for predictions and actuals. After enabling tracking, you can define the timeliness interval frequency based on the prediction timestamp and the actuals upload time separately, depending on your organization's needs:

To enable and define timeliness tracking:

1. From the Deployments page, do either of the following:

   • Click the deployment you want to define timeliness settings for, and then click Usage > Settings.

   • Click the Gray / Not Tracked icon in the Predictions Timeliness or Actuals Timeliness column to open the Usage Settings page for that deployment.

     

2. On the Usage Settings page, configure the following settings:

   

   Setting	Description
   Track timeliness	Enable one or more of Track timeliness of predictions and Track timeliness of actuals. To track the timeliness of actuals, provide an association ID and enable target monitoring for the deployment.
   Predictions timestamp definition	If you enabled timeliness tracking for predictions, use the frequency selectors to define an Expected prediction frequency in ISO 8601 format. The minimum granularity is one hour. To define time intervals directly in ISO 8601 notation (P1Y2M3DT1H), click Switch to advanced frequency.
   Actuals timestamp definition	If you enabled timeliness tracking for actuals, use the frequency selectors to define the Expected actuals upload frequency in ISO 8601 format. The minimum granularity is one hour. To define time intervals directly in ISO 8601 notation (P1Y2M3DT1H), click Switch to advanced frequency.

   Tip

   You can click Reset to defaults to return to a daily expected frequency, or P1D.

3. Click Save.

View timeliness indicators¶

Once you've enabled timeliness tracking on the Usage > Settings tab, you can view timeliness indicators on the Usage tab and in the Deployments inventory:

View timeliness status events¶

On the Service Health tab, under Recent Activity, you can view timeliness status events in the Agent Activity log:

Filter the deployment inventory by timeliness¶

In the Deployments inventory, you can click Filters to apply Predictions Timeliness Status and Actuals Timeliness Status filters by status value: