Skip to content

Click in-app to access the full platform documentation for your version of DataRobot.

Enhanced progress information for pipelines

Availability information

Enhanced progress information is off by default. Contact your DataRobot representative or administrator for information on enabling the feature.

Feature flag: Enable Pipeline Workspaces in the AI Catalog and Enable Workspace Development Modules

Now available for public preview, you can view module-specific progress information—separate from the module status indicators—for running pipelines, allowing you to determine when a pipeline is running slowly or if the pipeline execution failed.

In the AI Catalog, click the Workspaces tab and click Edit Workspace.

After running a pipeline, select the running module and click the Console tab to display two new tabs:

  • Logs—Provides tracing, print statements, stacktraces, and any other custom information.

  • Progress—Displays information on how much data has been processed as a percentage, or for the SparkSQL module, as a series of stages and tasks.

Note

All information in the Console tab is module-specific and reflects the module that is actively selected—it does not automatically display information for the module that is currently running.

Selecting a different module does not affect the progress information of any actively running module(s).

Progress and log information is available up to an hour after the module reaches a terminal state (Completed or Failed), unless the page is refreshed, in which case all Console information is cleared.


Updated April 19, 2022
Back to top