Enhanced progress information for pipelines¶
Availability information
Enhanced progress information is off by default. Contact your DataRobot representative or administrator for information on enabling the feature.
Feature flag: Enable Pipeline Workspaces in the AI Catalog and Enable Workspace Development Modules
Now available for public preview, you can view module-specific progress information—separate from the module status indicators—for running pipelines, allowing you to determine when a pipeline is running slowly or if the pipeline execution failed.
In the AI Catalog, click the Workspaces tab and click Edit Workspace.
After running a pipeline, select the running module and click the Console tab to display two new tabs:
-
Logs—Provides tracing, print statements, stacktraces, and any other custom information.
-
Progress—Displays information on how much data has been processed as a percentage, or for the SparkSQL module, as a series of stages and tasks.
Note
All information in the Console tab is module-specific and reflects the module that is actively selected—it does not automatically display information for the module that is currently running.
Selecting a different module does not affect the progress information of any actively running module(s).
Progress and log information is available up to an hour after the module reaches a terminal state (Completed or Failed), unless the page is refreshed, in which case all Console information is cleared.