# September 2023 > September 2023 - Read about DataRobot's new preview and generally available features released in > September, 2023. This Markdown file sits beside the HTML page at the same path (with a `.md` suffix). It summarizes the topic and lists links for tools and LLM context. Companion generated at `2026-05-06T18:17:10.001754+00:00` (UTC). ## Primary page - [September 2023](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html): Full documentation for this topic (HTML). ## Sections on this page - [In the spotlight](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#in-the-spotlight): In-page section heading. - [Compare models across experiments from a single view](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#compare-models-across-experiments-from-a-single-view): In-page section heading. - [New Google BigQuery connector added](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#new-google-bigquery-connector-added): In-page section heading. - [September release](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#september-release): In-page section heading. - [GA](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#ga): In-page section heading. - [Period Accuracy now available in Workbench and DataRobot Classic](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#period-accuracy-now-available-in-Workbench-and-datarobot-classic): In-page section heading. - [Expanded prediction and monitoring job definition access](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#expanded-prediction-and-monitoring-job-definition-access): In-page section heading. - [Preview](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#public-preview): In-page section heading. - [Materialize Workbench datasets in Google BigQuery](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#materialize-workbench-datasets-in-google-bigquery): In-page section heading. - [Azure Databricks support added to DataRobot](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#azure-databricks-support-added-to-datarobot): In-page section heading. - [Workbench time-aware capabilities expanded to include time series modeling](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#workbench-time-aware-capabilities-expanded-to-include-time-series-modeling): In-page section heading. - [Leaderboard Data and Feature List tabs added to Workbench](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#leaderboard-data-and-feature-list-tabs-added-to-workbench): In-page section heading. - [What-if and Optimizer available in the new app experience](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#what-if-and-optimizer-available-in-the-new-app-experience): In-page section heading. - [Real-time notifications for deployments](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#real-time-notifications-for-deployments): In-page section heading. - [Custom jobs in the Model Registry](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#custom-jobs-in-the-model-registry): In-page section heading. - [Hosted custom metrics](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/sept2023-announce.html#hosted-custom-metrics): In-page section heading. ## Related documentation - [AI Platform releases](https://docs.datarobot.com/en/docs/release/index.html): Linked from this page. - [Managed SaaS releases](https://docs.datarobot.com/en/docs/release/cloud-history/index.html): Linked from this page. - [2023 AI Platform releases](https://docs.datarobot.com/en/docs/release/cloud-history/2023-announce/index.html): Linked from this page. - [Self-Managed AI Platform release notes](https://docs.datarobot.com/en/docs/release/archive-release-notes/index.html): Linked from this page. - [documentation](https://docs.datarobot.com/en/docs/workbench/nxt-workbench/experiments/manage-experiments/compare-models.html): Linked from this page. - [Service Account authentication](https://docs.datarobot.com/en/docs/reference/data-ref/data-sources/dc-bigquery.html): Linked from this page. - [Create and configure](https://docs.datarobot.com/en/docs/workbench/nxt-workbench/dataprep/add-data/connect.html): Linked from this page. - [Wrangle BigQuery datasets](https://docs.datarobot.com/en/docs/workbench/nxt-workbench/dataprep/wrangle-data/index.html): Linked from this page. - [Classic](https://docs.datarobot.com/en/docs/classic-ui/modeling/analyze-models/evaluate/period-acc-classic.html): Linked from this page. - [Workbench](https://docs.datarobot.com/en/docs/workbench/nxt-workbench/experiments/experiment-insights/period-accuracy.html): Linked from this page. - [time-aware](https://docs.datarobot.com/en/docs/workbench/nxt-workbench/experiments/create-experiments/create-time-aware/index.html): Linked from this page. - [prediction](https://docs.datarobot.com/en/docs/classic-ui/predictions/batch/batch-dep/manage-pred-job-def.html): Linked from this page. - [monitoring](https://docs.datarobot.com/en/docs/classic-ui/predictions/batch/pred-monitoring-jobs/manage-monitoring-job-def.html): Linked from this page. - [Roles and permissions documentation](https://docs.datarobot.com/en/docs/reference/misc-ref/roles-permissions.html#shared-deployment-job-roles): Linked from this page. - [documentation](https://docs.datarobot.com/en/docs/workbench/nxt-workbench/dataprep/wrangle-data/pub-recipe.html#publish-to-your-data-source): Linked from this page. - [documentation](https://docs.datarobot.com/en/docs/reference/data-ref/data-sources/wb-databricks.html): Linked from this page. - [documentation](https://docs.datarobot.com/en/docs/workbench/nxt-workbench/experiments/no-code-apps/app-edit.html#prediction-details): Linked from this page. - [notification system](https://docs.datarobot.com/en/docs/classic-ui/mlops/governance/deploy-notifications.html): Linked from this page. - [documentation](https://docs.datarobot.com/en/docs/classic-ui/mlops/deployment/registry/reg-custom-jobs.html): Linked from this page. - [documentation](https://docs.datarobot.com/en/docs/api/reference/sdk/custom-metrics.html#add-hosted-custom-metrics): Linked from this page. ## Documentation content September 27, 2023 With the latest deployment, DataRobot's AI Platform delivered the new GA and preview features listed below. From the release center you can also access: - Monthly deployment announcement history - Self-Managed AI Platform release notes ### In the spotlight #### Compare models across experiments from a single view Solving a business problem with Machine Learning is an iterative process and involves running many experiments to test ideas and confirm assumptions. To simplify the iteration process, Workbench introduces model Comparison—a tool that allows you to compare up to three models, side-by-side, from any number of experiments within a single Use Case. Now, instead of having to look at each experiment individually and record metrics for later comparison, you can compare models across experiments in a single view. The comparison Leaderboard is accessible from any project in Workbench. It can be filtered to more easily locate and select models, compare models across different insights, and view and compare metadata for the selected models. The Comparison tab is a preview feature, on by default. The video below provides a very quick overview of the comparison functionality. Feature flag ON by default: Enable Use Case Leaderboard Compare Preview [documentation](https://docs.datarobot.com/en/docs/workbench/nxt-workbench/experiments/manage-experiments/compare-models.html). **Video: Model comparison** #### New Google BigQuery connector added The new BigQuery connector is now generally available in DataRobot. In addition to performance enhancements and [Service Account authentication](https://docs.datarobot.com/en/docs/reference/data-ref/data-sources/dc-bigquery.html), this connector also enables support for BigQuery in Workbench, allowing you to: - Create and configure data connections. - Add BigQuery datasets to a Use Case. - Wrangle BigQuery datasets , and then publish recipes to BigQuery to materialize the output in the Data Registry. **Video: Google BigQuery connector** ### September release The following table lists each new feature: **Features grouped by capability** | Name | GA | Preview | | --- | --- | --- | | Data | | | | New Google BigQuery connector added | ✔ | | | Materialize Workbench datasets in Google BigQuery | | ✔ | | Azure Databricks support added to DataRobot | | ✔ | | Modeling | | | | Compare models across experiments from a single view | | ✔ | | Workbench time-aware capabilities expanded to include time series modeling | | ✔ | | Period Accuracy now available in Workbench and DataRobot Classic | ✔ | | | Leaderboard Data and Feature List tabs added to Workbench | | ✔ | | Applications | | | | What-if and Optimizer available in the new app experience | | ✔ | | Predictions and MLOps | | | | Expanded prediction and monitoring job definition access | ✔ | | | Real-time notifications for deployments | | ✔ | | Custom jobs in the Model Registry | | ✔ | | Hosted custom metrics | | ✔ | ### GA #### Period Accuracy now available in Workbench and DataRobot Classic Period Accuracy is an insight that lets you define periods within your dataset and then compare their metric scores against the metric score of the model as a whole. It is now generally available for all time series projects. In DataRobot [Classic](https://docs.datarobot.com/en/docs/classic-ui/modeling/analyze-models/evaluate/period-acc-classic.html), the feature can be found in the Evaluate > Period Accuracy tab. For [Workbench](https://docs.datarobot.com/en/docs/workbench/nxt-workbench/experiments/experiment-insights/period-accuracy.html), find the insight under Experiment information. The insight is also available for [time-aware](https://docs.datarobot.com/en/docs/workbench/nxt-workbench/experiments/create-experiments/create-time-aware/index.html) experiments #### Expanded prediction and monitoring job definition access This release expands role-based access controls (RBAC) for [prediction](https://docs.datarobot.com/en/docs/classic-ui/predictions/batch/batch-dep/manage-pred-job-def.html) and [monitoring](https://docs.datarobot.com/en/docs/classic-ui/predictions/batch/pred-monitoring-jobs/manage-monitoring-job-def.html) jobs to align with deployment permissions. Previously, when deployments were shared between users, job definitions and batch jobs weren’t shared alongside the deployment. With this update, the User role gains read access to prediction and monitoring job definitions associated with any deployments shared with them. The Owner role gains read and write access to prediction and monitoring job definitions associated with any deployments shared with them. For more information on the capabilities of deployment Users and Owners, review the [Roles and permissions documentation](https://docs.datarobot.com/en/docs/reference/misc-ref/roles-permissions.html#shared-deployment-job-roles). Shared job definitions appear alongside your own; however, if you don't have access to the credentials associated with a prediction Source or Destination in the AI Catalog, the connection details are [redacted]: For more information, see the documentation for [Shared prediction job definitions](https://docs.datarobot.com/en/docs/classic-ui/predictions/batch/batch-dep/manage-pred-job-def.html#shared-job-definitions) and [Shared monitoring job definitions](https://docs.datarobot.com/en/docs/classic-ui/predictions/batch/pred-monitoring-jobs/manage-monitoring-job-def.html#shared-job-definitions). ### Preview #### Materialize Workbench datasets in Google BigQuery Now available for preview, you can materialize wrangled datasets in the Data Registry as well as BigQuery. To enable this option, wrangle a BigQuery dataset in Workbench, click Publish, and select Publish to BigQuery in the Publishing Settings modal. Note that you must establish a new connection to BigQuery to use this feature. Preview [documentation](https://docs.datarobot.com/en/docs/workbench/nxt-workbench/dataprep/wrangle-data/pub-recipe.html#publish-to-your-data-source). Feature flag(s) ON by default: - Enable BigQuery In-Source Materialization in Workbench - Enable Dynamic Datasets in Workbench #### Azure Databricks support added to DataRobot Support for Azure Databricks has been added to both DataRobot Classic and Workbench, allowing you to: - Create and configure data connections. - Add Azure Databricks datasets. Preview [documentation](https://docs.datarobot.com/en/docs/reference/data-ref/data-sources/wb-databricks.html). Feature flag OFF by default: Enable Databricks Driver #### Workbench time-aware capabilities expanded to include time series modeling With this deployment, DataRobot users can now use date/time partitioning to build time series-based experiments. Support for time series setup, modeling, and insights extend date/time partitioning, bringing forecasting capabilities to Workbench. With a significantly more streamlined workflow, including a simple window settings modal with graphic visualization, Workbench users can easily set up time series experiments. After modeling, all time series insights will be available, as well as experiment summary data that provides a backtest summary and partitioning log. Additionally: With feature lists and dataset views, you can see the results of feature extraction and reduction. Because Quick mode trains only the most crucial blueprints, you can build more niche or long-running time series models, manually, from the blueprint repository. Feature flags ON by default: - Enable Date/Time Partitioning (OTV) in Workbench - Enable Workbench for Time Series Projects #### Leaderboard Data and Feature List tabs added to Workbench This deployment brings the addition of two new tabs to the experiment info displayed on the Leaderboard: - TheDatatab provides summary analytics of the data used in the project. - TheFeature liststab lists feature lists built for the experiment and available for model training. Feature flag ON by default: Enable New No-Code AI Apps Edit Mode #### What-if and Optimizer available in the new app experience In the new Workbench app experience, you can now interact with prediction results using the what-if and optimizer widget, which provides both a scenario comparison and optimizer tool. Make sure the tool(s) you want to use are enabled in Edit mode. Then, click Present, select a prediction row in the All rows widget, and scroll down to What-if and Optimizer. From here, you can create new scenarios and view the optimized outcome. **Chart view:** [https://docs.datarobot.com/en/docs/images/app-rn-1.png](https://docs.datarobot.com/en/docs/images/app-rn-1.png) **Table view:** [https://docs.datarobot.com/en/docs/images/app-rn-2.png](https://docs.datarobot.com/en/docs/images/app-rn-2.png) Preview [documentation](https://docs.datarobot.com/en/docs/workbench/nxt-workbench/experiments/no-code-apps/app-edit.html#prediction-details). Feature flag ON by default: Enable New No-Code AI Apps Edit Mode #### Real-time notifications for deployments DataRobot provides automated monitoring with a [notification system](https://docs.datarobot.com/en/docs/classic-ui/mlops/governance/deploy-notifications.html), allowing you to configure alerts triggered when service health, data drift status, model accuracy, or fairness values deviate from your organization's accepted values. Now available for preview, you can enable real-time notifications for these status alerts, allowing your organization to quickly respond to changes in model health without waiting for scheduled health status notifications: For more information, see the notifications [documentation](https://docs.datarobot.com/en/docs/classic-ui/mlops/governance/deploy-notifications.html). Feature flag OFF by default: Enable Real-time Notifications for Deployments #### Custom jobs in the Model Registry Now available as a preview feature, you can create custom jobs in the Model Registry to implement automation (for example, custom tests) for your models and deployments. Each job serves as an automated workload, and the exit code determines if it passed or failed. You can run the custom jobs you create for one or more models or deployments. The automated workload you define when you assemble a custom job can make prediction requests, fetch inputs, and store outputs using DataRobot's Public API. For more information, see the [documentation](https://docs.datarobot.com/en/docs/classic-ui/mlops/deployment/registry/reg-custom-jobs.html). #### Hosted custom metrics Now available as a preview feature, you can not only implement up to five of your organization's custom metrics into a deployment, but also upload and host code using DataRobot Notebooks to easily add custom metrics to other deployments. After configuring a custom metric, DataRobot loads a notebook that contains the code for the metric. The notebook contains one custom metric cell, a unique type of notebook cell that contains Python code defining how the metric is exported and calculated, code for scoring, and code to populate the metric. For more information, see the [documentation](https://docs.datarobot.com/en/docs/api/reference/sdk/custom-metrics.html#add-hosted-custom-metrics). All product and company names are trademarks™ or registered® trademarks of their respective holders. Use of them does not imply any affiliation with or endorsement by them.