Skip to content

On-premise users: click in-app to access the full platform documentation for your version of DataRobot.

Creating and managing data connectors

Availability information

Creating and managing data connectors is off by default. Contact your DataRobot representative or administrator for information on enabling the feature.

Feature flag: Enable DataRobot Connectors

Now available as a public preview feature, you can add data connectors to DataRobot and create a data connection from a connector. Additionally, Self-Managed AI Platform administrators can manage data connectors for an organization.

Creating a new data connection

Unless specifically disabled by the administrator, each user has permission to create a data connection. Any connection that you create is available only to you unless you share it with others.

To create a new data connection:

  1. From the Account Settings dropdown, select Data Connections.

  2. Click Add new data connection to open the data store selection dialog box. You can also create a new data connection using the AI Catalog by selecting Add to catalog > New Data Connection.

  3. Select the Connectors tile in the dialog box.

  4. Complete the fields for the data connection. They will vary slightly based on the data connection selected.

    Field Description
    Data connection name Provide a unique name for the connection.
    Connector Select the connector for the data store to use from the dropdown list.
    Configuration: Parameters Indicate the name of the bucket in which the data is stored and modify parameters for the connection.
  5. Click Add data connection to save the configuration.

The new connection appears in the left-panel list of Data Connections.

Note that to authenticate an S3 data connection, you must always provide the AWS Access Key and AWS Secret Access Key:

Azure Data Lake Gen2 connectors

New ADLS Gen2 connector available

These steps are for a deprecated version of the ADLS Gen2 connector. For information on the new ADLS Gen2 connector, see the ADLS Gen2 connection requirements.

In addition to S3, users can create data connections with Azure Data Lake Storage (ADLS) Gen2 connectors. The configuration process is similar to the workflow described above.

When indicating the configuration parameters, complete the two mandatory fields for Azure:

  • Azure Account Storage Name: The Azure account that has the container with data you plan to use.
  • File System Name: The name of the container storing the data.

To verify a data connection, you must use your Azure username, password, and account name.

Note

To authenticate an ADLS Gen 2 connector, users must have the appropriate Azure built-in role: Storage Blob Data Owner, Storage Blob Data Contributor, or Storage Blob Data Reader. If the system displays an error and fails to authenticate, report the error to your IT team so they can check your user role in Azure.

Two-factor authentication restrictions

You cannot set up an ADLS Gen2 connector in DataRobot if the account uses two-factor authentication in Azure.

Each configured user must also grant DataRobot permission to access data on their behalf. Click Grant access to do so for the account listed. To grant access for another account, click Use different account and enter a different set of credentials.

This brings you to a Microsoft login page that will also prompt you to log in with your Azure credentials and grant DataRobot permissions. After consenting, the data connection is fully verified.

Self-Managed AI Platform admins

The following is available only on the Self-Managed AI Platform.

Managing data connectors

Availability information

This feature is off by default. Contact your DataRobot representative or administrator for information on enabling the feature.

Feature flag: Can manage connectors

In addition to data connections, system administrators can now also manage data connectors. A connector allows DataRobot to provide a way for users to ingest data from a database or connector. The administrator can add connectors for their organization's users to access when creating data connections. Once uploaded, connectors can be modified or deleted only by administrators.

To create a connector (a native connector for AWS S3 in this example):

  1. Click your user profile icon in the top right corner. Select Data Connections from the dropdown menu and click the Connectors & Drivers tab.

  2. In the left-panel, select Connectors and click + Add new connector.

  3. In the Add New Connector modal, select Native for Configuration and select S3 from the Connector dropdown.

    For Java-based connectors, select Custom as the configuration; you will be prompted to upload a JAR file.

  4. Click Add connector. Once the connector is added, you can view it in the left panel of the Connectors & Drivers page.


Updated February 28, 2024