Amazon DynamoDB Connector for Data Prep¶
User Persona: Data Prep User, Data Prep Admin, Data Source Admin, or IT/DevOps
This document covers all configuration fields available during connector setup. Some fields may have already been filled out by your Administrator at an earlier step of configuration and may not be visible to you. For more information on Data Prep's connector framework, see Data Prep Connector setup. Also, your Admin may have named this connector something else in the list of Data Sources.
Configure Data Prep¶
This connector allows you to connect to an Amazon DynamoDB for Library imports. The following fields are used to define the connection parameters.
- Name: Name of the data source as it will appear to users in the UI.
- Description: Description of the data source as it will appear to users in the UI.
You can connect Data Prep to multiple DynamoDB accounts. Using a descriptive name can be a big help to users in identifying the appropriate data source.
If you connect to DynamoDB through a proxy server, these fields define the proxy details.
- Web Proxy: 'None' if no proxy is required or 'Proxied' if the connection to DynamoDB should be made via a proxy server. If a web proxy server is required, the following fields are required to enable a proxied connection.
- Proxy host: The host name or IP address of the web proxy server.
- Proxy port: The port on the proxy server for Data Source.
- Proxy userame: The username for the proxy server.
- Proxy password: The password for the proxy server.
Note: Leave username & password blank for an unauthenticated proxy connection.
- AWS Region: Select the region to be used when sending requests to the DynamoDB API.
- AWS Authentication Type: These options specify how to authenticate with AWS.
- AWS Credentials: Requires each user to enter the Access Key ID and Secret Key associated with the user’s AWS Access Key. This is the default setting. See AWS Security Credentials for more details.
- Instance Profile (IAM Role): Enables all users in this tenant to access AWS without needing to individually authenticate. This authentication method is only available to customers deployed on AWS VPCs with EC2 servers configured to allow this kind of authentication. For more information on this approach, please see Using Instance Profile (IAM Role) to Grant Access to AWS Resources on Amazon EC2.
This connector will automatically retrieve credentials from the EC2 server instance.
DynamoDB Table Settings¶
Sample Items: Specifies the number of records (the equivalent of "rows" in a traditional relational database) to use when determining the schema of the table for import.
Note: DynamoDB is not a relational database, but Data Prep transforms all data into a tabular format upon import. In order to do this, Data Prep looks at the first n documents of a DynamoDB table (DynamoDB is a document database) and determines what attributes are present so that it can treat those attributes as columns. The "Sample Items" value determines the number of documents to look at.
Data Import Information¶
DynamoDB tables in the specified AWS region are available for import.
Via SQL Query¶
FAQ / Troubleshooting / Common Issues¶
Certain permissions are required in order to import data from DynamoDB. They are: