Amazon S3

Steps to complete:

1. Create a user with access to S3
2. Assign the user to the S3 bucket
3. Create an access key for the user
4. Configure your data connection in Datafold

​

Create a user with access to S3

To connect your Amazon S3 bucket, you will need to create a user for Datafold to use.

• Navigate to the AWS Console.
• Click on the search bar in the top header, then find IAM service and click on it.
• Click on the Users item of the Access Management section.
• Click on the Create user button.
• Create a user named Datafold.
• Do not attach a managed policy; the bucket policy below is sufficient.
• When done, keep ARN of the user handy as you’ll need it in the next step.

​

Assign the user to the S3 bucket

• Go to S3 panel and select the bucket.
• Click on the Permissions tab.
• Click on Edit next to the Bucket Policy.
• Add the following policy:
  {
    "Version": "2012-10-17",
    "Statement": [
      {
        "Effect": "Allow",
        "Principal": {
          "AWS": "arn:aws:iam::<account_id>:user/Datafold"
        },
        "Action": [
          "s3:GetObject",
          "s3:PutObject"
        ],
        "Resource": [
          "arn:aws:s3:::your-bucket-name/*",
          "arn:aws:s3:::your-bucket-name"
        ]
      }
    ]
  }
  
  Replace <account_id> and user/Datafold with your Datafold user’s ARN, and your-bucket-name with your bucket. s3:PutObject is only needed if you plan to write materialized diff results to this bucket.

​

Create an access key for the user

Next, go back to the IAM page to generate a key for Datafold.

• Click on the Users page.
• Click on the Datafold user.
• Click on the Security Credentials tab.
• Click on Create access key and select Create new access key.
• Choose Third-party service (or Other), confirm, and click Create access key. Copy the access key ID and secret access key.

​

Configure in Datafold

Click Save. Your data connection is ready!