datafold_tmp
in the above script, to materialize scratch work and keep data processing in the your warehouse.
Field Name | Description |
---|---|
Name | A name given to the data connection within Datafold |
Host | The hostname address for your database; default value 127.0.0.1 |
Port | Postgres connection port; default value is 5432 |
User | The user role created in our SQL script, named datafold |
Password | The password created in our SQL script |
Database Name | The name of the Postgres database you want to connect to |
Schema for temporary tables | The schema (datafold_tmp) created in our SQL script |
Parameter Group
. Database instances run with default parameters that do not include logging verbosity. To turn on the logging verbosity, you’ll need to create a new Parameter Group. Hit Parameter Groups on the menu and create a new Parameter Group.
aurora-postgresql10
parameter group family. This depends on the cluster that you’re running. For Aurora serverless, this is the appropriate family.
Finally, set the log_statement
enum field to mod
- meaning that it will log all the DDL statements, plus data-modifying statements. Note: This field isn’t set by default.
CloudWatchLogsReadOnly
and attach the CloudWatchLogsReadOnlyAccess
policy to it. Next, select the group.
Access Key
and Secret Key
. Save these two codes securely to finish configurations on Datafold.
The last piece of information Datafold needs is the CloudWatch Log Group. You will find this in CloudWatch under the Log Group section in the sidebar. It will be formatted as /aws/rds/cluster/<my_cluster_name>/postgresql
.
Field Name | Description |
---|---|
Name | A name given to the data connection within Datafold |
Host | The hostname address for your database; default value 127.0.0.1 |
Port | Postgres connection port; default value is 5432 |
User | The user role created in the SQL script; datafold |
Password | The password created in the SQL permissions script |
Database Name | The name of the Postgres database you want to connect to |
AWS Access Key | The Access Key provided in the Connect Datafold to CloudWatch step |
AWS Secret | The Secret Key provided in the Connect Datafold to CloudWatch step |
Cloudwatch Postgres Log Group | The path of the Log Group; formatted as /aws/rds/cluster/<my_cluster_name>/postgresql |
Schema for temporary tables | The schema created in the SQL setup script; datafold_tmp |