Skip to main content
Snowflake as a destination is deprecated and no longer actively maintained. It remains fully functional and no code is currently being removed. For new mirrors, we recommend ClickHouse, ClickHouse Cloud, or Postgres as the destination.

Prerequisites

To connect Snowflake to PeerDB, you need a Snowflake account with the appropriate permissions to create a user and warehouse for PeerDB. We have provided a script that you can use to create a user and warehouse for PeerDB. The script also creates a role and grants the role the appropriate permissions to access the warehouse and database.

Setup Roles and Permissions

1

Setup Warehouse

You can choose to create an exclusive warehouse for PeerDB or use an existing warehouse:
  1. (Recommended) You can create and use an exclusive warehouse for PeerDB. PeerDB operations will never contend with your queries for resources. You will have to pay the cost of running the warehouse.
  2. You can use a shared warehouse to reduce your warehouse running cost. PeerDB operations may have to contend with your queries for the shared resources.
2

Warehouse Setup

Depending on whether you want to create a new warehouse or use a shared warehouse, do either of the following:
  1. If you want to create a new exclusive warehouse, don’t make any changes to the PEERDB_WAREHOUSE value in the script
  2. If you want PeerDB to use a shared warehouse to process source queries, change the PEERDB_WAREHOUSE value in the script to the name of the shared warehouse
3

Role, User and Database Setup

Replace the default PEERDB_ROLE, PEERDB_DATABASE, PEERDB_USER, and PEERDB_5TR0NG_P455W0RD values with values that conform to your specific naming conventions for those resources.
Do not use the actual value of PEERDB_USER for any other purpose.
4

Roles and Permissions

  1. Log in to your Snowflake data warehouse.
  2. Copy the following script to a new worksheet and edit as needed (to add schemas).
Setup PeerDB Role
5

Run the Script

Run the script. Make sure to select the All Queries checkbox.Log in as the newly created user and verify that the schemas to sync to are visible in the Snowflake UI.

Setup Key-pair Authentication (Required)

1

Terminal

Open the command line in a terminal window.
2

Generate Private Key

Generate a private key (rsa_key.p8). You can generate an encrypted version of the private key or an unencrypted version of the private key.
To generate an unencrypted version, you can execute the following commands:
To generate an encrypted keypair, execute the command:
You will be prompted to enter a password. Choose a strong one, and don’t forget to note it down!You can also use different algorithms instead of the recommended AES256 if needed. PeerDB supports the following alternative algorithms:
  • AES128
  • DES3
3

Generate Public Key

From the command line, generate the public key (rsa_key.pub) by referencing the private key. Execute the command
4

Assign Public Key

Assign the public key to the Snowflake user. In a Snowflake worksheet, execute the command
You must replace the <PUBLIC_KEY> value with the string between the -----BEGIN PUBLIC KEY----- and -----END PUBLIC KEY----- statements. Exclude the -----BEGIN PUBLIC KEY----- and -----END PUBLIC KEY----- parts of the string.Apart from that, multiple lines in the public key are fine.
Refer to this doc for more details.

Configure PeerDB

To get the Snowflake account_id, you can either get it via a query or from the Snowflake UI:
To get the Snowflake account_id, run the following query in Snowflake worksheet:
remove .snowflakecomputing.com from the output of the above query to get the account identifier.Example in lixxxxx.us-east-1.snowflakecomputing.com, you want to use lixxxxx.us-east-1 as the account identifier.
Open the account selector form the bottom left of the Snowflake Web Interface and click the Copy icon as below:

Get Snowflake Account Identifier via the Snowflake Web Interface

Replace any dots (.) in the account identifier with hyphens (-).Example, in AB1234.XYZ987, you want AB1234-XYZ987
The account identifier is case insensitive.

PeerDB UI

In the PeerDB UI, after selecting Snowflake as the source, you can configure the connection details as follows:
password is NOT the account password. It is the password used to encrypt the private key, if using an encrypted private key.

Configure PeerDB UI with Snowflake Connection details

Validate the connection and create the Peer!

PeerDB SQL

In the PeerDB SQL interface, you can create a peer to Snowflake using the following command:
password is NOT the account password. It is the password used to encrypt the private key, if using an encrypted private key.

Considerations

  1. Database Specific: PeerDB only supports querying tables within a database. Cross database joins are not supported yet.
  2. Supported Datatypes: All string, numeric and timestamp based datatypes are supported for querying.
  3. SQL Coverage: Most SQL constructs in reads incl. Simple Selects, JOINs, aggregations, window functions, CTEs etc are supported. You can run both Postgres compatible and SF compatible queries through PeerDBs interface.
  4. Error Handling: If a query fails on the Snowflake side because of lack of auth or query coverage or timeout, PeerDB handles that error and propagates the entire message as a JSON text to the end-user. We also capture this ERROR message within PeerDB logs.