WAL or Change Data Capture (CDC) Based Replication
Below table shows supported features and features we are working on for WAL or CDC Based replication from Postgres to different targets. ā means supported. š ļø means Work in Progress and Coming Soon!.Warehouses
| Feature | Snowflake | BigQuery | Clickhouse | Postgres | S3/GCS |
|---|---|---|---|---|---|
| Initial Snapshot - Parallelizable | ā | ā | ā | ā | ā |
| Incremental Sync (CDC) | ā | ā | ā | ā | ā |
| DML Support - INSERT, UPDATE and DELETE | ā | ā | ā | ā | ā |
| Schema Changes | ā | ā | ā | ā | ā |
| Soft Delete | ā | ā | š ļø | ā | ā |
| Partitioned Tables | ā | ā | ā | ā | ā |
| Advanced Types - Arrays, JSONB, HSTORE, Geospatial etc. | ā | ā | ā | ā | ā |
| Advanced Monitoring - Lag, Throughput, Postgres Wait Events etc | ā | ā | ā | ā | ā |
| Resync Mirrors | ā | ā | ā | ā | ā |
| Column Exclusion | ā | ā | ā | ā | ā |
| Add Tables | ā | ā | ā | ā | ā |
Queues
| Feature | EventHubs | Kafka | Redpanda | PubSub |
|---|---|---|---|---|
| Initial Snapshot - Parallelizable | š ļø | ā | ā | ā |
| Incremental Sync (CDC) | ā | ā | ā | ā |
| DML Support - INSERT, UPDATE and DELETE | ā | N/A | N/A | N/A |
| Schema Changes | ā | š ļø | š ļø | š ļø |
| Partitioned Tables | ā | ā | ā | ā |
| Advanced Types - Arrays, JSONB, HSTORE, Geospatial etc. | ā | ā | ā | ā |
| Advanced Monitoring - Lag, Throughput, Postgres Wait Events etc | ā | ā | ā | ā |
| Resync Mirrors | š ļø | N/A | N/A | N/A |
| Column Exclusion | ā | ā | ā | ā |
Query Based or Watermark Based Replication
Below table shows supported features and features we are working on for Query Based or Watermark Based Replication from Postgres to different targets. ā means supported. š ļø means Work in Progress and Coming Soon!.| Feature | Snowflake | BigQuery | Postgres | S3/GCS |
|---|---|---|---|---|
| Initial Snapshot | ā | ā | ā | ā |
| Incremental Sync Based on Watermark | ā | ā | ā | ā |
| DML Support - INSERT, UPDATE (if updated_at & primary key are present) | ā | ā | ā | ā |
| Schema Changes - ADD COLUMN | ā | š ļø | š ļø | š ļø |
| Resync Mirrors | ā | š ļø | š ļø | š ļø |
| Partitioned Tables | ā | ā | ā | ā |
| Advanced Types - Arrays, JSONB, HSTORE, Geospatial etc. | ā | ā | ā | ā |
| Advanced Monitoring - Throughput, Postgres Wait Events etc | ā | ā | ā | ā |
| Column Exclusion | ā | ā | ā | ā |
Transformations
Below table shows what targets we support transformations and their status| Target | Status |
|---|---|
| EventHubs | ā |
| Kafka / Redpanda | ā |
| PubSub | ā |
| Snowflake | Private Preview |
| BigQuery | Private Preview |
| Clickhouse | Private Preview |
| Postgres | Private Preview |
| S3/GCS | Private Preview |