WAL or Change Data Capture (CDC) Based Replication

Below table shows supported features and features we are working on for WAL or CDC Based replication from Postgres to different targets. āœ… means supported. šŸ› ļø means Work in Progress and Coming Soon!.

Warehouses

FeatureSnowflakeBigQueryClickhousePostgresS3/GCS
Initial Snapshot - Parallelizableāœ…āœ…āœ…āœ…āœ…
Incremental Sync (CDC)āœ…āœ…āœ…āœ…āœ…
DML Support - INSERT, UPDATE and DELETEāœ…āœ…āœ…āœ…āœ…
Schema Changesāœ…āœ…āœ…āœ…āœ…
Soft Deleteāœ…āœ…šŸ› ļøāœ…āœ…
Partitioned Tablesāœ…āœ…āœ…āœ…āœ…
Advanced Types - Arrays, JSONB, HSTORE, Geospatial etc.āœ…āœ…āœ…āœ…āœ…
Advanced Monitoring - Lag, Throughput, Postgres Wait Events etcāœ…āœ…āœ…āœ…āœ…
Resync Mirrorsāœ…āœ…āœ…āœ…āœ…
Column Exclusionāœ…āœ…āœ…āœ…āœ…

Queues

FeatureEventHubsKafkaRedpandaPubSub
Initial Snapshot - ParallelizablešŸ› ļøāœ…āœ…āœ…
Incremental Sync (CDC)āœ…āœ…āœ…āœ…
DML Support - INSERT, UPDATE and DELETEāœ…N/AN/AN/A
Schema Changesāœ…šŸ› ļøšŸ› ļøšŸ› ļø
Partitioned Tablesāœ…āœ…āœ…āœ…
Advanced Types - Arrays, JSONB, HSTORE, Geospatial etc.āœ…āœ…āœ…āœ…
Advanced Monitoring - Lag, Throughput, Postgres Wait Events etcāœ…āœ…āœ…āœ…
Resync MirrorsšŸ› ļøN/AN/AN/A
Column Exclusionāœ…āœ…āœ…āœ…

Query Based or Watermark Based Replication

Below table shows supported features and features we are working on for Query Based or Watermark Based Replication from Postgres to different targets. āœ… means supported. šŸ› ļø means Work in Progress and Coming Soon!.

FeatureSnowflakeBigQueryPostgresS3/GCS
Initial Snapshotāœ…āœ…āœ…āœ…
Incremental Sync Based on Watermarkāœ…āœ…āœ…āœ…
DML Support - INSERT, UPDATE (if updated_at & primary key are present)āœ…āœ…āœ…āœ…
Schema Changes - ADD COLUMNāœ…šŸ› ļøšŸ› ļøšŸ› ļø
Resync Mirrorsāœ…šŸ› ļøšŸ› ļøšŸ› ļø
Partitioned Tablesāœ…āœ…āœ…āœ…
Advanced Types - Arrays, JSONB, HSTORE, Geospatial etc.āœ…āœ…āœ…āœ…
Advanced Monitoring - Throughput, Postgres Wait Events etcāœ…āœ…āœ…āœ…
Column Exclusionāœ…āœ…āœ…āœ…

Transformations

Below table shows what targets we support transformations and their status

TargetStatus
EventHubsāœ…
Kafka / Redpandaāœ…
PubSubāœ…
SnowflakePrivate Preview
BigQueryPrivate Preview
ClickhousePrivate Preview
PostgresPrivate Preview
S3/GCSPrivate Preview