Pgwarehouse: Easily sync your Postgres db to a Snowflake or ClickHouse warehouse

Pgwarehouse: Easily sync your Postgres db to a Snowflake or ClickHouse warehouse(github.com)

6 points by scottpersinger 3 years ago | 4 comments

higeorge13 3 years ago |

Interesting tool! I am curious about this feature: https://github.com/scottpersinger/pgwarehouse#last-modified in Clickhouse. Have you tested it on big tables and how well does it perform?

scottpersinger 3 years ago |

Built this recently to help a friend setup a Snowflake warehouse from their Postgres database. Also tested it with ClickHouse which is cool for running locally. Uses simple COPY which is fast and doesn't require binlog access, but doesn't support real-time replication as a result.

tylerhannan 3 years ago | |

Super interesting, I look forward to playing with it.

FWIW, the Community Integrations section of https://clickhouse.com/docs/en/integrations is open for PRs if you want to add it ;)

scottpersinger 3 years ago | | |

cool - will do!