Pgstream – CDC tool for PostgreSQL with DDL support

Hacker News

Hi HN, pgstream is an open source CLI tool and Go library for Postgres logical replication events. We have some bigger plans with it, but as of now its main "differentiator" is that it includes not only data changes but also DDL changes in the same ordered and consistent stream. We have developed this because in the Xata platform we handle automatic replication from Postgres to Elasticsearch/OpenSearch. Initially schema changes were problematic because they required us intercepting them at the API layer and then apply them to the search engine. But if the replication is slightly delayed or faster than the update, you can get replication errors. Having a single consistent stream with both makes consumer a lot more reliable in the face of schema changes. The way it works is that pgstream installs event triggers for DDL changes and maintains a "shadow" representation of the schema in a separate table. The changes to this table are included in the replication stream. Besides the Elasticsearch/OpenSearch output, pgstream also comes with a simple "webhook" output which is a simple way to get webhooks for any changes that happen in Postgres (data & schema). GitHub repo: https://github.com/xataio/pgstream

Visit product View on Hacker NewsJul 17, 2024

Share card

Actual performance

8points

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: single, open · Missing: mac, agents, macos

71%71% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Hacker NewsStrong engagement from HN community · Strong signals: open source, ide, io · Missing: https docs, excited, just released

53%53% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

TrustMRRLess likely to generate early MRR · Strong signals: way, para · Missing: mobile apps, ios, personal

47%47% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

Indie HackersIH features products with proven revenue · Strong signals: para · Missing: supports, reddit linkedin, podcasting

39%39% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Strong signals: platform · Missing: plus, intuitive, reviews

33%33% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

13%13% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Pg_protobuf – Protobuf support for PostgreSQL50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Pg_protobuf – Protobuf support for PostgreSQL

Hacker News7

Kafka FDW for PostgreSQL65%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Kafka FDW for PostgreSQL

Hacker News2

es2postgres – ElasticSearch to PostgreSQL Loader71%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

es2postgres – ElasticSearch to PostgreSQL Loader

Hacker News3

Metagration: PostgreSQL Migrator in PostgreSQL56%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Metagration: PostgreSQL Migrator in PostgreSQL

Hacker News1

PRQL in PostgreSQL73%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

PRQL in PostgreSQL

Hacker News267

Oh, Krab – PostgreSQL tool based on HCL syntax47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Oh, Krab – PostgreSQL tool based on HCL syntax

Hacker News3

PGLite – PostgreSQL in the Browser72%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

PGLite – PostgreSQL in the Browser

Hacker News4

Kallax a PostgreSQL Typesafe ORM for the Go Language75%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Kallax a PostgreSQL Typesafe ORM for the Go Language

Hacker News17

SSO for PostgreSQL Using OAuth2/OIDC58%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

SSO for PostgreSQL Using OAuth2/OIDC

Hacker News1

Play Battleships on PostgreSQL50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Play Battleships on PostgreSQL

Hacker News96

Browse all products Analyze your launch