Sink 5000 rows/SEC from Kafka –> Postgres using Python and 250MiB Mem

Hacker News

Hello! I've been working on building a flink alternative using DuckDB. Building off of DuckDB makes it easy to leverage all the integrations DuckDB supports. Using batching it's trivial to insert 5000 rows / second into a small postgres instance running locally in docker! Would love your thoughts and feedback, thank you! What do your data stacks look like for doing this non-differentiating data work like connecting streams and sources together?

Visit product View on Hacker NewsJan 31, 2025

Share card

Actual performance

2points

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: dock, using · Missing: mac, agents, macos

91%91% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Indie HackersFits the IH revenue-focused audience · Strong signals: supports · Missing: reddit linkedin, podcasting, created

74%74% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

Hacker NewsStrong engagement from HN community · Strong signals: 000, io · Missing: https docs, excited, just released

69%69% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal

43%43% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive

38%38% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

15%15% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Iceaxe – A modern, fast ORM for Python and Postgres79%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Iceaxe – A modern, fast ORM for Python and Postgres

Hacker News2

Solid IMAP and SMTP in Go Using Python52%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Solid IMAP and SMTP in Go Using Python

Hacker News2

Using functions to construct Regex in Python54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Using functions to construct Regex in Python

Hacker News105

WebRTC implementation for Python using Asyncio64%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

WebRTC implementation for Python using Asyncio

Hacker News216

Manipulate NumPy arrays in Python using Uiua44%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Manipulate NumPy arrays in Python using Uiua

Hacker News2

1M rows/s from Postgres to Python70%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

1M rows/s from Postgres to Python

Hacker News296

PgModeler – EER Diagramming for postgres73%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

PgModeler – EER Diagramming for postgres

Hacker News9

Merging RethinkDB and Postgres with GraphQL79%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Merging RethinkDB and Postgres with GraphQL

Hacker News6

Now supporting MySQL, Postgres, Redis, Mongo60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Now supporting MySQL, Postgres, Redis, Mongo

Hacker News3

GraphQL for Postgres83%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

GraphQL for Postgres

Hacker News195

Browse all products Analyze your launch