Python Stream Processing with Denormalized

Hacker News

tl;dr we’re releasing python bindings for writing stream processing jobs using the Denormalized Rust library. Hey HN, A few months ago we released Denormalized, our embeddable stream processing engine written in rust [0]. Today we’re excited to showcase python bindings for the library. Python is still very much the language of data and we wanted to make it easy for more engineers to write fast streaming jobs without having to learn Rust. Currently, you can use the library to write streaming aggregations, stream joins, and user defined aggregate functions (thought the API for this is quite clunk). The library is available on pypi: `pip install denormalized` and we’ve created a simple docker container that will quickly spin up an instance of kafka along with a script to write fake data to make running the examples [1] really easy: `docker run --rm -p 9092:9092 emgeee/kafka_emit_measurements:latest` We’d love to hear your feedback [0] https://news.ycombinator.com/item?id=41258276 [1] https://github.com/probably-nothing-labs/denormalized/tree/m...

Visit product View on Hacker NewsNov 13, 2024

Share card

Actual performance

20points

2comments

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Hacker NewsStrong engagement from HN community · Strong signals: excited, io · Missing: https docs, just released, exist

80%80% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

Indie HackersFits the IH revenue-focused audience · Strong signals: created · Missing: supports, reddit linkedin, podcasting

68%68% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

TrustMRRFits verified-revenue profile · Strong signals: month · Missing: mobile apps, ios, personal

50%50% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

Product HuntUnlikely to reach the leaderboard · Strong signals: user, dock, new · Missing: mac, agents, macos

40%40% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive

38%38% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

17%17% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Minibatch – Python stream processing61%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Minibatch – Python stream processing

Hacker News50

Bytewax – Python Stateful Stream Processing on Timely Dataflow61%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Bytewax – Python Stateful Stream Processing on Timely Dataflow

Hacker News21

Riko – A Python stream processing engine modeled after Yahoo! Pipes63%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Riko – A Python stream processing engine modeled after Yahoo! Pipes

Hacker News283

Table data stream processing – Python convtools54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Table data stream processing – Python convtools

Hacker News1

Iterable-subprocess – Stream to and from a subprocess in Python47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Iterable-subprocess – Stream to and from a subprocess in Python

Hacker News2

Stream-zip – Stream-construct ZIP archives in Python45%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Stream-zip – Stream-construct ZIP archives in Python

Hacker News1

We built rescaling for distributed stateful stream processing69%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

We built rescaling for distributed stateful stream processing

Hacker News5

Stream-unzip – stream unZIP files in Python43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Stream-unzip – stream unZIP files in Python

Hacker News27

Jet – in-memory, fault-tolerant, distributed stream processing64%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Jet – in-memory, fault-tolerant, distributed stream processing

Hacker News129

Benthos, stream multiplexer and processing service60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Benthos, stream multiplexer and processing service

Hacker News1

Browse all products Analyze your launch