SQLFlow: SQL Stream Processing Using DuckDB

Hacker News

I'm a couple years late to the party but DuckDB is blowing my mind. I couldn't find an good embedded DuckDB stream processing solution so I hacked my own, calling it SQLFlow: https://github.com/turbolytics/sql-flow SQLFlow enables writing stream transformations in pure sql, executed using DuckDB. The goal was to create a lightweight, performant stream processing engine using pure SQL transformations, DuckDB didn't disappoint! I'd love your feedback, feature requests, impressions, or just comments. I'd love to turn this into a stable, usable project that people are comfortable running in production. Thank you

Visit product View on Hacker NewsNov 27, 2023

Share card

Actual performance

7points

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Hacker NewsStrong engagement from HN community · Strong signals: io · Missing: https docs, excited, just released

77%77% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting

59%59% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

Product HuntOn track for Day 1 leaderboard · Strong signals: using · Missing: mac, agents, macos

55%55% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal

41%41% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive

38%38% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

17%17% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

SQLFlow - Easy Stream Processing46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

A flink alternative powered by DuckDB

Product Hunt+8

I brushed up on SQL using TDD, Ruby, and the pg gem53%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I brushed up on SQL using TDD, Ruby, and the pg gem

Hacker News1

Typed overlay over SQL now supports DuckDB60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Typed overlay over SQL now supports DuckDB

Hacker News4

We built rescaling for distributed stateful stream processing69%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

We built rescaling for distributed stateful stream processing

Hacker News5

Jet – in-memory, fault-tolerant, distributed stream processing64%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Jet – in-memory, fault-tolerant, distributed stream processing

Hacker News129

Benthos, stream multiplexer and processing service60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Benthos, stream multiplexer and processing service

Hacker News1

An SQL data mapper using Go generics61%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

An SQL data mapper using Go generics

Hacker News3

Upstream – Stream processing, for humans65%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Upstream – Stream processing, for humans

Hacker News5

Minibatch – Python stream processing61%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Minibatch – Python stream processing

Hacker News50

Bytewax – Python Stateful Stream Processing on Timely Dataflow61%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Bytewax – Python Stateful Stream Processing on Timely Dataflow

Hacker News21

Browse all products Analyze your launch