Xo

Xorq – open-source Python-first Pandas-style pipelines

Hacker News

Xorq – open-source Python-first Pandas-style pipelines

Hi HN, Dan, Hussain and Daniel here… After years of struggling with data pipelines that worked in notebooks but failed in production, we decided to do something about it. We created xorq to eliminate the constant headaches of SQL/pandas impedance mismatch, runtime debugging, wasteful recomputations and unreliable research-to-production deployments that plague traditional pandas-style pipeline workflows. xorq is built on Ibis and DataFusion. We’d love your feedback and contributions. xorq is [Apache 2.0 licensed]( https://github.com/letsql/xorq/blob/main/LICENSE ) to encourage open collaboration. Repo : https://github.com/letsql/xorq Docs : https://docs.xorq.dev Roadmap Issues : https://github.com/letsql/xorq You can get started `pip install xorq`. Or, if you use nix, you can simply run `nix run github:xorq-labs/xorq` and drop into an IPython shell. Demo video: https://youtu.be/jUk8vrR6bCw Here are some vignettes to look into next: 1. MCP Server + Flight + XGBoost: https://docs.xorq.dev/vignettes/mcp_flight_server 2. 1 DuckDB + 2 Writers + 1 Reader: https://docs.xorq.dev/vignettes/duckdb_concurrent 3. OpenAI UDF: https://docs.xorq.dev/tutorials/hn_data_prep Some features to note: - Ibis-based multi-engine expression system: effortless engine-to-engine streaming - Cache expressions with `.cache` operator - Portable DataFusion-backed UDF engine with first class support for pandas dataframes - Serialize Expressions to and from YAML - Easily build Flight end-points by composing UDFs thanks for checking this out, and we’re here to answer any questions!

Share card

Actual performance

15points
7comments
Made the leaderboard

Launch Intel predictions

Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: mcp, openai, open · Missing: mac, agents, macos
91%91% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Hacker NewsStrong engagement from HN community · Strong signals: ide, pipe, io · Missing: https docs, excited, just released
82%82% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
Indie HackersFits the IH revenue-focused audience · Strong signals: created, started · Missing: supports, reddit linkedin, podcasting
77%77% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
TrustMRRLess likely to generate early MRR · Strong signals: video · Missing: mobile apps, ios, personal
48%48% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
32%32% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
22%22% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Pa
Parallelise pipelines of Python async iterables49%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Parallelise pipelines of Python async iterables

Hacker News71
Pa
Parallelise Pipelines of Python Iterables54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Parallelise Pipelines of Python Iterables

Hacker News1
Me
Meltano, an open source platform for ELT pipelines67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Meltano, an open source platform for ELT pipelines

Hacker News3
Al
All-in-one open source tool for data pipelines60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

All-in-one open source tool for data pipelines

Hacker News21
Fl
Flupy – Data Pipelines in Python55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Flupy – Data Pipelines in Python

Hacker News8
Pi
Pipelines – Language for scripting parrallel pipelines with Python58%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Pipelines – Language for scripting parrallel pipelines with Python

Hacker News69
VScanX
VScanX27%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open-source, offline-first Python vulnerability fuzzer

Indie Hackerscommitment-side-project
La
Lama – Open-Source Python Droplr Alternative75%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Lama – Open-Source Python Droplr Alternative

Hacker News12
Op
Open-Source Python Projects71%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open-Source Python Projects

Hacker News1
Ai
Aiochan – Golang-Style Concurrency for Python61%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Aiochan – Golang-Style Concurrency for Python

Hacker News2