Be

BemiDB – Open-source data warehouse with zero-ETL

Hacker News

BemiDB – Open-source data warehouse with zero-ETL

Hi HN! We're Evgeny and Arjun, and we’re building a simpler way for startups to do data analytics. Since open-sourcing our Postgres read replica optimized for analytics ( https://github.com/BemiHQ/BemiDB ), we started hearing a familiar story. Teams would connect Postgres, feel relieved that they didn’t have to wrangle complex ETL pipelines, but then hit a wall as soon as they wanted to join data from HubSpot, Stripe, etc. They’d do hacky things like use Airbyte to sync data to their Postgres, so that it’d then auto sync to their BemiDB analytical database. We want to remove the layers of data complexity that startups have to add when scaling, and that’s why BemiDB now also allows connecting any supplementary data sources. This makes it a zero-ETL data warehouse for companies that don’t want the typical heavyweight warehouses with expensive ETL’s. Under the hood, we use Apache Iceberg (with Parquet data files) stored in S3. This allows for bottomless inexpensive storage, compressed data in columnar files, and an open format that guarantees compatibility with other data tools. We use Trino to help with table maintenance and compaction. We embed DuckDB as the query engine for in-memory analytics that work for complex queries. With efficient columnar storage and vectorized execution, we’re aiming for faster results without heavy infra. BemiDB communicates over the Postgres wire protocol and is also Postgres syntax compatible. We want to fully simplify data infra for companies that use Postgres and other data sources by reducing complexity (automatic data source syncs), using non-proprietary data formats (Iceberg open tables), and removing vendor lock-in (open source). We'd love to hear any and all feedback! Thoughts HN?

Share card

Actual performance

13points
2comments
Made the leaderboard

Launch Intel predictions

Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: stripe, using, open · Missing: mac, agents, macos
91%91% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Indie HackersFits the IH revenue-focused audience · Strong signals: started, compatible · Missing: supports, reddit linkedin, podcasting
86%86% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
Hacker NewsStrong engagement from HN community · Strong signals: open source, pipe, io · Missing: https docs, excited, just released
81%81% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
TrustMRRLess likely to generate early MRR · Strong signals: way · Missing: mobile apps, ios, personal
40%40% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Strong signals: soon, efficient · Missing: plus, platform, intuitive
30%30% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
16%16% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

VD
VDP – open-source unstructured visual data ETL80%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

VDP – open-source unstructured visual data ETL

Hacker News11
We
We made an open-source visual data ETL74%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

We made an open-source visual data ETL

Hacker News8
VDP
VDP34%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open-source unstructured data ETL infrastructure

Indie Hackers3ai
Du
Duckle was benchmarked against 4 open source ELT/ETL tools71%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Duckle was benchmarked against 4 open source ELT/ETL tools

Hacker News2
Si
Singer – Simple, Composable Open Source ETL71%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Singer – Simple, Composable Open Source ETL

Hacker News91
CocoIndex
CocoIndex31%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open source ETL to transform data for AI

Indie Hackerscommitment-full-time
Sn
Snapflow – Functional Data ETL60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Snapflow – Functional Data ETL

Hacker News4
Mu
Multiwoven – Open-Source Reverse-ETL71%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Multiwoven – Open-Source Reverse-ETL

Hacker News4
Si
SirixDB – Storing and Querying of Temporal Data (Java and Open Source)62%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

SirixDB – Storing and Querying of Temporal Data (Java and Open Source)

Hacker News13
St
Streamdal – an open-source tail -f for your data81%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Streamdal – an open-source tail -f for your data

Hacker News148