Open-source infra for building embedded data pipelines

Hacker News

Hey HN! We are building *open source infrastructure for deploying customer-facing data pipelines.* Here’s our repo https://github.com/pipebird/pipebird and website https://pipebird.com/ . Pipebird (YC W22) is designed to enable companies that generate important data to offer secure data pushes to their customers’ warehouses, directly from their products. Our team was previously building in fintech, where we heard from many of our peers that their customers wanted data pushed directly to their warehouses. Customers wanted to bring data into their source of truth without having to maintain custom built pipelines or introduce security risks by contracting a third-party ETL/ELT provider. After seeing Stripe https://stripe.com/data-pipeline and customer.io https://customer.io/data-warehouse recently invest in building out their own native data sharing products, we realized that many SaaS companies could better support their customers and even generate additional revenue by offering native data pipelines. Our goal with Pipebird is to make creating a reliable data pipeline as simple as pressing a button from a vendor's dashboard. With the current iteration of the product, data can be selected from a number of sources (ex: Postgres, MySQL, CockroachDB, etc.), customers can configure pipelines and optionally apply transformations (like type casting), and data can be periodically synced directly to customers’ warehouses (ex: Snowflake). We’re actively adding sources/destinations and would appreciate any feature requests. Here's a 2 min demo of the product https://www.loom.com/share/c7a7e4b4e57c4015b533fd754c510b2e Pipebird is open source (MIT license) so that any developer can use it. Our aim is to not charge individual developers - we make money selling paid plans that include features like multiple projects, user permissions, additional security features, managed infra, support, etc. Give us a whirl: https://github.com/pipebird/pipebird . We’d love your feedback and will be here to answer any questions!

Visit product View on Hacker NewsSep 1, 2022

Share card

Actual performance

41points

20comments

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: user, stripe, open · Missing: mac, agents, macos

97%97% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Hacker NewsStrong engagement from HN community · Strong signals: open source, ide, pipe · Missing: https docs, excited, just released

84%84% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting

79%79% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

TrustMRRFits verified-revenue profile · Missing: mobile apps, ios, personal

50%50% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive

40%40% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Strong signals: revenue, saas, active · Missing: arr, mrr, profit

16%16% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Strong signals: make money, paid, introduce · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Mage18%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open-source tool for building and running data pipelines

Indie Hackers2ai

All-in-one open source tool for data pipelines60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

All-in-one open source tool for data pipelines

Hacker News21

Meltano, an open source platform for ELT pipelines67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Meltano, an open source platform for ELT pipelines

Hacker News3

Data pipelines for data scientists (new open-source notebook)77%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Data pipelines for data scientists (new open-source notebook)

Hacker News36

Embedded our open-source charting lib into a no-code storytelling tool73%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Embedded our open-source charting lib into a no-code storytelling tool

Hacker News13

Snips NLU, an open source library for embedded NLU62%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Snips NLU, an open source library for embedded NLU

Hacker News5

Autumn – Open-source infra over Stripe60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Autumn – Open-source infra over Stripe

Hacker News141

SirixDB – Storing and Querying of Temporal Data (Java and Open Source)62%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

SirixDB – Storing and Querying of Temporal Data (Java and Open Source)

Hacker News13

Streamdal – an open-source tail -f for your data81%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Streamdal – an open-source tail -f for your data

Hacker News148

Neosync – Open Source Data Replication and Anonymization73%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Neosync – Open Source Data Replication and Anonymization

Hacker News4

Browse all products Analyze your launch