Open-source tool for data cleaning with LLM

Hacker News

Data cleaning is often the first yet tedious step for DS/ML/BI. It involves tasks such as deduplication, data type casting, handling missing values, correcting typos, and more. I'm working on an open-source project that guides you through the data cleaning process. It currently supports tables in Pandas/Snowflake/DuckDB, and outputs DBT SQL/YAML for cleaning. We take an agent approach, which is very different from Copilot. For Copilot, humans need to specify the steps, which is burdensome. For LLM agents, they handle the heavy lifting of exploring data, figuring out what needs cleaning, and guiding humans through steps. Here is a 1-minute demo: https://youtu.be/D7jw43ccOkg Please let me know your thoughts and feedback!

Visit product View on Hacker NewsMay 16, 2024

Share card

Actual performance

1points

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: agents, agent, tasks · Missing: mac, macos, cursor

88%88% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal

45%45% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

Hacker NewsMay not resonate with HN audience · Strong signals: ide, io · Missing: https docs, excited, just released

44%44% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

Indie HackersIH features products with proven revenue · Strong signals: supports · Missing: reddit linkedin, podcasting, created

42%42% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive

21%21% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

16%16% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Open-source tool to find PII across data silos64%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open-source tool to find PII across data silos

Hacker News3

Desbordante – an open-source data profiling tool63%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Desbordante – an open-source data profiling tool

Hacker News2

I made an open source tool for transfering data63%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I made an open source tool for transfering data

Hacker News2

Open-source Data Anonymization tool nxs-data-anonymizer62%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open-source Data Anonymization tool nxs-data-anonymizer

Hacker News4

MailMop45%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

The Open-Source, Privacy-First Gmail Cleaning Tool

Product Hunt+14

SirixDB – Storing and Querying of Temporal Data (Java and Open Source)62%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

SirixDB – Storing and Querying of Temporal Data (Java and Open Source)

Hacker News13

Streamdal – an open-source tail -f for your data81%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Streamdal – an open-source tail -f for your data

Hacker News148

Open-Source Data Replication and Anonymization73%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open-Source Data Replication and Anonymization

Hacker News24

Neosync – Open Source Data Replication and Anonymization73%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Neosync – Open Source Data Replication and Anonymization

Hacker News4

SpiderFoot, the open source footprinting tool71%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

SpiderFoot, the open source footprinting tool

Hacker News2

Browse all products Analyze your launch