Do

Document extraction with human feedback loop

Hacker News

Document extraction with human feedback loop

About the feature: We built a tool for automatically assessing business health from complex management financial documents and bank statements. In order to get this working reliably, we had to iterate extensively on the prompts for the structured output at the field level. This led us to building a feature to allow users to improve them too, and with some context engineering, we have what we are calling “feedback loops”. Here is a 2 min demo https://www.youtube.com/watch?v=ZDNlEZydoXU How it works (video runs through these steps): 1. Create a target form for your extraction (AI helps create it) 2. Upload a document (choose from different models) 3. Review the quality of the extraction (and check the PDF citations) 4. If there are any mistakes, correct them and give feedback at the field level 5. Once you feel like you've seen enough errors and provided enough corrections, use the Feedback workflow to refine your field descriptions. You can try the app here https://app.sea.dev/ (it works best when you do at least 2-3 reasonable extractions between prompt refinements) The feedback feature is currently in beta. If you make some corrections and then go to https://app.sea.dev/feedback you'll see them ready for review and refinement. I would love to get feedback on how we might improve this idea. The video was a toy example but it is live and working with a few early credit analysts customers and they seem to like it.

Share card

Actual performance

7points
2comments
Made the leaderboard

Launch Intel predictions

Analyze your own launch →
Indie HackersFits the IH revenue-focused audience · Strong signals: mistakes · Missing: supports, reddit linkedin, podcasting
87%87% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Product HuntOn track for Day 1 leaderboard · Strong signals: model, user, models · Missing: mac, agents, macos
85%85% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
Hacker NewsStrong engagement from HN community · Strong signals: ide, io · Missing: https docs, excited, just released
56%56% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
AppSumoStrong fit for a featured deal · Strong signals: users · Missing: plus, platform, intuitive
52%52% predicted probability of success on AppSumo, based on ML models trained on real launch data.
TrustMRRLess likely to generate early MRR · Strong signals: video, users · Missing: mobile apps, ios, personal
42%42% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
18%18% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Docuct
Docuct57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

AI-powered document extraction with human validation

Indie Hackers1ai
Hu
Human Lambdas – Create Human in the Loop queues and outsource them57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Human Lambdas – Create Human in the Loop queues and outsource them

Hacker News107
Parsewire
Parsewire42%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Intelligent Document Extraction software

Indie Hackers1b2b
A
A Dalle-3 and GPT4-Vision feedback loop37%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

A Dalle-3 and GPT4-Vision feedback loop

Hacker News587
Hu
HumanLayer – Human-in-the-Loop for AI Agents57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

HumanLayer – Human-in-the-Loop for AI Agents

Hacker News5
Docuct.ai
Docuct.ai48%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

AI-powered document extraction with human validation

Indie Hackerscommitment-full-time
ud
udoc. Dependency-free document extraction in Rust42%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

udoc. Dependency-free document extraction in Rust

Hacker News5
Dynamite Docs
Dynamite Docs46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

AI Powered Document Extraction

Indie Hackers1ai
Yeee
Yeee42%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Reduce the feedback loop between developpers

Indie Hackerscommitment-side-project
Parseflow
Parseflow70%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Evidence first document parsing and extraction API.

Indie Hackers1ai