An AI agent that debugs your LLM app and submits pull requests

Hacker News

Hi HN, I built Kaizen Agent, an open-source CLI tool that acts like an AI QA engineer for your LLM applications and agents. It helps catch broken behavior, apply fixes automatically, and open a pull request — all in one workflow. What it does: - Runs test inputs with expected outputs - If a test fails, it analyzes the failure - Applies prompt/code fixes - Re-runs tests until they pass - Submits a GitHub PR with the fix Why I built it: I got tired of manually debugging and iterating while developing multi-step LLM agents. Writing test cases, checking outputs, tweaking prompts, rerunning — it was all too repetitive. This tool automates that loop. Try it: GitHub: https://github.com/Kaizen-agent/kaizen-agent Would love feedback — especially from anyone building agents, LLM tools, or testing frameworks. Curious how others are thinking about evaluation, brittleness, and automation in this space.

Visit product View on Hacker NewsJun 25, 2025

Share card

Actual performance

1points

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: agents, agent, code · Missing: mac, macos, cursor

95%95% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting

58%58% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal

39%39% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive

31%31% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Hacker NewsMay not resonate with HN audience · Strong signals: lua, io · Missing: https docs, excited, just released

24%24% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

22%22% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Making pull requests less painful with an AI agent31%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Making pull requests less painful with an AI agent

Hacker News9

On empathy and pull requests52%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

On empathy and pull requests

Hacker News1

GitHub App that prevents merging of pull requests with configuration56%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

GitHub App that prevents merging of pull requests with configuration

Hacker News9

Kodiak – a GitHub app to automerge pull requests53%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Kodiak – a GitHub app to automerge pull requests

Hacker News3

Backprop – Smarter Pull Requests38%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Backprop – Smarter Pull Requests

Hacker News11

Terrateam12%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Terrateam is Terraform GitOps with GitHub Pull Requests.

Indie Hackers

Fourchette – isolated testing environments on Heroku for pull requests50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Fourchette – isolated testing environments on Heroku for pull requests

Hacker News4

Pullwalla29%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Stay on top of pull requests with Pullwalla.

Indie Hackers1$4/moopen-source

CodeMill – a marketplace for pull requests48%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

CodeMill – a marketplace for pull requests

Hacker News169

Izuna, show type annotations on pull requests58%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Izuna, show type annotations on pull requests

Hacker News3

Browse all products Analyze your launch