A

A GitHub Action that quizzes you on a pull request

Hacker News

A GitHub Action that quizzes you on a pull request

A little idea I got from playing with AI SWE Agents. Can AI help make sure we understand the code that our AIs write? PR Quiz uses AI to generate a quiz from a pull request and blocks you from merging until the quiz is passed. You can configure various options like the LLM model to use, max number of attempts to pass the quiz or min diff size to generate a quiz for. I found that the reasoning models, while more expensive, generated better questions from my limited testing. Privacy: This GitHub Action runs a local webserver and uses ngrok to serve the quiz through a temporary url. Your code is only sent to the model provider (OpenAI).

Share card

Actual performance

94points
33comments
Made the leaderboard

Launch Intel predictions

Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: agents, agent, model · Missing: mac, macos, cursor
79%79% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting
75%75% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal
39%39% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
Hacker NewsMay not resonate with HN audience · Strong signals: ide, io · Missing: https docs, excited, just released
33%33% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
23%23% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
18%18% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

[G
[GitHub] Mark Pull Request as depending on another48%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

[GitHub] Mark Pull Request as depending on another

Hacker News5
Re
Reviewpad, a GitHub action to automate pull request workflows44%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Reviewpad, a GitHub action to automate pull request workflows

Hacker News10
PRTriage
PRTriage59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

It supports pull request workflow on GitHub

Indie Hackerscommitment-side-project
divvy
divvy26%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Timely GitHub pull request approval through Slack

Indie Hackerscommitment-side-project
Gi
GitHub Pull Request Bot54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

GitHub Pull Request Bot

Hacker News2
Gi
GitHub Pull Request Reminder49%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

GitHub Pull Request Reminder

Hacker News2
GitBar
GitBar64%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Every pull request, one menubar. GitHub, GitLab & Azure

Product Hunt+122Productivity
Pr
Prace – Pull Request Linter for GitHub50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Prace – Pull Request Linter for GitHub

Hacker News1
Gi
GitHub action to print relevant stats about pull request Reviewers43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

GitHub action to print relevant stats about pull request Reviewers

Hacker News2
Pu
Pull-to-action gestures for angular34%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Pull-to-action gestures for angular

Hacker News2