St

Standardising 'Unit Tests' for Prompts

Hacker News

Standardising 'Unit Tests' for Prompts

PromptRepository is an open-source framework (Typescript) that illustrates an approach to creating more reliable LLM-based applications through systematic prompt validation, and testing. Key features: - Simple JSON schema for externalized prompts with versioning and parameter validation - Lightweight approach inspired by Anthropic's guidance to "keep it simple" with LLM applications - 'Unit tests for Prompts' inspired by Chris Benson/Practical AI's recommendations from episode 295. - Bundled prompts to generate unit tests and evaluations for new prompts built with the framework. The framework demonstrates a novel approach: bundle tested prompts with a framework that generate code to use the framework. Repo: https://github.com/jonverrier/PromptRespository Take a look.

Share card

Actual performance

3points
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: new, code, open · Missing: mac, agents, macos
75%75% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Indie HackersFits the IH revenue-focused audience · Strong signals: para · Missing: supports, reddit linkedin, podcasting
63%63% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
45%45% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Hacker NewsMay not resonate with HN audience · Strong signals: lua, io · Missing: https docs, excited, just released
33%33% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
TrustMRRLess likely to generate early MRR · Strong signals: para · Missing: mobile apps, ios, personal
27%27% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
16%16% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
4%4% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Wr
Writing unit tests in Golang33%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Writing unit tests in Golang

Hacker News1
CodeBeaver
CodeBeaver65%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Unit tests on autopilot

Product Hunt+109
Dy
Dynamically generate self-signed certs for Go unit tests41%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Dynamically generate self-signed certs for Go unit tests

Hacker News1
Wr
Writing modern C unit tests with Criterion46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Writing modern C unit tests with Criterion

Hacker News34
Op
Opunit Simple unit tests for servers and containers43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Opunit Simple unit tests for servers and containers

Hacker News15
Un
Unit Tests for LangChain aps in 3 lines of code41%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Unit Tests for LangChain aps in 3 lines of code

Hacker News1
Wr
Writing Maintainable Unit Tests Course39%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Writing Maintainable Unit Tests Course

Hacker News2
Un
Unit tests for data structures47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Unit tests for data structures

Hacker News3
I
I made a CLI that will use GPT4 to generate unit tests39%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I made a CLI that will use GPT4 to generate unit tests

Hacker News4
Fl
Flaptastic helps make your unit tests perfect33%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Flaptastic helps make your unit tests perfect

Hacker News3