Standardising 'Unit Tests' for Prompts
Standardising 'Unit Tests' for Prompts
PromptRepository is an open-source framework (Typescript) that illustrates an approach to creating more reliable LLM-based applications through systematic prompt validation, and testing. Key features: - Simple JSON schema for externalized prompts with versioning and parameter validation - Lightweight approach inspired by Anthropic's guidance to "keep it simple" with LLM applications - 'Unit tests for Prompts' inspired by Chris Benson/Practical AI's recommendations from episode 295. - Bundled prompts to generate unit tests and evaluations for new prompts built with the framework. The framework demonstrates a novel approach: bundle tested prompts with a framework that generate code to use the framework. Repo: https://github.com/jonverrier/PromptRespository Take a look.
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Correct prediction on native model
Similar products
Writing unit tests in Golang
Unit tests on autopilot
Dynamically generate self-signed certs for Go unit tests
Writing modern C unit tests with Criterion
Opunit Simple unit tests for servers and containers
Unit Tests for LangChain aps in 3 lines of code
Writing Maintainable Unit Tests Course
Unit tests for data structures
I made a CLI that will use GPT4 to generate unit tests
Flaptastic helps make your unit tests perfect