PromptProof – CI gate for LLM outputs (schema/regex/cost; no API keys)
PromptProof – CI gate for LLM outputs (schema/regex/cost; no API keys)
I built a tiny GitHub Action that fails PRs when LLM output breaks contracts. No live model calls in CI... it runs on recorded fixtures. What it does: Deterministic checks: JSON schema, regex, list/set equality, numeric bounds, file diff Snapshots + regression compare Cost budget gate PR comment + HTML report Try it in a minute: copy the Quick Start, open a PR, see red → fix → green. Links: Marketplace: https://github.com/marketplace/actions/promptproof-eval Demo repo: https://github.com/geminimir/promptproof-demo-project Sample report: https://geminimir.github.io/promptproof-action/reports/befor ... Looking for blunt feedback... Was onboarding smooth? Anything missing you expected? Is the report clear enough to make this a required check?
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Correct prediction on native model
Similar products
Tokentoll, a CI gate for LLM API cost regressions
CI-Wallboard
Integrating Packagr with Gitlab CI
Protecting Your Gitlab CI Piplines
ArchSentry – Deterministic architectural enforcement for CI
A linter for LLM token spend — that gates cost in CI
Redis Keys in RAM :)
Filedge – parse SEC filings for $0.05 via x402, no keys
CrococryptFile 1.2 released – GPG/OpenPGP keys are now supported
Percona Migrator – online MySQL schema migrations in Rails