LLM Sanity Checks – A practical guide to not over-engineering AI
LLM Sanity Checks – A practical guide to not over-engineering AI
I keep seeing teams use frontier models for tasks a regex or a 4B model could do cheaper and faster. This repo is a collection of opinionated patterns and heuristics to help you rethink the architecture of your AI workflows and ease the decision-making process while ensuring maximum efficiency. It covers: - A decision tree for architectural sanity checks. - Tradeoffs between JSON and delimiter-separated output. - Patterns for cascading models (verifying small models before calling big ones). Open to feedback on other anti-patterns you've seen in production.
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Correct prediction on native model
Similar products
A practical guide to well-being for singles
I Boiled a Decade of Debugging into a Practical Guide
Practical platform engineering guide for senior engineers
Fundamental Engineering Principles Guide
A practical operating guide for turning an LLM into a real t
Someone always checks in
a practical Lisp in C
a practical introduction to Kryptos K1-K3 brute-force decryption
Speck, a WebGL molecule renderer for attractive and practical figures
Software Engineering Handbook – A Guide to Engineering, Life, and More