Evals Skills
Evals Skills
Hello HN I'm Rogerio, co-founder of LangWatch This past month we've completely changed the way we onboard new customers now on LangWatch, instead of giving them instructions on how to instrument, cookbooks or UIs to build evals, or docs on how to write Scenario agent simulation tests, we simply give them skills now, or ready to copy-and-paste prompts. This has reduced our onboarding time to only a few minutes, no more postponing evals because other priorities gets in the way. We have now skills for everything for managing your agent lifecycle: "Instrument my agent with open telemetry" "Write evaluations for my agent" "Write scenario tests and a CI pipeline for my agent" "Version my prompts" and even more targeted recipes "Check my agent doesn't give prescriptive advice" "Generate an evaluation dataset from my RAG knowledge base" "Test my CLI is well usable by other AI agents" Check out more on LangWatch Skills directory above and lmk what you think
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
Zine on LLM Evals
Claude Code skills for building LLM evals
We wrote a book on system evals
Htmx Skills
See which skills are fading before it's too late
Mthds – Beyond skills: a typed DSL for executable AI methods
We wrote a book on LLM system evals with a bear and fox
Skills.wtf – Find the Best Alexa Skills
Brag about your skills online
Donate your time/skills for a charitable donation