Dokimos – LLM evaluation framework for Java
Dokimos – LLM evaluation framework for Java
I'm working on an open-source project dokimos, because every LLM eval framework I found was Python and TypeScript-only, but a lot of companies will be building LLM apps and AI agents with Java. Key features: - JUnit 5 integration for test-driven evals - Works with LangChain4j - Framework-agnostic - Supports custom evaluators and datasets GitHub: https://github.com/dokimos-dev/dokimos Would love contributions or to team up with anyone who has Java experience and wants to work on this together.
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Correct prediction on native model
Similar products
Opik, an open source LLM evaluation framework
seqeval - a Python framework for sequence labeling evaluation
aiide – A pragmatic framework to build LLM Co-pilots
Rues an Expression Evaluation Sidecar
Zeno, an Interactive ML Evaluation Framework
Evaluation Framework for Startups Ecosystem
Faster LLM evaluation with Bayesian optimization
Hallu – a web framework where an LLM hallucinates your app
A Multichannel LLM Chatbot framework in Java
Open Evaluation