Bonsai – A Competitive Ternary Weight LLM
Bonsai – A Competitive Ternary Weight LLM
Introducing Bonsai 0.5B, one of the first ternary-weight LLMs to rival full-precision models of similar size, such as Qwen 2.5 0.5B and MobileLLM 0.5B. Trained on just 3.8B tokens, using 1,000x less data than other models, Bonsai redefines what’s possible for ultra-efficient training in low-bit models. Next, we're building larger and more powerful ternary-weight models for the edge. Technical Report: https://github.com/deepgrove-ai/Bonsai/blob/main/paper/Bonsa... Model (Unpacked): https://huggingface.co/deepgrove/Bonsai Reach us: team@deepgrove.ai
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
When Will I Weigh? Weight Trajectory
A1161 - Competitive Writing
Competitive Analysis and LLMO
Redis-LLM – Redis module integrates LLM with Redis
LitLLM the Spiciest LLM Wrapper
LLM Reasonsers
Resilient LLM
Hegelion – Force your LLM to argue with itself before answering
I Stopped Hoping My LLM Would Cooperate