ZigFormer – An LLM implemented in pure Zig
ZigFormer – An LLM implemented in pure Zig
Hi everyone, I've made an early version of ZigFormer, a small LLM implemented in Zig with no dependencies on external ML frameworks like PyTorch or JAX. ZigFormer is modelled after a textbook LLM (like GPT-2 from OpenAI) and can be used as a Zig library as well as a standalone application to train a model and chat with it. This was mainly an educational project. I'm sharing it here in case others find it interesting or useful. Link to the project: https://github.com/CogitatorTech/zigformer
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Correct prediction on native model
Similar products
A pure Tcl JPEG decoder
A pure-Ruby implementation of systemd's sd_notify(3)
Pointfree FP-Interpreter with Combinators and Pure Functions
Goredo – redo implementation on pure Go
Rtpstalk – pure Java RTPS implementation
Pure C Implementation of the Chatarjee – Xi Correlation Coefficient
6502 in pure Lua, no dependencies
IRCd in Pure Bash
Go-osc – OSC Packet Implementation for Golang. Implemented in Pure Go
Pure functional lenses in Racket