Zi

ZigFormer – An LLM implemented in pure Zig

Hacker News

ZigFormer – An LLM implemented in pure Zig

Hi everyone, I've made an early version of ZigFormer, a small LLM implemented in Zig with no dependencies on external ML frameworks like PyTorch or JAX. ZigFormer is modelled after a textbook LLM (like GPT-2 from OpenAI) and can be used as a Zig library as well as a standalone application to train a model and chat with it. This was mainly an educational project. I'm sharing it here in case others find it interesting or useful. Link to the project: https://github.com/CogitatorTech/zigformer

Share card

Actual performance

22points
4comments
Made the leaderboard

Launch Intel predictions

Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: model, openai, open · Missing: mac, agents, macos
62%62% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
Hacker NewsStrong engagement from HN community · Strong signals: io · Missing: https docs, excited, just released
58%58% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
AppSumoStrong fit for a featured deal · Missing: plus, platform, intuitive
53%53% predicted probability of success on AppSumo, based on ML models trained on real launch data.
TrustMRRLess likely to generate early MRR · Strong signals: education · Missing: mobile apps, ios, personal
50%50% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
Indie HackersIH features products with proven revenue · Missing: supports, reddit linkedin, podcasting
27%27% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
10%10% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Strong signals: chat · Missing: web3, crypto, cryptocurrency
2%2% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

A
A pure Tcl JPEG decoder50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

A pure Tcl JPEG decoder

Hacker News3
A
A pure-Ruby implementation of systemd's sd_notify(3)43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

A pure-Ruby implementation of systemd's sd_notify(3)

Hacker News1
Po
Pointfree FP-Interpreter with Combinators and Pure Functions57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Pointfree FP-Interpreter with Combinators and Pure Functions

Hacker News1
Go
Goredo – redo implementation on pure Go47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Goredo – redo implementation on pure Go

Hacker News2
Rt
Rtpstalk – pure Java RTPS implementation55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Rtpstalk – pure Java RTPS implementation

Hacker News13
Pu
Pure C Implementation of the Chatarjee – Xi Correlation Coefficient63%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Pure C Implementation of the Chatarjee – Xi Correlation Coefficient

Hacker News2
65
6502 in pure Lua, no dependencies77%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

6502 in pure Lua, no dependencies

Hacker News5
IR
IRCd in Pure Bash73%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

IRCd in Pure Bash

Hacker News6
Go
Go-osc – OSC Packet Implementation for Golang. Implemented in Pure Go47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Go-osc – OSC Packet Implementation for Golang. Implemented in Pure Go

Hacker News4
Pu
Pure functional lenses in Racket53%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Pure functional lenses in Racket

Hacker News2