I

I built a lite LPU that can do inference on Karpathy's MicroGPT

Hacker News

I built a lite LPU that can do inference on Karpathy's MicroGPT

We had no guide or course that teaches chip design at our university. We had taken a digital logic course, but were disappointed with the fact that the most complex project we did was building a full adder in Quartus using logic blocks, not even in RTL!5 Therefore, we decided to challenge ourselves to dive deep into machine learning (ML) hardware and learn as much as we could on our own. We wanted to prove that basic math (like y = mx + b) and basic logic circuits are enough to help anyone understand how modern AI hardware works. Our goal was to design our own version of the LPU from scratch and run a simple Transformer-style model on it, proving that with minimal Machine Learning and computer design knowledge, it’s totally possible. We were also driven by a simple question: What makes the LPU architecture so compelling that even Nvidia licensed it? Keep in mind, this article is not intended to serve as a tutorial for “how to build an LPU from scratch,” and our architecture is not a 1:1 LPU. It serves as an educational resource for how someone with minimal hardware experience can approach this field, and our journey in building what we think an LPU would look like.

Share card

Actual performance

18points
3comments
Made the leaderboard

Launch Intel predictions

Analyze your own launch →
Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting
74%74% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Product HuntOn track for Day 1 leaderboard · Strong signals: mac, model, computer · Missing: agents, macos, agent
72%72% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
Hacker NewsStrong engagement from HN community · Strong signals: ide, io · Missing: https docs, excited, just released
62%62% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
TrustMRRLess likely to generate early MRR · Strong signals: education · Missing: mobile apps, ios, personal
45%45% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
42%42% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
17%17% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

NP
NPR Lite43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

NPR Lite

Hacker News2
Du
DuckDuckGo Lite43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

DuckDuckGo Lite

Hacker News3
Ez
EzInvoice Lite43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

EzInvoice Lite

Hacker News4
Ez
EzInvoice Lite43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

EzInvoice Lite

Hacker News2
TQNN
TQNN55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Fault-tolerant inference for noisy and imperfect data.

Indie Hackers1ai
Ja
Javosize Lite the java troubleshooting tool36%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Javosize Lite the java troubleshooting tool

Hacker News1
We
We just launched MegaAI. It's a 4k30fps, 4W, 4TOPS inference powerhouse69%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

We just launched MegaAI. It's a 4k30fps, 4W, 4TOPS inference powerhouse

Hacker News3
Yi
YieldOS-Lite – A simulator for LLM inference control-plane governance38%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

YieldOS-Lite – A simulator for LLM inference control-plane governance

Hacker News2
Te
Team Pads in Etherpad Lite50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Team Pads in Etherpad Lite

Hacker News1
LL
LLM Inference Requirements Profiler59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

LLM Inference Requirements Profiler

Hacker News4