Running Gemma-4 26B at 124 tokens/SEC on a CPU, no GPU

Hacker News

I wanted to know how fast a 26B mixture-of-experts model could run on a desktop CPU with no GPU. Got ~40 tok/s single-stream (lossless) and ~124 batched. The surprising part was the byte budget: for this model you compress the output head (32% of per-token bytes), not the experts (16%). The writeup has the bandwidth roofline and the dead-ends; the repo has the reproducible recipe. Happy to answer questions. Repo: https://github.com/arun-prasath2005/gemma4-cpu-moe

Visit product View on Hacker NewsJun 30, 2026

Share card

Actual performance

10points

1comments

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting

66%66% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Hacker NewsStrong engagement from HN community · Strong signals: io · Missing: https docs, excited, just released

60%60% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

Product HuntOn track for Day 1 leaderboard · Strong signals: model, single · Missing: mac, agents, macos

52%52% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

TrustMRRFits verified-revenue profile · Missing: mobile apps, ios, personal

51%51% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive

25%25% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

16%16% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

8%8% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Metaballs Implementation in the CPU and GPU58%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Metaballs Implementation in the CPU and GPU

Hacker News2

wc-GPU: The Unix util `wc` running on a GPU66%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

wc-GPU: The Unix util `wc` running on a GPU

Hacker News15

Checkpoint K8s pods transparently (plain CPU or GPU accelerated) [video]56%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Checkpoint K8s pods transparently (plain CPU or GPU accelerated) [video]

Hacker News2

Bottleneck Calculator44%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Find out if your CPU or GPU is holding your PC back

Indie Hackers1games

Harvard CPU in Verilog and Assembler in Go54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Harvard CPU in Verilog and Assembler in Go

Hacker News4

H2 Forth CPU58%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

H2 Forth CPU

Hacker News120

CPU Ranker38%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

CPU Databse, CPU, Processors, Mobile CPU, CPU List

Product Hunt+4

Tilery-VM – run Nvidia cuTile GPU kernels on a CPU, no GPU required60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Tilery-VM – run Nvidia cuTile GPU kernels on a CPU, no GPU required

Hacker News4

Video about the CPU vulnerability Zenbleed (CVE-2023-20593)50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Video about the CPU vulnerability Zenbleed (CVE-2023-20593)

Hacker News4

Online CPU profiler for Golang59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Online CPU profiler for Golang

Hacker News1

Browse all products Analyze your launch