A
A Small BitNet GPT in MLX
Hacker NewsA Small BitNet GPT in MLX
For those of us nerds who like to tinker with language models, I thought of sharing an example ipynb that shows how to build a small gpt (kudos to @karpathy for teaching us minGPT) where you replace the nn.Linear layer with a BitLinear layers as introduced in the paper on 1.58 bit LLMs https://arxiv.org/abs/2402.17764
Share cardActual performance
4points
Did not reach leaderboard
Launch Intel predictions
Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: model, models · Missing: mac, agents, macos84%84% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Hacker NewsStrong engagement from HN community · Missing: https docs, excited, just released56%56% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
AppSumoStrong fit for a featured deal · Missing: plus, platform, intuitive52%52% predicted probability of success on AppSumo, based on ML models trained on real launch data.
TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal44%44% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
Indie HackersIH features products with proven revenue · Missing: supports, reddit linkedin, podcasting38%38% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue20%20% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Strong signals: introduce · Missing: web3, chat, crypto10%10% predicted probability of success on BetaList, based on ML models trained on real launch data.
Incorrect prediction on native model
Similar products
Sh
Shit, TinyGo Crazy Small WASM Binaries. Hack Go and WASM37%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
Shit, TinyGo Crazy Small WASM Binaries. Hack Go and WASM
Hacker News6Sm
Small Clojure Interpreter61%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
Small Clojure Interpreter
Hacker News143Ch
Chibicc – A Small C Compiler56%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
Chibicc – A Small C Compiler
Hacker News22Sh
Show HN - small lib for "fluentifying" HTMLElements34%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
Show HN - small lib for "fluentifying" HTMLElements
Hacker News1sm
small lisp interpreter in Haskell79%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
small lisp interpreter in Haskell
Hacker News25A
A small embeddable and hackable Lisp-2 interpreter in C68%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
A small embeddable and hackable Lisp-2 interpreter in C
Hacker News2Ze
Zerobox – a small lightbox44%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
Zerobox – a small lightbox
Hacker News42LeanBill18%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
FinOps for small clouds
Indie Hackerscommitment-side-projectWo
Worldbuilding Experiments with GPT-336%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
Worldbuilding Experiments with GPT-3
Hacker News2Au
Autosummarized HN (With GPT-3)51%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
Autosummarized HN (With GPT-3)
Hacker News6