Na

NanoEuler – GPT-2 scale model in pure C/CUDA from scratch

Hacker News

NanoEuler – GPT-2 scale model in pure C/CUDA from scratch

Hi everyone, I started working on nanoeuler after the ban of anthropic's fable because my ambition and dream is to work in the AI field in anthropic. The two interesting reasons that led me to create nanoeuler were (1) interfacing with llm does not mean understanding how they are composed and (2), working on llm with a very low-level layer to understand the correlation between parameters and data and growth of the model and how the GPU works and how some layers can be optimized. So I started working on it with a research aspect by making nanoeuler grow more and more but doing one step after another starting from Shakespeare.txt and understanding what a text generation model understands at 23 million parameters. For example, nanoeuler at that number had understood that Name: started a line and wrote that line with sense. I wrote everything in CUDA because I wanted to not use any intermediary between the model in training and inference and what it had to do. Then the use of SFT and much more, even if in small ways, were really useful to understand the various step to make an llm like a chatbot.Any feedback, help, or suggestions are absolutely welcome!

Share card

Actual performance

55points
26comments
Made the leaderboard

Launch Intel predictions

Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: model · Missing: mac, agents, macos
93%93% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Indie HackersFits the IH revenue-focused audience · Strong signals: started, para · Missing: supports, reddit linkedin, podcasting
72%72% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
Hacker NewsStrong engagement from HN community · Strong signals: io · Missing: https docs, excited, just released
54%54% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
TrustMRRFits verified-revenue profile · Strong signals: way, para · Missing: mobile apps, ios, personal
52%52% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
25%25% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Strong signals: growth, training · Missing: arr, mrr, revenue
20%20% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Strong signals: chat · Missing: web3, crypto, cryptocurrency
0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

UN
UNet diffusion model in pure CUDA70%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

UNet diffusion model in pure CUDA

Hacker News8
GP
GPT-2 from scratch in PyTorch – Video tutorial38%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

GPT-2 from scratch in PyTorch – Video tutorial

Hacker News1
Bu
Building a GPT from scratch: What I learned and why it mattered67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Building a GPT from scratch: What I learned and why it mattered

Hacker News2
Te
Tensorli - GPT-Like Transformers in Pure NumPy51%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Tensorli - GPT-Like Transformers in Pure NumPy

Hacker News3
I
I wrote a RDBMS (SQLite clone) from scratch in pure Python74%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I wrote a RDBMS (SQLite clone) from scratch in pure Python

Hacker News371
CU
CUDA and cuBLAS matrices in Clojure58%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

CUDA and cuBLAS matrices in Clojure

Hacker News1
Ra
Raytracer with both C++ and CUDA back ends57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Raytracer with both C++ and CUDA back ends

Hacker News5
On
One Billion Rows in CUDA52%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

One Billion Rows in CUDA

Hacker News3
CU
CUDA Fractal Renderer53%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

CUDA Fractal Renderer

Hacker News44
Ne
Nested VMs from Scratch in C66%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Nested VMs from Scratch in C

Hacker News4