Train Your Own Language Model on Your Favourite Programming Language
Train Your Own Language Model on Your Favourite Programming Language
In the context of the Deep Learning class at Tsinghua University, my teammates and I have trained our own (tiny) LLM on Go code using the `go/scanner` tokens as the tokenizer! If you're ever looking to train a single-GPU Language Model over the weekend on your favorite Programming Language, feel free to use our code and VSCode Extension.
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
Tetris implemented in Zig programming language
Tuppence Programming Language for 2-adic arithmetic
Octaspire Dern – Programming language
FizzBuzz in an esoteric programming language.
Mint Programming Language
M# Programming Language
J4 – A programming language implemented in C
Jolie – The First Programming Language for Microservices
Vivaldi programming language
I made a (terrible) programming language