Finetune Llama-3.1 2x faster in a Colab

Hacker News

Just added Llama-3.1 support! Unsloth https://github.com/unslothai/unsloth makes finetuning Llama, Mistral, Gemma & Phi 2x faster, and use 50 to 70% less VRAM with no accuracy degradation. There's a custom backprop engine which reduces actual FLOPs, and all kernels are written in OpenAI's Triton language to reduce data movement. Also have an 2x faster inference only notebook in a free Colab as well! https://colab.research.google.com/drive/1T-YBVfnphoVc8E2E854...

Visit product View on Hacker NewsJul 23, 2024

Share card

Actual performance

16points

2comments

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Hacker NewsStrong engagement from HN community · Strong signals: llama, io · Missing: https docs, excited, just released

74%74% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

Product HuntOn track for Day 1 leaderboard · Strong signals: google, openai, open · Missing: mac, agents, macos

69%69% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting

62%62% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

TrustMRRFits verified-revenue profile · Strong signals: google · Missing: mobile apps, ios, personal

50%50% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive

50%50% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

17%17% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

2%2% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Llama or Alpaca?78%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Llama or Alpaca?

Hacker News6

Llama 3.2 Interpretability with Sparse Autoencoders74%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Llama 3.2 Interpretability with Sparse Autoencoders

Hacker News579

BaseRT64%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

6.4x faster than llama.cpp, 3.9x faster than MLX

Product Hunt+223Open Source

Finetune Llama-3 2x faster in a Colab notebook78%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Finetune Llama-3 2x faster in a Colab notebook

Hacker News45

Llama 2 Uncensored 70B as API79%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Llama 2 Uncensored 70B as API

Hacker News18

Finetune Llama 3.2 Vision in a Colab75%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Finetune Llama 3.2 Vision in a Colab

Hacker News10

TokenHawk, WebGPU Running LLaMA64%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

TokenHawk, WebGPU Running LLaMA

Hacker News2

Llama Running on a Microcontroller76%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Llama Running on a Microcontroller

Hacker News49

Llama list – todolists are better with a llama companion67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Llama list – todolists are better with a llama companion

Hacker News3

Unsloth – finetune Llama 2x faster 50% less memory on your GPU75%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Unsloth – finetune Llama 2x faster 50% less memory on your GPU

Hacker News3

Browse all products Analyze your launch