Op

Open-source fine-tuning in a Colab notebook

Hacker News

Open-source fine-tuning in a Colab notebook

Posted before, but wanted to share if you want an open source alternative to OpenAI fine-tuning, give Unsloth a try! Phi 3.5 was just released, and is distilled from GPT4. Unsloth makes finetuning 2x faster, uses 70% less VRAM + has no accuracy degradations. We rewrite all backprop steps and reduce FLOPs and write everything in Triton (JIT low level CUDA). If you want to own the weights after fine-tuning, give Unsloth a spin! I have free Colabs and Kaggle notebooks as well at https://github.com/unslothai/unsloth

Share card

Actual performance

5points
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Hacker NewsStrong engagement from HN community · Strong signals: just released, open source, io · Missing: https docs, excited, exist
79%79% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
Product HuntOn track for Day 1 leaderboard · Strong signals: openai, open · Missing: mac, agents, macos
76%76% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting
61%61% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal
38%38% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
31%31% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
13%13% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
2%2% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Op
Open Source Reinforcement Fine-Tuning for Your Agents49%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open Source Reinforcement Fine-Tuning for Your Agents

Hacker News5
GP
GPT Fine-Tuning Notebook Boosts Classification Accuracy from 69% to 94%39%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

GPT Fine-Tuning Notebook Boosts Classification Accuracy from 69% to 94%

Hacker News1
Fi
Fine tuning and RLHF mistralai 7B using DeepSpeed38%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Fine tuning and RLHF mistralai 7B using DeepSpeed

Hacker News1
Co
Courtyard – Open-source macOS app for local MLX fine-tuning Text52%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Courtyard – Open-source macOS app for local MLX fine-tuning Text

Hacker News1
Sh
ShadowPEFT – Centralized and Detachable Parameter-Efficient Fine-Tuning44%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

ShadowPEFT – Centralized and Detachable Parameter-Efficient Fine-Tuning

Hacker News6
Te
Terracotta – Platform for fine-tuning and evaluating LLMs40%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Terracotta – Platform for fine-tuning and evaluating LLMs

Hacker News1
Fi
Fine-Tuning Index of Open-Source LLMs vs. OpenAI58%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Fine-Tuning Index of Open-Source LLMs vs. OpenAI

Hacker News4
Ha
Haven (YC S23) – Quickly iterate when fine-tuning open-source LLMs72%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Haven (YC S23) – Quickly iterate when fine-tuning open-source LLMs

Hacker News13
Predibase Reinforcement Fine-Tuning
Predibase Reinforcement Fine-Tuning60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

LLM reinforcement fine-tuning platform to improve LLM output

Product Hunt+172SaaS
Qu
Quaterion – x100 faster fine-tuning of similarity learning models49%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Quaterion – x100 faster fine-tuning of similarity learning models

Hacker News19