Open-source fine-tuning in a Colab notebook
Open-source fine-tuning in a Colab notebook
Posted before, but wanted to share if you want an open source alternative to OpenAI fine-tuning, give Unsloth a try! Phi 3.5 was just released, and is distilled from GPT4. Unsloth makes finetuning 2x faster, uses 70% less VRAM + has no accuracy degradations. We rewrite all backprop steps and reduce FLOPs and write everything in Triton (JIT low level CUDA). If you want to own the weights after fine-tuning, give Unsloth a spin! I have free Colabs and Kaggle notebooks as well at https://github.com/unslothai/unsloth
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
Open Source Reinforcement Fine-Tuning for Your Agents
GPT Fine-Tuning Notebook Boosts Classification Accuracy from 69% to 94%
Fine tuning and RLHF mistralai 7B using DeepSpeed
Courtyard – Open-source macOS app for local MLX fine-tuning Text
ShadowPEFT – Centralized and Detachable Parameter-Efficient Fine-Tuning
Terracotta – Platform for fine-tuning and evaluating LLMs
Fine-Tuning Index of Open-Source LLMs vs. OpenAI
Haven (YC S23) – Quickly iterate when fine-tuning open-source LLMs
LLM reinforcement fine-tuning platform to improve LLM output
Quaterion – x100 faster fine-tuning of similarity learning models