Mi

Mistral NeMo finetuning fits in Colab

Hacker News

Mistral NeMo finetuning fits in Colab

Managed to make Mistral NeMO 12b https://mistral.ai/news/mistral-nemo/ fit in a free Google Colab with a Tesla T4 GPU (16GB) for 4bit QLoRA finetuning! Managed to shave 60% VRAM usage and made it 2x faster as well! It should work in under 12GB of VRAM as well!

Share card

Actual performance

4points
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Hacker NewsStrong engagement from HN community · Missing: https docs, excited, just released
62%62% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
Product HuntOn track for Day 1 leaderboard · Strong signals: google, new · Missing: mac, agents, macos
61%61% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
TrustMRRFits verified-revenue profile · Strong signals: google · Missing: mobile apps, ios, personal
53%53% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
Indie HackersIH features products with proven revenue · Missing: supports, reddit linkedin, podcasting
43%43% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
41%41% predicted probability of success on BetaList, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
28%28% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
24%24% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Se
SectorLISP now fits in one sector52%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

SectorLISP now fits in one sector

Hacker News323
POPKIT
POPKIT49%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Find the AI that fits your work.

Indie Hackerscommitment-side-project
Malabis
Malabis47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Fashion that Fits you

Indie Hackerscommitment-side-project
itminan
itminan66%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Finds the dua from the Sunnah that fits your situation

Indie Hackers1$4/moeducation
DayWaka
DayWaka43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Find work that fits your life

Product Hunt+6
Propfundsy
Propfundsy20%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Find the prop firm that actually fits your trading.

Indie Hackers1finance
Jo
Jobs that fits you(Job Seeker)54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Jobs that fits you(Job Seeker)

Hacker News2
Jo
Jobs that fits you(Job Seeker)54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Jobs that fits you(Job Seeker)

Hacker News1
En
EnfinBref- {GPT3-5|Mistral-7B} YouTube summaries, segment by segment46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

EnfinBref- {GPT3-5|Mistral-7B} YouTube summaries, segment by segment

Hacker News26
Ki
Kinky story generator (powered by Mistral)42%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Kinky story generator (powered by Mistral)

Hacker News1