A

A GPU/VRAM filter for finding LLMs that will run on your hardware

Hacker News

A GPU/VRAM filter for finding LLMs that will run on your hardware

I kept seeing people ask "Which model i can run on my gpu", "will model X fit on my GPU". Thats why I built a filter on whichllmmodel that lets you search models by what will actually fit on your hardware (8GB, 16GB, 24GB, etc.) at a given quantization level.

Share card

Actual performance

2points
12comments
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: model, models · Missing: mac, agents, macos
85%85% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Hacker NewsStrong engagement from HN community · Strong signals: io · Missing: https docs, excited, just released
72%72% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting
59%59% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal
43%43% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
34%34% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
21%21% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
8%8% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Le
Lemonade: Run LLMs Locally with GPU and NPU Acceleration83%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Lemonade: Run LLMs Locally with GPU and NPU Acceleration

Hacker News15
Fi
Finding puns computationally51%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Finding puns computationally

Hacker News24
Fi
Finding Interesting Publications on PubMed44%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Finding Interesting Publications on PubMed

Hacker News2
A
A picker that maps local LLMs to hardware, hardware to LLMs67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

A picker that maps local LLMs to hardware, hardware to LLMs

Hacker News3
Ca
Can your GPU run this LLM?60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Can your GPU run this LLM?

Hacker News15
Ru
Run LLMs on the Browser74%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Run LLMs on the Browser

Hacker News6
I
I made SOL75 – a compiler for hardware59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I made SOL75 – a compiler for hardware

Hacker News1
Mi
Microcontroller with hardware-accelerated Lua VM72%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Microcontroller with hardware-accelerated Lua VM

Hacker News8
ProjectHunt
ProjectHunt37%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

IoT, Hardware

Indie Hackerscommitment-side-project
In
Intentionally subtle headphone crossfeed filter48%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Intentionally subtle headphone crossfeed filter

Hacker News51