Ex
Example POC to run the Dolly V2 12B model in 8bit mode
Hacker NewsExample POC to run the Dolly V2 12B model in 8bit mode
I banged this out today because nobody seems to have figured this out yet (and I wanted to play with this model). I was inspired by the fact that Simon Willison was struggling to get this running[0], so I wanted to take a crack at it! This is by no means "clean", but it is a baseline for others to hack from. Feel free to send over PRs and I'll land them! (I'd love it somebody used this to glue this into this webui[1].) 0: https://til.simonwillison.net/llms/dolly-2 1: https://github.com/oobabooga/text-generation-webui/
Share cardActual performance
5points
Did not reach leaderboard
Launch Intel predictions
Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: model · Missing: mac, agents, macos81%81% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting71%71% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
Hacker NewsMay not resonate with HN audience · Strong signals: io · Missing: https docs, excited, just released44%44% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal39%39% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive31%31% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue23%23% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.
Correct prediction on native model
Similar products
rq
rqlite v2, SQLite Replication via Hashicorp Raft65%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
rqlite v2, SQLite Replication via Hashicorp Raft
Hacker News11rq
rqlite v2.2.2, replicating SQLite via Raft consensus65%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
rqlite v2.2.2, replicating SQLite via Raft consensus
Hacker News66HO
HOWL, a formant synthesizer (v2.0)41%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
HOWL, a formant synthesizer (v2.0)
Hacker News2Le
LeagueSmart v255%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
LeagueSmart v2
Hacker News1Re
Rebalance Calc v241%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
Rebalance Calc v2
Hacker News1Bu
BunnyAPI v241%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
BunnyAPI v2
Hacker News1Co
Codeply v2.141%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
Codeply v2.1
Hacker News4Nu
Nuesbyte v241%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
Nuesbyte v2
Hacker News46Fi
Fingerprintjs v247%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
Fingerprintjs v2
Hacker News1Fi
Firesize v241%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.
Firesize v2
Hacker News1