Mamba-Chat – A Chat LLM Based on State Space Models

Hacker News

Hey everyone! Many of you might have come across the Mamba paper a few days ago, which introduced an LLM based on a state space model architecture. The Mamba architecture is quite useful as its complexity scales subquadratically with input length and is therefore way more efficient than transformer models: https://github.com/state-spaces/mamba I got really excited about the paper, so I decided to fine-tune the model on a chat dataset. It turns that this actually worked quite well! The model is quite suitable for casual chatting, which honestly surprised me given that it only has 2.8B parameters and the base model was only trained on the Pile. It's quite exciting that we might have a serious candidate for an architecture that could dethrone transformers. You can find both my fine-tuning and inference code here: https://github.com/havenhq/mamba-chat

Visit product View on Hacker NewsDec 7, 2023

Share card

Actual performance

9points

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: model, models, code · Missing: mac, agents, macos

83%83% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Indie HackersFits the IH revenue-focused audience · Strong signals: para · Missing: supports, reddit linkedin, podcasting

75%75% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

Hacker NewsStrong engagement from HN community · Strong signals: excited, ide, io · Missing: https docs, just released, exist

64%64% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

TrustMRRLess likely to generate early MRR · Strong signals: way, para · Missing: mobile apps, ios, personal

45%45% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Strong signals: efficient · Missing: plus, platform, intuitive

36%36% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

15%15% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Strong signals: chat, introduce · Missing: web3, crypto, cryptocurrency

1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Less‑filtered LLM chat and API50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Less‑filtered LLM chat and API

Hacker News1

Last System State Before OOM49%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Last System State Before OOM

Hacker News1

Lepak – Chat with people based on city, county, state, country54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Lepak – Chat with people based on city, county, state, country

Hacker News2

T3 Chat for Image Models32%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

T3 Chat for Image Models

Hacker News1

Switchboard.chat46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Switchboard.chat

Hacker News7

Chat with WebSockets51%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Chat with WebSockets

Hacker News3

Chat Meatspaces46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Chat Meatspaces

Hacker News4

Rtbl – Chat about your interests39%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Rtbl – Chat about your interests

Hacker News1

Chat for Trello53%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Chat for Trello

Hacker News75

Meerkat roulette is chat roulette for Meerkats46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Meerkat roulette is chat roulette for Meerkats

Hacker News3

Browse all products Analyze your launch