LL

LLMem, a read through cache for OpenAI chat completions

Hacker News

LLMem, a read through cache for OpenAI chat completions

When building a system around OAI, I found myself sending the same request multiple times as part of developing/testing some other part of the system. On top of wasting money in this way, I was also throwing away potentially useful later training data to specialize a smaller LLM for my use case. I’m hosting an open server atm since I hit it from various different networks for my projects, or you easily enough run it as a local service.

Share card

Actual performance

1points
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting
80%80% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Product HuntOn track for Day 1 leaderboard · Strong signals: openai, open · Missing: mac, agents, macos
68%68% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
Hacker NewsStrong engagement from HN community · Strong signals: io · Missing: https docs, excited, just released
54%54% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
TrustMRRFits verified-revenue profile · Strong signals: way · Missing: mobile apps, ios, personal
52%52% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Strong signals: host · Missing: plus, platform, intuitive
23%23% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Strong signals: training · Missing: arr, mrr, revenue
18%18% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Strong signals: chat · Missing: web3, crypto, cryptocurrency
2%2% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

I
I made an OpenAI-powered tamagotchi that reacts to what you read online51%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I made an OpenAI-powered tamagotchi that reacts to what you read online

Hacker News5
Ca
Cataloging the NYRB and LRB with OpenAI Embeddings46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Cataloging the NYRB and LRB with OpenAI Embeddings

Hacker News3
An
Analyzing a snapshot isolation read anomaly27%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Analyzing a snapshot isolation read anomaly

Hacker News6
Sh
Shit I Read54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Shit I Read

Hacker News3
Re
Read less, do more with SummarizeBot47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Read less, do more with SummarizeBot

Hacker News2
Re
Read less and do more with SummarizeBot47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Read less and do more with SummarizeBot

Hacker News2
Re
Read-Only PasteBin35%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Read-Only PasteBin

Hacker News1
I
I ported danmaz74 "HN: Mark All Read" to Firefox38%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I ported danmaz74 "HN: Mark All Read" to Firefox

Hacker News1
Sh
Show HN : Figure out how much more you have to read63%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Show HN : Figure out how much more you have to read

Hacker News1
UR
URLTodo – The treatment for "Read It Never" syndrome47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

URLTodo – The treatment for "Read It Never" syndrome

Hacker News2