Ollama – Run LLMs on your Mac

Hacker News

Hi HN A few folks and I have been working on this project for a couple weeks now. After previously working on the Docker project for a number of years (both on the container runtime and image registry side), the recent rise in open source language models made us think something similar needed to exist for large language models too. While not exactly the same as running linux containers, running LLMs shares quite a few of the same challenges. There are "base layers" (e.g. models like Llama 2), specific configuration to run correctly (parameters, temperature, context window sizes etc). There's also embeddings that a model can use at runtime to look up data – we don't support this yet but it's something we're looking at doing soon. It's an early project, and there's still lots to do!

Visit product View on Hacker NewsJul 20, 2023

Share card

Actual performance

284points

94comments

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: mac, model, dock · Missing: agents, macos, agent

94%94% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Indie HackersFits the IH revenue-focused audience · Strong signals: para · Missing: supports, reddit linkedin, podcasting

78%78% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

Hacker NewsStrong engagement from HN community · Strong signals: exist, open source, llama · Missing: https docs, excited, just released

75%75% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

TrustMRRLess likely to generate early MRR · Strong signals: para · Missing: mobile apps, ios, personal

41%41% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Strong signals: soon · Missing: plus, platform, intuitive

40%40% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

17%17% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

ThinkR – G1 but in R with Ollama51%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

ThinkR – G1 but in R with Ollama

Hacker News1

Run LLMs on the Browser74%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Run LLMs on the Browser

Hacker News6

MyOllama – Open-Source Mobile Client for Ollama LLMs56%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

MyOllama – Open-Source Mobile Client for Ollama LLMs

Hacker News1

Run LLMs locally with WebGPU55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Run LLMs locally with WebGPU

Hacker News2

GPTCache – Redis for LLMs69%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

GPTCache – Redis for LLMs

Hacker News7

prompttest – pytest for LLMs34%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

prompttest – pytest for LLMs

Hacker News2

Trolling SMS spammers with Ollama50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Trolling SMS spammers with Ollama

Hacker News318

LLM VibeCheck & VibeFlowChat65%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

The mission control for your local Ollama LLMs

Product Hunt+3

Ollama Shell Helper-English to Shell Commands with Local LLMs on Ollama40%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Ollama Shell Helper-English to Shell Commands with Local LLMs on Ollama

Hacker News2

A podcast run by using LLMs56%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

A podcast run by using LLMs

Hacker News1

Browse all products Analyze your launch