macOS GUI for running LLMs locally

Hacker News

Hello HN, I've been working on this project for a while, and it has been in an "open" beta for some time. I finally believe it's ready for its first release. I hope you like it. Here are some potential questions that may arise: 1. How does it compare to LM Studio? It's likely that if you're already using LM Studio, you'll continue to do so. This project is designed to be more user-friendly. 2. Is it open-source? No, it is not. 3. Does it use any open-source libraries? Yes, it uses llama.cpp and a few others, as indicated in the license information included with the application. 4. Why is not using electronjs? Two reasons, I wanted total control over the whole tech-stack and second, I wanted to be able to send this to my friends over iMessage. 5. Does it support Intel macs? It should, but I couldn't test it. 6. Does it support older macOS? 12.6 is the lowest version at the moment. 7. Is XXX a bug? Probably :)

Visit product View on Hacker NewsSep 18, 2023

Share card

Actual performance

58points

47comments

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: mac, macos, user · Missing: agents, agent, cursor

95%95% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting

74%74% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

Hacker NewsStrong engagement from HN community · Strong signals: llama, io · Missing: https docs, excited, just released

68%68% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal

38%38% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Strong signals: friendly · Missing: plus, platform, intuitive

35%35% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

11%11% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Running LLMs on CPUs55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Running LLMs on CPUs

Hacker News1

VRAMGlass46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Find the right GPU for running LLMs locally

Product Hunt+1

a MacOS GUI app under 700KB44%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

a MacOS GUI app under 700KB

Hacker News1

All-in-one desktop app for running LLMs locally65%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

All-in-one desktop app for running LLMs locally

Hacker News1

Run LLMs locally with WebGPU55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Run LLMs locally with WebGPU

Hacker News2

Medis 2 – A modern Redis GUI for macOS63%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Medis 2 – A modern Redis GUI for macOS

Hacker News3

Rsync GUI54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Rsync GUI

Hacker News1

RDBTools, GUI for redis61%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

RDBTools, GUI for redis

Hacker News1

Fail2web, a fail2ban GUI54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Fail2web, a fail2ban GUI

Hacker News48

GUI configuration for Xrdp – XRDPConfigurator55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

GUI configuration for Xrdp – XRDPConfigurator

Hacker News3

Browse all products Analyze your launch