Op

Open-source LLM playground for VS Code

Hacker News

Open-source LLM playground for VS Code

Hey HN! We made a VS Code extension that allows developers to play with their prompts right in their editor. It uses Oxc and RustPython to parse and detect the prompts in the source code. Devs can test their prompts against different models and/or variables (models*data matrix). With a CSV dataset, one can test their prompt changes against multiple rows and verify whether the change is good or not. Automated evals are coming soonish. The request/response JSONs are available to inspect, as well as usage stats with projected cost. The extension supports hundreds of models thanks to the Vercel Gateway. If you need more provider options (planned but not priority), please let me know. Users without keys will get their requests served by LM Studio running on my PC. Please don't crash my workstation! It only supports JS/TS and Python for now, but many more languages are coming. Compiling tree-sitter crates to Wasm is PITA, but I'm getting there. I also work on improving the heuristics so prompt strings can be detected from arrays or when passed as arguments to popular LLM APIs. Now you can use "prompt" in the variable name or put a comment with "@prompt" in front of it.

Share card

Actual performance

2points
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Indie HackersFits the IH revenue-focused audience · Strong signals: supports · Missing: reddit linkedin, podcasting, created
85%85% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Product HuntOn track for Day 1 leaderboard · Strong signals: model, user, models · Missing: mac, agents, macos
82%82% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
TrustMRRFits verified-revenue profile · Strong signals: users, way · Missing: mobile apps, ios, personal
51%51% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
Hacker NewsMay not resonate with HN audience · Strong signals: ide, io · Missing: https docs, excited, just released
49%49% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
AppSumoMay struggle as an AppSumo deal · Strong signals: soon, users · Missing: plus, platform, intuitive
26%26% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Strong signals: arr · Missing: mrr, revenue, profit
15%15% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

An
An open-source registry for VS Code extensions62%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

An open-source registry for VS Code extensions

Hacker News2
VS
VSConnect, an open source network client for VS Code60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

VSConnect, an open source network client for VS Code

Hacker News1
Pr
PromptFiddle – Open-source WASM-based LLM playground76%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

PromptFiddle – Open-source WASM-based LLM playground

Hacker News2
Co
CodeSwing – A CodePen-like interactive playground, built into VS Code62%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

CodeSwing – A CodePen-like interactive playground, built into VS Code

Hacker News159
Th
Thufir – An open-source AI VS Code extension for SREs50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Thufir – An open-source AI VS Code extension for SREs

Hacker News1
Bu
Build your own Vim emulation for VS Code48%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Build your own Vim emulation for VS Code

Hacker News88
Se
Seconds to in-cluster microservices mocks in VS Code51%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Seconds to in-cluster microservices mocks in VS Code

Hacker News9
So
Sourcegraph Code Search for VS Code46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Sourcegraph Code Search for VS Code

Hacker News12
I
I am fixing VS Code search50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I am fixing VS Code search

Hacker News3
Ve
Verilog HDL support for VS Code40%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Verilog HDL support for VS Code

Hacker News3