Op

Open-source, lightweight tracer for debugging LLMs applications

Hacker News

Open-source, lightweight tracer for debugging LLMs applications

This allows you to set up logging traces with minimal effort on any python codebase and store it into a mongo db database or a local directory. I'm leveraging it mostly for developing on language models, and use the data for a downstream evaluation and debugging. Since I'm didn't want to rely on any of the opinionated frameworks (Langchain with Langsmith, etc), I thought a simpler plug-and-play solution would suffice. I have a lot of features in mind for the roadmap -- let me know if you'd like to add to it and feel free to drop in any suggestions. There is also a quick Streamlit app added to stare at the results; I'm not a Streamlit pro and preemptively apologize for any UI issues.

Share card

Actual performance

4points
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: model, models, code · Missing: mac, agents, macos
77%77% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Hacker NewsStrong engagement from HN community · Strong signals: lua, io · Missing: https docs, excited, just released
66%66% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
Indie HackersIH features products with proven revenue · Missing: supports, reddit linkedin, podcasting
45%45% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
40%40% predicted probability of success on AppSumo, based on ML models trained on real launch data.
TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal
35%35% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
16%16% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Po
Poozle – open-source Plaid for LLMs65%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Poozle – open-source Plaid for LLMs

Hacker News132
Le
Leaping – Open-source debugging with LLMs69%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Leaping – Open-source debugging with LLMs

Hacker News15
Op
Open-source tool for deploying applications to K8s/OpenShift33%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open-source tool for deploying applications to K8s/OpenShift

Hacker News3
Sw
Swiftwave – Simple Lightweight Open Source PaaS80%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Swiftwave – Simple Lightweight Open Source PaaS

Hacker News7
GA
GAI, a Go-idiomatic, lightweight abstraction on top of LLMs52%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

GAI, a Go-idiomatic, lightweight abstraction on top of LLMs

Hacker News2
Gr
Grimoire – A lightweight, open-source WoW addon manager47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Grimoire – A lightweight, open-source WoW addon manager

Hacker News1
Re
Restfox – Open source lightweight alternative to Postman59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Restfox – Open source lightweight alternative to Postman

Hacker News758
Li
Lightweight, open source FlatFile clone56%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Lightweight, open source FlatFile clone

Hacker News2
TinyLens
TinyLens50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Minimalistic, open source analytics for web applications

Indie Hackers1analytics
Te
TensorZero – open-source data and learning flywheel for LLMs70%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

TensorZero – open-source data and learning flywheel for LLMs

Hacker News49