Llm.report – Open-source logging and analytics for OpenAI

Hacker News

Hi hacker news, My name is Dillion and I'm the creator of llm.report. A few months ago, I was frustrated by the lack of observability into the OpenAI API. All of us are left in the dark about API performance, latency, cost calculation, cost breakdown, and more. I just wanted to know more about how my AI app is performing in production and make data-driven decisions to improve the product. So I ended up just building it myself. There are three parts to the platform: 1. OpenAI API Dashboard (no-code) - Enter your OpenAI key and get access to detailed insights straight from the OpenAI API itself 2. Logging - Log all your requests / responses to OpenAI to analyze cost, latency, token usage and more 3. User Metrics - Calculate your cost per user to figure out who your power users are, and how much they cost you per day Would appreciate any feedback you have! Would you use something like this? Why or why not?

Visit product View on Hacker NewsAug 16, 2023

Share card

Actual performance

6points

3comments

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: user, new, openai · Missing: mac, agents, macos

95%95% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting

84%84% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

Hacker NewsStrong engagement from HN community · Strong signals: hacker news, io · Missing: https docs, excited, just released

57%57% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

TrustMRRFits verified-revenue profile · Strong signals: month, users · Missing: mobile apps, ios, personal

55%55% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Strong signals: platform, users · Missing: plus, intuitive, reviews

31%31% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

19%19% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

LLM Logger – open-source logging for LLM calls45%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

LLM Logger – open-source logging for LLM calls

Hacker News2

Whoops, an open source tool for logging anything60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Whoops, an open source tool for logging anything

Hacker News1

Langfuse – Open-source observability and analytics for LLM apps76%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Langfuse – Open-source observability and analytics for LLM apps

Hacker News143

An open-source API built on top of OpenAI Embeddings and Pinecone79%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

An open-source API built on top of OpenAI Embeddings and Pinecone

Hacker News5

Pirsch Analytics - Open-source analytics for developers69%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Pirsch Analytics - Open-source analytics for developers

Hacker News4

Open-Source Library OpenAI/Azure Fallback Tool47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open-Source Library OpenAI/Azure Fallback Tool

Hacker News4

Nginx logging to ZeroMQ74%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Nginx logging to ZeroMQ

Hacker News6

Comet LLM - Open-source prompt management and analytics52%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Comet LLM - Open-source prompt management and analytics

Hacker News19

Trench – Open-source analytics infrastructure72%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Trench – Open-source analytics infrastructure

Hacker News155

Trench79%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open source analytics infrastructure

Product Hunt+281Developer Tools

Browse all products Analyze your launch