YPerf – Monitor LLM Inference API Performance

Hacker News

Our team operates several real-time AI applications, where both latency(TTFT) and throughput(TPS) are critical to most of our users. Unfortunately, nearly all of the major LLM APIs lack consistent stability. To address this, I developed YPerf—a simple webpage designed to monitor the performance of inference APIs. I hope it helps you select better models and discover new trending ones as well. The data is sourced from OpenRouter, an excellent provider that aggregates LLM API services.

Visit product View on Hacker NewsDec 23, 2024

Share card

Actual performance

2points

2comments

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: model, user, new · Missing: mac, agents, macos

90%90% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Hacker NewsStrong engagement from HN community · Strong signals: ide, io · Missing: https docs, excited, just released

57%57% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

TrustMRRFits verified-revenue profile · Strong signals: users · Missing: mobile apps, ios, personal

55%55% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

Indie HackersIH features products with proven revenue · Missing: supports, reddit linkedin, podcasting

48%48% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Strong signals: users · Missing: plus, platform, intuitive

33%33% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

18%18% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

7%7% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

LLM Inference Requirements Profiler59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

LLM Inference Requirements Profiler

Hacker News4

Healthyr - Rails app performance monitor38%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Healthyr - Rails app performance monitor

Hacker News3

LLM Inference Performance Analytic Tool for Moe Models (DeepSeek/etc.)44%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

LLM Inference Performance Analytic Tool for Moe Models (DeepSeek/etc.)

Hacker News1

Mashape Analytics - Visualize, Inspect and Monitor API Performance55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Mashape Analytics - Visualize, Inspect and Monitor API Performance

Hacker News9

Raileo77%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Monitor your website downtime, ssl validity and performance

Indie Hackers5saas

Speeding up LLM inference 2x times (possibly)74%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Speeding up LLM inference 2x times (possibly)

Hacker News419

Open-source AMDGCN kernels for optimizing LLM inference72%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open-source AMDGCN kernels for optimizing LLM inference

Hacker News5

Onera – Private LLM Inference Inside AMD SEV-SNP Enclaves59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Onera – Private LLM Inference Inside AMD SEV-SNP Enclaves

Hacker News1

Monitor website performance, downtime, SSL expiry for FREE51%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Monitor website performance, downtime, SSL expiry for FREE

Hacker News1

BonzAI – self-sovereign, local LLM inference in the browser62%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

BonzAI – self-sovereign, local LLM inference in the browser

Hacker News5

Browse all products Analyze your launch