Okapi – a metrics engine based on open data formats

Hacker News

Hi All I wanted to share an early preview of Okapi an in-memory metrics engine that also integrates with existing datalakes. Modern software systems produce a mammoth amount of telemetry. While we can discuss whether or not this is necessary, we can all agree that it happens. Most metrics engines today use proprietary formats to store data and don’t use disaggregated storage and compute. Okapi changes that by leveraging open data formats and integrating with existing data lakes. This makes it possible to use standard OLAP tools like Snowflake, Databricks, DuckDB or even Jupyter / Polars to run analysis workflows (such as anomaly detection) while avoiding vendor lock-in in two ways - you can bring your own workflows and have a swappable compute engine. Disaggregation also reduces Ops burden of maintaining your own storage and the compute engine can be scaled up and down on demand. Not all data can reside in a data-lake/object store though - this doesn’t work for recent data. To ease realtime queries Okapi first writes all metrics data to an in memory store and reads on recent data are served from this store. Metrics are rolled up as they arrive which helps ease memory pressure. Metrics are held in-memory for a configurable retention period after which it gets shipped out to object storage/datalake (currently only Parquet export is supported). This allows fast reads on recent data while offloading query-processing for older data. On benchmarks queries on in-memory data finish in under a millisecond while having write throughput of ~280k samples per second. On a real deployment, there’d be network delays so YMMV. Okapi it is still early — feedback, critiques, and contributions welcome. Cheers !

Visit product View on Hacker NewsAug 20, 2025

Share card

Actual performance

14points

5comments

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: open · Missing: mac, agents, macos

82%82% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting

73%73% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

Hacker NewsStrong engagement from HN community · Strong signals: exist, existing, ide · Missing: https docs, excited, just released

51%51% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

TrustMRRLess likely to generate early MRR · Strong signals: way · Missing: mobile apps, ios, personal

35%35% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive

25%25% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Strong signals: arr · Missing: mrr, revenue, profit

21%21% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Web-Based Inspectors for Binary Formats54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Web-Based Inspectors for Binary Formats

Hacker News5

A Prometheus exporter that gathers сomprehensive container metrics33%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

A Prometheus exporter that gathers сomprehensive container metrics

Hacker News4

Synmetrix – Open-Source Platform for Data and Metrics Management54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Synmetrix – Open-Source Platform for Data and Metrics Management

Hacker News1

Recursively detects and decodes multiple formats in nested data31%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Recursively detects and decodes multiple formats in nested data

Hacker News2

Dogma: a metalanguage for describing data formats in documentation53%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Dogma: a metalanguage for describing data formats in documentation

Hacker News3

Go-metrics-charts – realtime charting of live go-metrics metrics data50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Go-metrics-charts – realtime charting of live go-metrics metrics data

Hacker News2

Wurfel Engine – isometric game engine with Open world, block based64%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Wurfel Engine – isometric game engine with Open world, block based

Hacker News4

Keep track of Open startups metrics45%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Keep track of Open startups metrics

Hacker News4

Progressive web metrics at your fingertipz45%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Progressive web metrics at your fingertipz

Hacker News1

Qq: like jq, but can transcode between many formats62%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Qq: like jq, but can transcode between many formats

Hacker News115

Browse all products Analyze your launch