High-performance GenAI engine now open source

Hacker News

Hey HN After one too many customer firedrills regarding hallucinating or insecure AI models, we built a system to catch these issues before they reached production. The Arthur Engine has been running in Fortune 100 to AI Native Start-Ups over the past two years, putting security controls around more than 10 billion tokens in production every month. We're now opening up this service to developers, enabling you to leverage enterprise-grade solutions to provide guardrails and evals as a service, all for free. Get it on Github ( https://github.com/arthur-ai/arthur-engine ) to start evaluating your models today Highlights of Arthur's Engine include: * Built for speed and scale: It performs well with p90 latencies of sub-second well over 100+ RPS * Made for full lifecycle support: Ideal for pre-production validation, real-time guardrails, and post-production monitoring. * Ease of use: It is designed to be easy for anyone to run and deploy whether you're working on it locally during development, or you're deploying it within a horizontally-scaling architecture for large-scale workloads. * Unification of generative and traditional AI: The Arthur AI Engine can be used to evaluate a diverse range of models from LLMs and Agentic AI systems to binary classifiers, regression models, recommender systems, forecasting models, and more. * Content-specific guardrail and detection features: Ranging from toxicity and hallucination detection to sensitive data (like PII, keyword/regex and custom rules) and prompt injection. * Customizability: Plug in your own models or integrate with other model or guardrail providers with ease, and tailor the system to match your specific needs. Having been first-hand witnesses to the lack of adequate AI monitoring tools and the general under delivery of Gen AI systems in production, we believe that such a capability shouldn't be exclusive to big-budget organizations. Our mission is to make AI better, for everyone, and we believe by opening up this tool we can help more people get to that goal. Check out our GitHub repo for examples and directions on how to use the Arthur AI Engine for various purposes such as validation during development, real-time guardrails or performance troubleshooting using enriched logging data. ( https://github.com/arthur-ai/engine-examples ) We can’t wait to see what you build — Zach and Team Arthur

Visit product View on Hacker NewsApr 24, 2025

Share card

Actual performance

22points

12comments

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Indie HackersFits the IH revenue-focused audience · Strong signals: organizations · Missing: supports, reddit linkedin, podcasting

93%93% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Product HuntOn track for Day 1 leaderboard · Strong signals: agent, model, agentic · Missing: mac, agents, macos

90%90% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

TrustMRRFits verified-revenue profile · Strong signals: month · Missing: mobile apps, ios, personal

52%52% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

Hacker NewsMay not resonate with HN audience · Strong signals: lua, open source, ide · Missing: https docs, excited, just released

49%49% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

AppSumoMay struggle as an AppSumo deal · Strong signals: exclusive · Missing: plus, platform, intuitive

42%42% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

22%22% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Perspective – high performance pivoting engine in WebAssembly77%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Perspective – high performance pivoting engine in WebAssembly

Hacker News10

Apache ResilientDB, High-Performance Open-Source Blockchain64%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Apache ResilientDB, High-Performance Open-Source Blockchain

Hacker News16

Ngx_waf – Open source, Handy, High performance Nginx firewall module68%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Ngx_waf – Open source, Handy, High performance Nginx firewall module

Hacker News31

Open-source, high performance layout parsing for LLM's67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open-source, high performance layout parsing for LLM's

Hacker News13

TruffleRuby – A high performance implementation of Ruby56%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

TruffleRuby – A high performance implementation of Ruby

Hacker News1

MyPerf4J – High Performance Java APM54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

MyPerf4J – High Performance Java APM

Hacker News1

M3 – A high performance WebAssembly interpreter in C77%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

M3 – A high performance WebAssembly interpreter in C

Hacker News14

Kvrocks – High Performance SSD Redis which supports replication and HA60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Kvrocks – High Performance SSD Redis which supports replication and HA

Hacker News6

High performance JA3 and HTTP2 fingerprint for Nginx78%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

High performance JA3 and HTTP2 fingerprint for Nginx

Hacker News2

AmisaDB – Free DBMS for High Performance OLTP and OLAP Workloads63%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

AmisaDB – Free DBMS for High Performance OLTP and OLAP Workloads

Hacker News4

Browse all products Analyze your launch