AI

AI Security Leaderboard – comparing cyber and CBRN safeguards

Hacker News

AI Security Leaderboard – comparing cyber and CBRN safeguards

There's no shortage of leaderboards for model capabilities - but the security of models is becoming increasingly relevant, from the risk of an AI agent processing unsanitized input being hijacked to models being pulled due to cybersecurity jailbreaks. We developed an automated test suite that runs models through 1500 automatically generated jailbreak attempts and measures the number of universal jailbreaks: prompts that elicit compliant, detailed responses to >75% clearly harmful questions within a domain (like offensive cybersecurity). We find a big gap between the most robust models -- Fable 5 and GPT-5.6 Sol -- and other leading frontier models -- Gemini 3.1 Pro and Grok 4.5. This is v1.0 and we plan to update with new attacks and broader datasets in the future; we'd love to hear from HN what would be useful in your work!

Share card

Actual performance

4points
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: agent, model, new · Missing: mac, agents, macos
87%87% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Indie HackersFits the IH revenue-focused audience · Strong signals: gemini · Missing: supports, reddit linkedin, podcasting
81%81% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
AppSumoStrong fit for a featured deal · Missing: plus, platform, intuitive
58%58% predicted probability of success on AppSumo, based on ML models trained on real launch data.
TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal
40%40% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
Hacker NewsMay not resonate with HN audience · Strong signals: io · Missing: https docs, excited, just released
29%29% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
16%16% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
4%4% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Infosectrain
Infosectrain18%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Cyber Security

Indie Hackers
Gecko Security
Gecko Security53%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Your AI Security Engineer

Product Hunt+176Developer Tools
Almanax
Almanax59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Your AI Security Engineer

Product Hunt+157Developer Tools
AI
AI Security Newsletter30%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

AI Security Newsletter

Hacker News1
AI
AI Security Breaches, the problems and it's causes37%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

AI Security Breaches, the problems and it's causes

Hacker News2
AI
AI Security Baseline 1.0 for LLM Apps39%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

AI Security Baseline 1.0 for LLM Apps

Hacker News1
Sprinto's AI Security Questionnaire
Sprinto's AI Security Questionnaire54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

AI that answers Security Questionnaires & RFP like you would

Product Hunt+394SaaS
GrabbrApp
GrabbrApp34%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Simplifying OPSEC in cyber security investigations

Indie Hackers2programming
Cyber Security Jobs
Cyber Security Jobs25%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Latest jobs in Cyber Security and Information Security.

Indie Hackerscommitment-side-project
Mi
Mindgard – Cyber Security Platform for AI46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Mindgard – Cyber Security Platform for AI

Hacker News16