Launch Intel
Au

Automated red teaming for your LLM app

Hacker News

Automated red teaming for your LLM app

Hi HN, I built this open-source LLM red teaming tool based on my experience scaling LLMs at a big co to millions of users... and seeing all the bad things people did. How it works: - Uses an unaligned model to create toxic inputs - Runs these inputs through your app using different techniques: raw, prompt injection, and a chain-of-thought jailbreak that tries to re-frame the request to trick the LLM. - Probes a bunch of other failure cases (e.g. will your customer support bot recommend a competitor? Does it think it can process a refund when it can't? Will it leak your user's address?) - Built on top of promptfoo, a popular eval tool One interesting thing about my approach is that almost none of the tests are hardcoded. They are all tailored toward the specific purpose of your application, which makes the attacks more potent. Some of these tests reflect fundamental, unsolved issues with LLMs. Other failures can be solved pretty trivially by prompting or safeguards. Most businesses will never ship LLMs without at least being able to quantify these types of risks. So I hope this helps someone out. Happy building!

Visit productView on Hacker NewsJun 13, 2024
Share card

Actual performance

23points
2comments
Made the leaderboard

Launch Intel predictions

Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: model, user, using · Missing: mac, agents, macos
86%86% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting
80%80% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
Hacker NewsMay not resonate with HN audience · Strong signals: io · Missing: https docs, excited, just released
48%48% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
TrustMRRLess likely to generate early MRR · Strong signals: users · Missing: mobile apps, ios, personal
46%46% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Strong signals: users · Missing: plus, platform, intuitive
34%34% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
12%12% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Sc
Scoop – automated carpooling76%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Scoop – automated carpooling

Hacker News6
Au
Automated Raspberry Surveillance with Ansible48%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Automated Raspberry Surveillance with Ansible

Hacker News4
Sn
Snapshotly – Automated DigitalOcean Backups54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Snapshotly – Automated DigitalOcean Backups

Hacker News24
Au
Automated Timelapses of Boston Viewed from Historic Monuments50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Automated Timelapses of Boston Viewed from Historic Monuments

Hacker News3
To
Top Quant/Algotrading Githubs Automated80%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Top Quant/Algotrading Githubs Automated

Hacker News5
Op
OpenAEDMap – Automated External Defibrillators from OpenStreetMap59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

OpenAEDMap – Automated External Defibrillators from OpenStreetMap

Hacker News14
Ex
Expressio – Automated Internationalization50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Expressio – Automated Internationalization

Hacker News2
La
LangevinAI – Automated FP&A for Everyone21%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

LangevinAI – Automated FP&A for Everyone

Hacker News2
St
StealthBox – Dockerized Automated Torrent Seedbox50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

StealthBox – Dockerized Automated Torrent Seedbox

Hacker News4
Nucleo
Nucleo55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Automated cancer diagnostics

Product Hunt+99Pitch NYC
Browse all productsAnalyze your launch