Wa

Waffie, an LLM API automated testing tool

Hacker News

Waffie, an LLM API automated testing tool

Hey yall, Very early release but wanted to get the idea out there. Waffie is built for developers looking to operationalize LLM APIs into their solutions. The first thing I'm tackling is automated testing of LLMs in the context of unstructured to structured data interpretation. For example, sentiment analysis. Specify what you want in a YAML file and a test.csv and run waffie against your test cases. Looking to bridge the gaps between software development and machine learning engineering.

Visit product View on Hacker NewsJul 28, 2023

Actual performance

4points

4comments

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: mac, context, apis · Missing: agents, macos, agent

73%73% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Hacker NewsStrong engagement from HN community · Strong signals: ide, io · Missing: https docs, excited, just released

61%61% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

Indie HackersIH features products with proven revenue · Missing: supports, reddit linkedin, podcasting

47%47% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal

30%30% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive

16%16% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

11%11% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Automated API testing with Jenkins46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Automated API testing with Jenkins

Automated API Testing with Jenkins and Assertible46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Automated API Testing with Jenkins and Assertible

Qodex.ai33%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

The First Automated API Testing Agent

Indie Hackerscommitment-full-time

Automated HTML5 Testing33%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Automated HTML5 Testing

Codeless API testing42%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Codeless API testing

HTML5 API for multivariate testing56%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

HTML5 API for multivariate testing

AssureAPI76%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

API testing, guaranteed!

Product Hunt+14

Automated red teaming for your LLM app43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Automated red teaming for your LLM app

EthicalCheck.dev (Automated API Security Testing)49%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

EthicalCheck.dev (Automated API Security Testing)

HeadlessTesting52%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Automated Browser Testing with Puppeteer

Indie Hackers1$200/mob2b

Browse all products Analyze your launch