Benchmax, a new open-source RL environment framework for LLM finetuning

Hacker News

Hello HN! I’ve been working on `benchmax`, a open-source framework for building, running, and parallelizing environments, to fine-tune LLMs with reinforcement learning. What I wanted to solve for: - Environments are tightly coupled with RL trainers, leading to fragmentation and limited compatibility. - These coupled environments are tend to be mostly competitive math and coding → for OSS RL + LLMs to scale, we need more complex, real-world environments. - Scaling these environments in parallel is still not easily possible What I'm excited about: - benchmax is training framework agnostic with adapters already built out for verl and verifiers. we’re gonna build more adapters for other frameworks (e.g. SkyRL, etc.), instead of forcing others to adopt our standard (though ofc they’re welcome to ) - benchmax comes with a few interesting environments out of the box: spreadsheet processing, CRM, etc. → more coming soon! - benchmax supports MCP as a first class citizen. there has been an explosion of MCP servers/tools built out for usecases ranging from browser use to excel to game creation.`benchmax` allow folks to leverage and compose these existing MCP servers to build environments integrated with real world systems - Multi-node environment parallelization coming soon! If you like what you see, feel free to * star* the * repo* to support the project!! Our hope’s to really let anyone benchmax on their tasks, with benchmax https://github.com/cgftinc/benchmax It’s still very early! And I expect to be shipping a lot more things → more environments, more trainer integrations. Would love y’all’s thoughts what environments and trainer integrations could be interesting!

Visit product View on Hacker NewsJul 29, 2025

Share card

Actual performance

1points

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: mcp, new, tasks · Missing: mac, agents, macos

89%89% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Indie HackersFits the IH revenue-focused audience · Strong signals: supports, para · Missing: reddit linkedin, podcasting, created

81%81% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

Hacker NewsStrong engagement from HN community · Strong signals: excited, exist, existing · Missing: https docs, just released, lua

65%65% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

TrustMRRLess likely to generate early MRR · Strong signals: para · Missing: mobile apps, ios, personal

46%46% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Strong signals: soon · Missing: plus, platform, intuitive

39%39% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Strong signals: training · Missing: arr, mrr, revenue

15%15% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Strong signals: real world · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Tiledesk – Open-Source LLM Chatbot Framework43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Tiledesk – Open-Source LLM Chatbot Framework

Hacker News4

Evvo – an open source framework for distributed evolutionary algorithms75%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Evvo – an open source framework for distributed evolutionary algorithms

Hacker News3

MetricFlow – open-source metric framework81%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

MetricFlow – open-source metric framework

Hacker News98

Dissect – An open source DFIR framework73%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Dissect – An open source DFIR framework

Hacker News8

RedBlue48%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Open-Source Hypervideo Framework

Indie Hackers1apis

ZenML50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

extensible, open-source MLOps framework

Indie Hackers4$1/moai

Opik, an open source LLM evaluation framework79%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Opik, an open source LLM evaluation framework

Hacker News86

Axilla – Open-source TypeScript framework for LLM apps83%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Axilla – Open-source TypeScript framework for LLM apps

Hacker News161

RΞ

RΞASON – Open-source TypeScript framework for LLM apps74%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

RΞASON – Open-source TypeScript framework for LLM apps

Hacker News7

RΞ

RΞASON – Open-source TypeScript framework for LLM apps58%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

RΞASON – Open-source TypeScript framework for LLM apps

Hacker News16

Browse all products Analyze your launch