Mu

Multi-agent autoresearch for ANE inference beats Apple's CoreML by 6×

Hacker News

Multi-agent autoresearch for ANE inference beats Apple's CoreML by 6×

We ran an experiment over the weekend to explore whether multiple autonomous agents could collaboratively optimize inference on Apple’s Neural Engine (ANE). Each agent ran locally on a different Mac (M1–M4), repeatedly modifying how a DistilBERT model is executed on the ANE, benchmarking latency, and sharing results and insights with other agents in real time. Instead of exploring independently, agents could: - see what others had tried - reuse working strategies - avoid known failure modes Across all tested chips, the agents ended up outperforming Apple’s CoreML baseline, with up to 6.31× lower median inference latency on the same hardware. An interesting pattern we observed: an agent stuck at ~2.1ms latency on M4 was able to break through after incorporating strategies discovered by agents on different chips (M2, M4 Max), eventually reaching ~1.5ms and surpassing CoreML. Full write-up: https://x.com/christinetyip/status/2039040161439224157 Detailed results: https://ensue-network.ai/lab/ane?view=strategies https://ensue-network.ai/lab/ane Curious what other optimization problems this kind of setup could be applied to, especially in systems, compilers, or ML infra. Would be interested in exploring similar experiments.

Share card

Actual performance

6points
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Product HuntOn track for Day 1 leaderboard · Strong signals: mac, agents, agent · Missing: macos, cursor, claude
81%81% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
best fitHighest predicted score across all platforms for this description.
Hacker NewsStrong engagement from HN community · Strong signals: io · Missing: https docs, excited, just released
70%70% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting
64%64% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal
31%31% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
29%29% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
20%20% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Strong signals: real time · Missing: web3, chat, crypto
0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Mu
Multi-agent LLM editor with local inference via WebSockets61%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Multi-agent LLM editor with local inference via WebSockets

Hacker News2
GemStar-1
GemStar-140%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

The torque behind multi-agent intelligence.

Indie Hackerscommitment-full-time
AI
AITalksToAI – A multi-agent LLM chatroom50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

AITalksToAI – A multi-agent LLM chatroom

Hacker News1
Mu
Multi-Agent Framework for Ruby50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Multi-Agent Framework for Ruby

Hacker News2
As
Async multi-agent coordination across physical environments49%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Async multi-agent coordination across physical environments

Hacker News3
AttendMe
AttendMe42%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Multi-Agent Medical AI For Physicians

Product Hunt+17
Ve
Veritas AI – Multi-Agent Deliberation for Truth42%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Veritas AI – Multi-Agent Deliberation for Truth

Hacker News2
Si
Simulations of Multi-Agent Dialogues57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Simulations of Multi-Agent Dialogues

Hacker News4
SyntrofAI
SyntrofAI68%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

World’s First Multi-Agent Operating System

Product Hunt
Ov
Ovadare – resolving AI agent conflicts in multi-agent platforms35%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Ovadare – resolving AI agent conflicts in multi-agent platforms

Hacker News4