An Open-Source, Local-First Agent Framework in Rust
An Open-Source, Local-First Agent Framework in Rust
Hey HN, About five months ago, I started thinking seriously about how we run agents — and how little control end users actually have over privacy, data, and compute. Running an LLM locally is great for rewriting emails or answering basic questions, but it doesn’t give you real autonomy. What does give you power is the ability to run full-fledged local agents capable of deep research, coding, reasoning, and tool use — all without sending data to external services. With that vision in mind, I started an open-source project (MIT + Apache-2 licensed) to make building and running agents modular, customizable, and hardware-friendly. Every component of the agent stack can be swapped out: Memory: plug in your own memory backend LLM layer: use local models or cloud APIs interchangeably Execution style: choose between ReAct, CoT, or your own custom executor The goal is to enable real research workflows while maintaining strong performance and developer-friendly usability. The project doesn’t stop at building agents, either — we want to ensure you can run them efficiently on any accelerated hardware, from GPUs to edge devices. Would love feedback from the HN community!
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
Arkloop – Open-source, local-first Agent client
I made an open source and local translation app
Every 4s, Familiar OCRs my screen into Markdown (open source, local)
Open-source local voice typing
An open-source, local-first Webflow for your own app
ApiArk – Open-source, local-first API platform (Postman alternative)
Open-source, local-first GTD app — no account, no cloud
Open-source, local-first dictation you can trust
The open-source, local-first Figma for React apps
Open source, local voice-to-text