HumanLayer – Human-in-the-Loop for AI Agents
HumanLayer – Human-in-the-Loop for AI Agents
I found myself building a bunch of LLM-backed features that needed to use tool calling, and some of those tools involved doing things that were somewhat high stakes - communicating on my behalf or modifying shared / production data. one example - I wanted to replace a marketing website with a chatbot + vector DB loaded with the previous content, docs, and blog posts. Between hallucinations, missing knowledge base info, and the LLM generally writing like an psuedo-intellectual high schooler, I realized I couldn't trust it to communicate unsupervised with my website visitors. I needed a way to improve the percent of high-quality responses, and do it this at scale. I wired up a prototype that would 1. consult me in slack before sending any response down to a website visitor 2. incorporate my feedback into the knowledge base, and 3. reformulate answers until I approved the message 4. send it to the visitor That prototype evolved into what is now HumanLayer https://github.com/humanlayer/humanlayer#why-humanlayer
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
Human-in-the-loop infra for AI agents
Human Lambdas – Create Human in the Loop queues and outsource them
Vigilator – human-in-the-loop layer for AI agents
The human-in-the-loop layer for AI agents.
Ship software with 0 human in the loop
Keep your stakeholders in the loop
Human-in-the-loop infrastructure for agentic workflows.
Automation for invoices — with a human in the loop.
AI Agents Benchmarking and Competition
OAuth for AI Agents