Compliant-LLM: Audit AI Agents for Compliance with NIST AI RMF
Compliant-LLM: Audit AI Agents for Compliance with NIST AI RMF
We're excited to launch compliant-llm: an open-source toolkit that helps infosec and compliance teams audit AI agents against regulatory frameworks like NIST AI RMF, ISO 42001, and OWASP Top 10. Infosec and compliance teams are now responsible for tracking security and compliance risks of a growing number of AI agents across external and internal apps and third-party vendors. compliant-llm gives you a way to: - Define and run comprehensive red-teaming tests for AI agents - Maps test outcomes to compliance frameworks like NIST AI RMF - Generate detailed audit logs and documentation - Integrate with Azure, OpenAI, Anthropic, or wherever you host your models - With an open-source, self-hosted solution Install and launch the red-teaming dashboard locally: pip install compliant-llm compliant-llm dashboard This opens an interactive UI for running AI compliance checks and analyzing results. We’re at v0.1, and would love your feedback. Tell us about the compliance or AI risk issues you’re facing, and we’ll prioritize what matters most.
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
Supercharge Your Compliance with AI Agents
CogniSim – Interaction utilites for crossplatform LLM agents
I made GAI to have LLM agents in Go without heavy frameworks
Audit your ISP with a speedtest cronjob
AgentContract – ESLint for AI agents - Declare what your AI can||can't!
AI red teaming assesment for AI agents
AI Agents Benchmarking and Competition
OAuth for AI Agents
47jobs – A Fiverr/Upwork for AI Agents
SAIA – SCUMM for AI Agents