Open-Source LLM Observability and Export to Grafana, Datadog etc.
Open-Source LLM Observability and Export to Grafana, Datadog etc.
Hi Everyone! This is the maintainer of Doku, an open-source LLM Observability tool that you can self-host and run easily (its 3 simple components) Doku currently can monitor OpenAI, Mistral, Anthropic, Cohere and Azure OpenAI usage like Performance, Costs, Tokens and user interactions. This is a starting point for us, So let us know what you'd like to see in LLM Monitoring. Also, We fully understand that you are already using some observability tool, So we did build our connections with these which allow auto-export to your Observability tool. Currently Doku can export to Grafana Cloud, DataDog, New Relic, Dynatrace and SigNoz. Too make you job easier, We have build dashboards that you can easily import into all of these. Checkout -> https://docs.dokulabs.com/latest/connections/intro Doku is self-hosted and Open-source at heart. we’d love for you to try it out and share what you think. Check it out at https://docs.dokulabs.com/
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
OpenLIT – Open-Source LLM Observability with OpenTelemetry
OpenLIT – Open-Source LLM Observability with OpenTelemetry
Open-source observability for LLM apps
Langfuse – Open-source observability and analytics for LLM apps
OneUptime - An Open Source Observability Platform
OneUptime – open-source observability platform
Open Source Data Observability
Autometrics – open-source observability stack
Pontoon, an open-source data export platform
LLM Observability Platform