All you need is Prometheus and Jaeger for LLM Observability
All you need is Prometheus and Jaeger for LLM Observability
Hey folks! I'm thrilled to let you all know about something my friend and I have been working on at [OpenLIT]( https://github.com/openlit/openlit )! For those of you working with LLMs, we’ve got some pretty cool updates. We’ve successfully integrated Prometheus and Jaeger—yes, the go-to observability tools to fully support your LLM application observability. This means you can stick with the tools you already know and trust! Here's how it works: Imagine spending less time on setup and more on what truly matters: enhancing features and functionality. OpenLIT simplifies the process of adding observability to your LLM applications through OpenTelemetry (OTel). Just a single line of code and you can start monitoring key attributes like costs, token usage, user interactions, and performance metrics. And it doesn't stop at Prometheus and Jaeger! OpenLIT is also compatible with other backends like Grafana Tempo, or any OTel-compatible system, giving you the flexibility to store and visualize data just the way you like it. Head over to our guide to get started. Oh, and we've set you up with a Grafana dashboard that's pretty much plug-and-play. You're going to love the visibility it offers. We're super keen to see how OpenLIT integrates into what you’re doing! Give it a go and share your thoughts. Your feedback is super valuable and will help us make OpenLIT even better. Swing by and star our project on GitHub here -> https://github.com/openlit/openlit Can’t wait to see OpenLIT in action in your LLM applications! Cheers! Patcher
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
You don't need to adopt new tools for LLM observability
LLM Observability Platform
Langtrace – OpenTelemetry-Based LLM App Observability
Langtrace – OpenTelemetry Based LLM App Observability
LLM observability for builders who can't afford surprises.
n8n’s observability, LLM’s flexibility
PDFAgent with Observability
OpenLIT – Open-Source LLM Observability with OpenTelemetry
OpenLIT – Open-Source LLM Observability with OpenTelemetry
Open-source observability for LLM apps