Super Fast Multi-User Open Source LLM WebUI
Super Fast Multi-User Open Source LLM WebUI
It's a 20MB static binary, or docker container with integrated DB. Perfect to hacking/testing LLMs with built in SQLite DB for history, config, etc. https://x.com/rogerscissp/status/1917092440068047334
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
Tankman – An Open Source User Management and Authorization MicroService
Verity – A tiny and super fast open-source server for Altcha
Europa – An Open Source Multi-Cloud Container Registry
Open-source multi-modal LLM chat agent
Blixtser – Super fast serialization for Java
Tankman – A Open Source service for User Management and Authorization
OpenLIT – Open-Source LLM Observability with OpenTelemetry
OpenLIT – Open-Source LLM Observability with OpenTelemetry
We made glhf.chat – run almost any open-source LLM, including 405B
SlideSelection, an Open Source Hooper Selection Implementation