Use any LLM in Go with stable, minimal API
Use any LLM in Go with stable, minimal API
I started this package about a year ago because most existing packages were overly complex and I just wanted the basic LLM functionality (text, tools, streaming, images, caching, etc) compatible with all the major APIs (OpenAI Chat Completions + Responses, Anthropic, Google Studio + Vertex). It also works with any other vendor that provides a compatible API. Along this journey we found a ton of quirks and differences between vendors, and tried to make switching between them on the fly feel as smooth as possible (e.g. not having to worry exactly how to include an image in a tool result). Sharing it now because it's reaching some form of maturity after a year, but because the goal has been to keep it minimal, it only has the bare minimum we needed – I'd love to hear what people think is missing!
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Correct prediction on native model
Similar products
Use any LLM with just one API
Minimal NodeJS Web API
Use DynamoDB with the Redis API (Go)
Mini_gzip – embeddable, minimal, in-memory GZIP API
Mini_gzip – embeddable, minimal, in-memory Gzip API
A minimal implementation of LLM output watermarking
Jelly – Experimental minimal RPC
Minimal Fibers
Momentous – a minimal datepicker for bootstrap
Minimal Meteor Scaffolding