AI Proxy with support for multiple providers, caching

Hacker News

Hi HN, We're excited to open source our AI Proxy which supports Mistral, LLaMa2, OpenAI, Azure, Anthropic, and more through vanilla OpenAI SDKs. The proxy also supports configurable caching, API key management, and load balancing across multiple providers. The proxy code also includes multiple deployment options: Cloudflare workers, Vercel, AWS Lambda, and plain-old Express. We're open sourcing this because our customers are starting to run their production workloads through it, and we believe that critical-path-of-production tools should be open source. To play around with a hosted version of the proxy, you can simply set the base URL in your OpenAI libs to https://braintrustproxy.com/v1 (more detailed instructions in the repo[1] and our docs[2]). We'd love your feedback -- on use cases we may not have thought of, models we should support, or other features that would be useful to include in this layer of abstraction. [1]: https://github.com/braintrustdata/braintrust-proxy [2]: http://braintrustdata.com/docs/guides/proxy

Visit product View on Hacker NewsNov 27, 2023

Share card

Actual performance

3points

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: model, models, openai · Missing: mac, agents, macos

83%83% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Indie HackersFits the IH revenue-focused audience · Strong signals: supports · Missing: reddit linkedin, podcasting, created

81%81% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

Hacker NewsStrong engagement from HN community · Strong signals: excited, open source, llama · Missing: https docs, just released, exist

60%60% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal

42%42% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Strong signals: host · Missing: plus, platform, intuitive

28%28% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

20%20% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

1%1% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

5-Proxy74%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Compare the Best Proxy Providers and Find the Right Proxy fo

Indie Hackerscommitment-full-time

Letsproxy49%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

UI for nginx proxy with letsencrypt SSL termination support

Indie Hackerscommitment-side-project

A CORS proxy in a container42%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

A CORS proxy in a container

Hacker News5

Cors-container – A CORS proxy in a container42%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Cors-container – A CORS proxy in a container

Hacker News3

A CORS proxy in a container42%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

A CORS proxy in a container

Hacker News7

RedFI – Redis Fault-Injection Proxy40%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

RedFI – Redis Fault-Injection Proxy

Hacker News6

ChromeDriver Proxy an extensible proxy to ChromeDriver49%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

ChromeDriver Proxy an extensible proxy to ChromeDriver

Hacker News2

Inlets as an IPv6 Proxy45%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Inlets as an IPv6 Proxy

Hacker News2

Notifier/Proxy Logger39%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Notifier/Proxy Logger

Hacker News1

Proxy.py47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Proxy.py

Hacker News3

Browse all products Analyze your launch