OpenAI Cost Monitoring
OpenAI Cost Monitoring
Hi HN, My name is Ben Schaechter and I’m Co-Founder and CEO of https://vantage.sh - a cloud cost visibility and optimization platform. We just added support for monitoring OpenAI costs and usage to Vantage and I wanted to share a demo we put together with HN as I thought people might find it interesting: https://www.youtube.com/watch?v=CzAOU1-uMrM In early April we started getting requests from customers to add OpenAI cost support specifically as it was a bit opaque as to what exactly was driving costs. The way this works is that it uses an undocumented API available from OpenAI - I asked ChatGPT how to get this info and this is what it recommended. The OpenAI team said this was fine to use but is subject to change in the future which is why this feature is in beta right now. This new integration uses an OpenAI API key to report on costs by organization, operation (i.e “Completion”), and model (i.e. “GPT-4”). It also allows you to forecast your OpenAI costs and set up billing alerts in Slack if costs begin to increase rapidly. I’d love to know what people think on this and if you have any feedback good or bad for us to improve this moving forward. You can register an account and connect OpenAI in a few seconds here: https://console.vantage.sh/signup
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Correct prediction on native model
Similar products
Cataloging the NYRB and LRB with OpenAI Embeddings
Free AWS cost monitoring
Microservices monitoring
Microservices and container monitoring
RBLWatch - Blacklists monitoring
Obsessive monitoring
Monitoring and Alerting with Graphite
Crowdsourced Environmental Monitoring
Opsmatic configuration monitoring
Redisplay – Monitoring Redis with Arduino