Sunk Cost – How long until a local LLM rig pays for itself?
Sunk Cost – How long until a local LLM rig pays for itself?
I kept hearing "just buy a Mac and run models locally, it pays for itself" and wanted to check. Sunk Cost takes a machine, a model and how many tokens you use a day, and works out how long the hardware takes to pay back against renting the same model by the token. Obviously there are other reasons to buy your own hardware aside from just saving money on llms but this is just looking at it from a raw cost saving perspective. If you have any ideas on how I can make this more helpful lmk!
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Correct prediction on native model
Similar products
A reliability layer that prevents LLM downtime and unpredictable cost
Local LLM AIME benchmarking tool
So Long, and Thanks for All the Veggies
2/2/22 Jumpy2 (long overdue)
The Long Beach Pub
infracost - Cost Estimation for Terraform
Cost of the War in Afghanistan
DripStat – Full Java APM at 1/10th the Cost of NewRelic
Advertise at no cost. $0 CPM. $0 CPC.