Deploy Hugging Face Models to AWS Lambda
Deploy Hugging Face Models to AWS Lambda
I've been working on Scaffoldly since 2020 to simplify AWS Lambda deployments. Recently discovered you can run Hugging Face models efficiently using EFS for caching. Here's what's interesting: - Uses EFS for model file persistence - Pre-downloads models after deployment for faster cold starts - Cold start: ~20s (model loading), warm requests: 5-20s (CPU inference) - Fully automated container builds and deployment - Works with private/gated models via HF_TOKEN Example deployment: npx scaffoldly create app --template python-huggingface cd python-huggingface && npx scaffoldly deploy Scaffoldly is Open Source and I'm excited for all feedback and contributions from the community! https://github.com/scaffoldly/scaffoldly https://github.com/scaffoldly/scaffoldly-examples/tree/pytho...
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
Deploy a Jenkins Cluster on AWS
Railway – Deploy Rails to AWS with Ansible
Deploy Jitsi on AWS in 5 Minutes
Cloudlvl – Generate and Deploy AWS Lambda with AI
Train and deploy ML/DL models on AWS Sagemaker
Deploy Next.js to AWS
Sagify - Train and deploy ML/DL models on AWS SageMaker made simple
Platform to deploy from GitHub to AWS
Terraform AWS Starterkit
Cfer Is a Ruby DSL for AWS CloudFormation