Work in Progress

Live link: https://share.streamlit.io/tlkh/serverless-transformers/main/app.py

Serverless Transformer

Serve HuggingFace Transformer models via serverless (mostly free):

• Cloud Run
  • 4GB + 4 vCPU: run up to 200+M parameter Transformer (e.g. T5-base)
  • autoscale to 0, free monthly quota
• Free web interface via Streamlit Share

Deployment

Build Backend Container

cd backend
docker build . -t cloudrun-transformer