FastAPI Inference Template 🚀
A lightweight template to wrap any 🤗 Transformers model as an API with FastAPI.
Endpoints
GET /
→ health checkPOST /predict
→ run inference
Example Usage
curl -X POST "http://localhost:8000/predict" \
-H "Content-Type: application/json" \
-d '{"text": "Markets are looking strong today"}'
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support