Service status checks on models and the ability to raise or log an alert when not available. Intention is to make it more visible if a service or model is not available.
Areas to check.
- Check if APIs have a health check or heartbeat for service & models
- Check if there is an API for a service's service status pages
- Local - health checks: Server Running check
- Last resorts: Service Status scraping.
Note: For Ollama, service status might need to be added (see ollama/ollama#15419) though also check if there is an API option.
Service status checks on models and the ability to raise or log an alert when not available. Intention is to make it more visible if a service or model is not available.
Areas to check.
Note: For Ollama, service status might need to be added (see ollama/ollama#15419) though also check if there is an API option.