ML FaaS - Machine Learning Serving cluster
Clone or download
HydroRobot HydroRobot
Latest commit 4a618db Sep 21, 2018

README.md

Hydrosphere ML Lambda

Join the chat at https://gitter.im/Hydrospheredata/hydro-serving

ML Lambda is an open source model management cluster for deploying, serving and monitoring machine learning models and ad-hoc algorithms. It enables you to get your models up and running in an instant, on just about any infrastructure and using any of the available machine learning toolkits. It lets you monitor your models’ performance, analyse their inputs (for example, determine whether there is recently an increased number of outliers or not), observe models’ inference on given data and so on.

Please, see our getting started guide and documentation.

Features:

  • Serverless user experience in your data center or public cloud.
  • State of the art architecture based on Service mesh powered by Envoy proxy
  • Plumbing. Automatic generation of Protobuf contracts for REST, gRPC and Streaming Kafka API from the model metadata
  • Safe experiments and models warm up on shadowed or canary traffic
  • Unified across ML frameworks
  • Automatic data profiling and statistical check of the model quality
  • Immutable model versioning
  • Agnostic to training pipeline and notebook environment
  • Multi-framework Pipelines (e.g. Scikit-learn -> Spark ML -> TensorFlow pipeline)
  • Out of the box tuned and optimized Serving Runtimes
  • Models optimization for Serving

Check UI - explore, deploy and test models

Hydrosphere Serving Deploy Models

Hydrosphere Serving Create an AI application

Hydrosphere Serving Test ML Models

Related repositories