Angel 1.0.0 English

Release v1.0.0

1. ParameterServer Functionalities

   • Automatically partitions and manages models whose parameters can be represented as matrix/vector, supporting sparse and dense types
   • Supports push/pull operations and customized psFunc
   • Provides multiple concurrency control mechanisms（BSP/SSP/ASP）

2. Development & Execution

   • Language support: the system is developed with Scala and Java; users can use any language of their choice
   • Deployment: can be deployed to Yarn or run on local
   • Data partitioning: automatically partitions and reads training data, compatible with Hadoop FS interface by default
   • Incremental training: automatically generates checkpoint during training, supporting incremental training after model is loaded

3. PS Service

   • Only starts up PSServer and PSAgent, providing PS service for other distributed computing platforms
   • Spark-on-Angel algorithms can be developed based on PS-Service without changing Spark source code, supporting Breeze NumericOps seamlessly

4. Algorithms Library

   • Contains many algorithms such as Logistic Regression, SVM, KMeans, LDA, MF, GBDT, etc.
   • Supports various optimization methods, including ADMM, OWLQN, LBFGS and GD
   • Supports various loss functions and metrics, L1/L2 regularization

5. Algorithm Optimization

   • LDA: F+LDA accelerates sampling, while retrieving parameters in a streaming fashion to reduce network latency
   • GBDT: two-stage tree-splitting transfers part of the computing load to PS, reducing network communications and improve speed