Skip to content

winddd/flexps

 
 

Repository files navigation

flexps

Build Status

FlexPS is a minimum Parameter-Server based system, supporting efficient worker-server interaction using various consistency model (BSP/SSP/ASP).

The introductory paper of FlexPS has been published in PVLDB'18 (paper). The team for this work consists of Yuzhen Huang, Tatiana Jin, Yidi Wu, Zhenkun Cai, Xiao Yan, Fan Yang, Jinfeng Li, Yuying Guo, James Cheng. We also would like to acknowledge the contributions of Zhanhao Liu, Shuo Tu, Ruoyu Wu to this work.

For paper version, pleace check out flexps-paper-version which is the research prototype and is not maintained anymore.

In courtesy of the Husky team at CUHK.

Check the wiki pages for FlexPS tutorial:

  1. Build
  2. Run
  3. Guide
  4. Table
  5. HdfsManager

FlexPS has also been used for the csci5570 course project, Fall 2017, CUHK (course, project, github). In the course, we gave the students some interfaces, code skeletons, and some tests and let them to implement a Parameter Server step by step. Details can be found here. Tatiana was the TA of the course. It will be helpful if you want to build a Parameter Server from scratch.

FlexPS uses gflags, glog, gtest, zmq and libhdfs3 (hdfsmanager only).

Acknowledgement: FlexPS borrows many good design and componenets from husky, ps-lite and bosen.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C++ 92.5%
  • CMake 4.0%
  • Python 3.1%
  • Dockerfile 0.4%