Phase 1: PS module implementation and unit tests.
Phase 2: master-PS-worker interaction. Add
num_ps_pods argument and set the default as 0 to use legacy PS (PS with master and Redis).
Phase 3: Change
num_ps_pods default to 1. Remove legacy PS (PS with master and Redis).
Phase 4: Embedding replica and PS fault tolerance.