how to understand "DeepSpeed uses gradient accumulation to extract pipeline parallelism"

hi, I am a little bit confused about the relationship of gradient accumulation stages and pipeline stages when I read your pipeline source code "total_steps = 2 * (self.micro_batches + self.stages - 1)", could you describe it  detailed?