Interleaved/Looping SPMD Pipelines

[ptoulme-aws]

Hello,
At the 2024 OpenXLA Dev Day, I watched a presentation by Nvidia where they demonstrated SPMD pipeline parallel. They specifically mentioned interleaved pipelining (looping pipelines). I recall the presenter said they obtained an interleaved schedule via an HLO pass.

Questions:

1. Is this pass open source and if so where is it located? I looked on OpenXLA and cannot find it.
2. Is there a recording of this presentation anywhere?

Thank you,
Patrick Toulme

Amazon Web Services

[ptoulme-aws]

https://groups.google.com/a/openxla.org/g/openxla-discuss/c/rSnETPs3z2c