Repository navigation
Releases: afdEP/afdEP-comm
Release list
afdEP v1.0.0
afdEP v1: expert-parallel communication specialized for Attention–FFN Disaggregation.
v1 vendors DeepEP V2's kernels and removes what the Attention and FFN roles make unnecessary, against the same kernels run without roles (Masked DeepEP). Every change keeps a control switch; details and per-change evidence are in docs/v1.md.
In one NVLink domain: no entry barriers, counts from Attention to FFN only, directed exit (only receivers wait), receive buffers sized per role, role suites that launch only the warps each role uses, and a single-FFN reduction and collect view.
Across NVLink domains (NCCL GIN): a directional protocol when every domain holds one role. Domains that hold both roles run DeepEP's union hybrid.
Measured (communication only, round trip under CUDA graphs, against Masked DeepEP; paired geometric-mean changes over fresh-process repeats):
- 4 × H100, one NVLink domain (tree
bd4db4da, sections 1–4): 27–35% lower latency at one token and 1–5% at 2,048 tokens, faster in every repeat. - 8 × H200, one NVLink domain: 22% (4A:4F), 24% (6A:2F) and 39% (7A:1F) lower at one token.
- H200 across NVLink domains with one role per domain: 30% lower at 11:1 over 12 domains and 26% at 5:1 over 6 domains at one token. Mixed-role domains match Masked within 1.4%.
Support: Hopper (SM90), BF16 and FP8, eager and CUDA graphs, one NVLink domain or several joined by GIN. The release tree passes the GPU suite in one 4-GPU NVLink domain, and the directional protocol passed it on earlier trees over two to five NVLink domains. The 8-GPU-domain and 24-rank results are measured, not suite-validated. Blackwell (SM100) is tracked in #2.
Naming: this generation was developed as v2.1; the earlier DeepEP-reuse generation is now v0. Records cite the native source digests of the trees as measured. 958652a3 is v1 before the rename; the rename and the release's comment fixes changed only comments and text, giving 131efc37 for this release.