Repository navigation
v0.11.3.dev0
Pre-release
Pre-release
·
374 commits
to dev
since this release
What's Changed
- feature(nixl): pipeline parallelism for prefill/decode KV-cache transfer by @rebel-ykchoi in #901
- perf(eagle): reduce EAGLE drafting overhead by @rebel-minkyu in #945
- feature: compute KV cache available memory per chiplet by @rebel-jongholee in #870
- fix(sampler): honour SamplingParams.logprob_token_ids by @rebel-eunji in #879
- other(test): enable the suffix decoding e2e test by @rebel-cjlee in #953
- refactor(weight-loader): drop the forked load_weights overrides by @rebel-cjlee in #947
- docs(agent): adjust the agent rules after first use by @rebel-cjlee in #959
- fix(dp): rendezvous the DP ranks at the end of warm-up by @rebel-yskim in #955
- fix(moe): add the replicated shared expert outside the TP all_reduce by @rebel-kblee in #960
- other(dummy): Dummy PR for v0.11.3.dev0 by @rebel-junamsong in #966
New Contributors
- @rebel-jongholee made their first contribution in #870
Full Changelog: v0.11.2a11...v0.11.3.dev0