[None][feat] Assert attention DP disabled when KV connector is in use#13448
Conversation
|
/bot run --disable-fail-fast |
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Enterprise Run ID: 📒 Files selected for processing (1)
📝 WalkthroughWalkthroughA validation check is added to Changes
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~4 minutes 🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
|
PR_Github #45439 [ run ] triggered by Bot. Commit: |
|
PR_Github #45439 [ run ] completed with state
|
afffd53 to
4828836
Compare
|
/bot run --disable-fail-fast |
|
PR_Github #45508 [ run ] triggered by Bot. Commit: |
|
PR_Github #45508 [ run ] completed with state
|
KV connector has not been validated with attention data parallelism, and there is no established plumbing to make the two work together. Fail fast at connector init rather than silently producing incorrect behavior. Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
4828836 to
61d7d3f
Compare
|
/bot run --disable-fail-fast |
|
PR_Github #45517 [ run ] triggered by Bot. Commit: |
|
PR_Github #45517 [ run ] completed with state
|
|
/bot run --disable-fail-fast |
|
PR_Github #45736 [ run ] triggered by Bot. Commit: |
|
PR_Github #45736 [ run ] completed with state
|
|
/bot run --disable-fail-fast |
|
PR_Github #45781 [ run ] triggered by Bot. Commit: |
|
PR_Github #45781 [ run ] completed with state |
Summary
NotImplementedErrorinpy_executor_creator._create_py_executorthat fires whenmapping.enable_attention_dpis True and akv_connector_configis provided, matching the style of the existing scheduler-policy and VSWA guards.Test plan
kv_connector_config+enable_attention_dp=Trueand confirm the newNotImplementedErroris raised before any connector worker is instantiated.kv_connector_config+enable_attention_dp=Falseand confirm startup is unchanged.Summary by CodeRabbit