fix(train): Fall back to public hub when private hub lacks base model#6092
Conversation
|
Claude finished @lucasjia-aws's task in 1m 44s —— View job Review: PR #6092 — Fall back to public hub when private hub lacks base model
The change is correct, well-scoped, and mirrors the existing A few minor points, none blocking: 1. Broad Any exception — throttling, 2. Stray empty comment line ( The diff leaves a dangling 3.
Overall this looks good to merge — the items above are optional polish, not correctness issues. |
When resolving a model package's base model, the reconstructed hub-content ARN honored SAGEMAKER_HUB_NAME but never verified the base model actually existed in that private hub, and never fell back. If the private hub had not mirrored the base model (or its ModelReference was cleaned up), server-side CreateTrainingJob failed with "Hub content ... does not exist", breaking evaluation integ tests (benchmark, custom scorer, and LLM-as-judge, including custom scorer with a built-in metric). Verify the base model exists in the configured private hub and fall back to SageMakerPublicHub when it is absent, mirroring the existing fallback in _resolve_jumpstart_model. Base models are always published to the public hub, so this keeps evaluation working regardless of private-hub contents. The public-hub path is unchanged and does no extra lookups.
|
Claude finished @lucasjia-aws's task in 52s —— View job Review: PR #6092 — Fall back to public hub when private hub lacks base model
The change is correct and well-scoped. Verified against the checked-out repo:
A couple of minor, non-blocking observations:
None of these are correctness issues. LGTM. |
When resolving a model package's base model, the reconstructed hub-content ARN honored SAGEMAKER_HUB_NAME but never verified the base model actually existed in that private hub, and never fell back. If the private hub had not mirrored the base model (or its ModelReference was cleaned up), server-side CreateTrainingJob failed with "Hub content ... does not exist", breaking evaluation integ tests (benchmark, custom scorer, and LLM-as-judge, including custom scorer with a built-in metric).
Verify the base model exists in the configured private hub and fall back to SageMakerPublicHub when it is absent, mirroring the existing fallback in _resolve_jumpstart_model. Base models are always published to the public hub, so this keeps evaluation working regardless of private-hub contents. The public-hub path is unchanged and does no extra lookups.
Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.