Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parameter validation failed - "MemorySizeInMb", must be one of: MemorySizeInMB, MaxConcurrency, ProvisionedConcurrency #225

Open
robmcd opened this issue Nov 29, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@robmcd
Copy link

robmcd commented Nov 29, 2024

Describe the bug
getting an error when trying to create model endpoint config.

To reproduce

from sagemaker_core.resources import EndpointConfig, Endpoint
from sagemaker_core.main.shapes import ProductionVariant, ProductionVariantServerlessConfig

endpoint_config = EndpointConfig.create(
    endpoint_config_name='endpoint-config',
    production_variants=[
        ProductionVariant(
            variant_name='variantA', 
            model_name='MyModel',
            serverless_config=ProductionVariantServerlessConfig(
                memory_size_in_mb=1024,
                max_concurrency=2
            )
        )
    ]
)

Getting error:

ParamValidationError: Parameter validation failed:
Missing required parameter in ProductionVariants[0].ServerlessConfig: "MemorySizeInMB"
Unknown parameter in ProductionVariants[0].ServerlessConfig: "MemorySizeInMb", must be one of: MemorySizeInMB, 
MaxConcurrency, ProvisionedConcurrency

Expected behavior
No error raised.

Screenshots or logs
If applicable, add screenshots or logs to help explain your problem.

Bug information
A description of your system. Please provide:

  • SageMaker Core version: 1.0.16
  • Python version: 3.11

Additional context
I'm guessing that there's some case sensitive issue happening here...?

@robmcd robmcd added the bug Something isn't working label Nov 29, 2024
@robmcd
Copy link
Author

robmcd commented Dec 6, 2024

Similar error:
Unknown parameter in InferenceSpecification: "SupportedResponseMimeTypes", must be one of: Containers, SupportedTransformInstanceTypes, SupportedRealtimeInferenceInstanceTypes, SupportedContentTypes, SupportedResponseMIMETypes

@wm3
Copy link

wm3 commented Jan 20, 2025

I also have the same issue. I can't create any serverless inference endpoints using sagemaker-core because of this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants