Skip to content

Out of Memory Warning Needed for NPU Devices #134

Open
@leestott

Description

@leestott

Based on Model sizes we need a out of memory warning.

There are significant differences between Intel AI PC devices

NPU
Image

GPU
Image

vs

ARM AI PC Devices based on available GPU and NPU Memory constraints 7GB vs 18GB (On Intel)

NPU

Image

GPU

Image

Ask
We need to provide a error at present running large models such as deepseek R1 14b crashes foundry local service and doesnt provide a clear error or issue to users.

AB#66984

Metadata

Metadata

Assignees

No one assigned

    Labels

    ADObugSomething isn't workingduplicateThis issue or pull request already existspapercutThis issue relates to user experience papercut

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions