-
Notifications
You must be signed in to change notification settings - Fork 88
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Steps to Reproduce
- Use 4070 12GB.
- Join parallax gpt-oss-20b.
- Will be assigned with 3 layers of ~8 GB weight usage.
- OOM when capturing graph. Only ~0.5GB for graph.
Expected Behavior
Should be assigned with less layers. Finish capturing graph which takes around 2GB memory.
Actual Behavior
OOM when capturing graph.
Version
v0.0.1
Environment & Context
- I'm using the latest version.
- I have searched existing issues.
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working