-
-
Notifications
You must be signed in to change notification settings - Fork 796
Closed
Description
System Info
Python 3.11 venv, Arch Linux
Reproduction
import torch
import bitsandbytes as bnb
a = [torch.rand(1), torch.rand(1)]
opt = bnb.optim.LAMB8bit(a)
a[0].grad = torch.rand(1)
opt.step()
venv/lib/python3.11/site-packages/bitsandbytes/functional.py", line 1211, in optimizer_update_32bit
optim_func = str2optimizer32bit[optimizer_name][0]
~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^
KeyError: 'lamb'
Expected behavior
it steps the optimizer?
Metadata
Metadata
Assignees
Labels
No labels