Skip to content

Commit

Permalink
perf(finetune): 更新学习率
Browse files Browse the repository at this point in the history
  • Loading branch information
zjZSTU committed Mar 31, 2020
1 parent 01cf3c0 commit f1a1ba1
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion py/finetune.py
Original file line number Diff line number Diff line change
Expand Up @@ -128,7 +128,7 @@ def train_model(data_loaders, model, criterion, optimizer, lr_scheduler, num_epo

criterion = nn.CrossEntropyLoss()
# optimizer = optim.SGD(model.parameters(), lr=1e-3, momentum=0.9)
optimizer = optim.Adam(filter(lambda p: p.requires_grad, model.parameters()), lr=1e-3, weight_decay=1e-2)
optimizer = optim.Adam(filter(lambda p: p.requires_grad, model.parameters()), lr=1e-5, weight_decay=1e-5)
lr_scheduler = optim.lr_scheduler.StepLR(optimizer, step_size=4, gamma=0.1)

best_model = train_model(data_loaders, model, criterion, optimizer, lr_scheduler, device=device, num_epochs=15)
Expand Down

0 comments on commit f1a1ba1

Please sign in to comment.