Skip to content

[bugfix]修复fitlogcallback在disttrainner中无法添加dev_data 的问题 #348

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 15 commits into from
Dec 16, 2020
Merged

[bugfix]修复fitlogcallback在disttrainner中无法添加dev_data 的问题 #348

Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
4a05242
f1 fix
ROGERDJQ Jul 30, 2020
88b02bb
fix f1 test
ROGERDJQ Aug 5, 2020
add339f
Merge branch 'master' of github.com:fastnlp/fastNLP into test
ROGERDJQ Aug 5, 2020
cc0b378
f1 fix
ROGERDJQ Aug 7, 2020
22c6e6d
!5 修复了一些错误
WillQvQ Nov 23, 2020
af517fc
Merge branch 'master' of github.com:fastnlp/fastNLP into test
ROGERDJQ Dec 13, 2020
848d0a7
fix fitlogcallback when applied on DistTrainer
ROGERDJQ Dec 13, 2020
fb1bc88
small typo
ROGERDJQ Dec 13, 2020
bbb6d2e
Delete .gitignore
ROGERDJQ Dec 14, 2020
d027a8f
回退取消.gitignore的添加
ROGERDJQ Dec 15, 2020
6da1215
Revert "small typo"
ROGERDJQ Dec 15, 2020
6a7a0c0
重新取消.gitignore的添加
ROGERDJQ Dec 15, 2020
4bc1c90
恢复gitignore
ROGERDJQ Dec 15, 2020
33fa2f1
fix typo
ROGERDJQ Dec 15, 2020
cea5119
Merge branch 'dev' into test
yhcc Dec 16, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions fastNLP/core/dist_trainer.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -177,8 +177,13 @@ def __init__(self, train_data, model, optimizer=None, loss=None,
self.batch_size = self.world_size * self.batch_size_per_gpu
self.n_steps = self._get_n_steps()

self.dev_data = dev_data
self.metrics = metrics
self.test_use_tqdm = True
self.kwargs = kwargs
self.test_use_tqdm = kwargs.get('test_use_tqdm', self.use_tqdm)
dev_batch_size = kwargs.get('dev_batch_size', batch_size_per_gpu)

# for evaluation, only run eval on master proc
if dev_data and metrics:
cb = _TesterCallback(
Expand Down