-
Notifications
You must be signed in to change notification settings - Fork 26.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
TFTrainer dataset doc & fix evaluation bug #6618
Conversation
@@ -38,7 +38,11 @@ class TFTrainer: | |||
args (:class:`~transformers.TFTrainingArguments`): | |||
The arguments to tweak training. | |||
train_dataset (:class:`~tf.data.Dataset`, `optional`): | |||
The dataset to use for training. | |||
The dataset to use for training. The dataset should yield tuples of ``(features, labels)`` where |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I imagine it's the same for eval_dataset
, or the datasets passed along to evaluate
or predict
, so I'd copy this docstrings over there too.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Oh yeah, I think they do expect the same format. Added.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the clarifications!
Codecov Report
@@ Coverage Diff @@
## master #6618 +/- ##
==========================================
- Coverage 79.79% 78.86% -0.94%
==========================================
Files 156 156
Lines 28213 28213
==========================================
- Hits 22513 22250 -263
- Misses 5700 5963 +263
Continue to review full report at Codecov.
|
* TFTrainer dataset doc & fix evaluation bug discussed in huggingface#6551 * add docstring to test/eval datasets
* TFTrainer dataset doc & fix evaluation bug discussed in huggingface#6551 * add docstring to test/eval datasets
This reverts commit 47c523b.
discussed in #6551