Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable progress bar for Trainer #9275

Closed
Nickil21 opened this issue Dec 23, 2020 · 3 comments
Closed

Disable progress bar for Trainer #9275

Nickil21 opened this issue Dec 23, 2020 · 3 comments

Comments

@Nickil21
Copy link

Nickil21 commented Dec 23, 2020

I am referencing a similar code compared to [run_glue.py]
(https://github.com/huggingface/transformers/blob/master/examples/text-classification/run_glue.py).

I am running a preprocessing function that does the tokenization of text as well as trainer.predict on a pandas dataframe. How do I disable the progress bar from showing the progress made on each row of the dataframe? I thought it would work by disabling logging as well as tqdm, but it is not the case here. #3050

@sgugger
Copy link
Collaborator

sgugger commented Dec 23, 2020

If you set disable_tqdm=False in your TrainingArguments, you shouldn't have any progress bar from the library.

@Nickil21
Copy link
Author

Well, I think you meant disable_tqdm=True. By the way, the following worked:

args = TrainingArguments(disable_tqdm=True, output_dir="tmp_trainer")

I am still getting progress bars for the dataset.map() though. Is there something like verbose=False?

@sgugger
Copy link
Collaborator

sgugger commented Dec 23, 2020

dataset.map comes from the Datasets library, not Transformers. So you should open an issue there for this part :-)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants