Skip to content
This repository was archived by the owner on Jun 4, 2025. It is now read-only.

Conversation

@natuan
Copy link

@natuan natuan commented Oct 23, 2021

Add num workers to training GLUE script

@natuan natuan requested review from a team, bfineran, markurtz, mgoin and spacemanidol October 23, 2021 05:04
@markurtz markurtz merged commit 988e1cc into master Oct 23, 2021
markurtz pushed a commit that referenced this pull request Oct 23, 2021
* Test:rm datasets/huggingface-hub versions (#23)

* SparseML integ for NER (#21)

* SparseML integ for NER

* Reuse SparseMLTrainer for token classification

* support to download and unwrap framework files from SparseZoo stubs (#19)

* support to download and unwrap framework files from SparseZoo stubs in hf_argparser

* added check that model config and checkpoint are downloaded from zoo

* Add preprocessing num workers for GLUE (#26)

Co-authored-by: Rahul Tuli <rahul@neuralmagic.com>
Co-authored-by: Benjamin Fineran <bfineran@users.noreply.github.com>
KSGulin pushed a commit that referenced this pull request Mar 9, 2022
@dbogunowicz dbogunowicz deleted the preprocess_num_workers branch December 5, 2023 10:27
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants