Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

updating nlp notebook #693

Merged
merged 9 commits into from
Aug 22, 2022
Merged

Conversation

liususan091219
Copy link
Collaborator

@liususan091219 liususan091219 commented Aug 21, 2022

Why are these changes needed?

Update the nlp notebook:

  • Replaced the sentiment classification & model selection example with Colab built in GPU experiment.
  • Rerun multiple choice and text summarization on Ray Tune with 4 V100 GPU.

Related issue number

Checks

notebook/automl_nlp.ipynb Outdated Show resolved Hide resolved
"Requirement already satisfied: tenacity>=6.2.0 in /usr/local/lib/python3.7/dist-packages (from plotly->catboost>=0.26->flaml[blendsearch,nlp,notebook]) (8.0.1)\n",
"Requirement already satisfied: qtpy>=2.0.1 in /usr/local/lib/python3.7/dist-packages (from qtconsole->jupyter->flaml[blendsearch,nlp,notebook]) (2.2.0)\n",
"Requirement already satisfied: absl-py in /usr/local/lib/python3.7/dist-packages (from rouge-score->flaml[blendsearch,nlp,notebook]) (1.2.0)\n"
]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clear this cell's output?

"id": "2XZmrBRru_A0"
},
"source": [
"Let's will run FLAML for 30 mins. Here we will Electra's [small model](https://huggingface.co/google/electra-small-discriminator) for the tuning. We set gpu_per_trial to 1, and n_concurrent_trials to 1 (the number of trials running at the same time). Make sure gpu_per_trial * n_concurrent_trials does not exceed the GPU number you have. While running you can observe the resource usage (including the GPU) on the right. "
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
"Let's will run FLAML for 30 mins. Here we will Electra's [small model](https://huggingface.co/google/electra-small-discriminator) for the tuning. We set gpu_per_trial to 1, and n_concurrent_trials to 1 (the number of trials running at the same time). Make sure gpu_per_trial * n_concurrent_trials does not exceed the GPU number you have. While running you can observe the resource usage (including the GPU) on the right. "
"Let's run FLAML for 30 mins. Here we use Electra's [small model](https://huggingface.co/google/electra-small-discriminator) for the tuning. We set gpu_per_trial to 1, and n_concurrent_trials to 1 (the number of trials running at the same time). Make sure gpu_per_trial * n_concurrent_trials does not exceed the GPU number you have. While running you can observe the resource usage (including the GPU) on the right. "

@qingyun-wu
Copy link
Contributor

When the PR is approved, can you please also make sure changes in this notebook are also included in the tutorial branch? Also can you add a version number at the end of this line pip install flaml[nlp,notebook,blendsearch] in the notebook (similar to the pip install in this notebook: https://github.com/microsoft/FLAML/blob/tutorial/notebook/automl_classification.ipynb) in the tutorial branch?

Thank you!

@liususan091219 liususan091219 merged commit 2ead296 into microsoft:main Aug 22, 2022
@liususan091219 liususan091219 deleted the nlp_notebook branch August 22, 2022 11:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants