Cookbook recipe for demos with Gradio. #133

dmaniloff · 2024-06-29T22:20:26Z

What does this PR do?

Recipe to create demos with Gradio for the HF Enterprise Cookbook.

Who can review?

@stevhliu

review-notebook-app · 2024-06-29T22:20:32Z

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

dmaniloff · 2024-06-29T22:20:48Z

cc/ @MoritzLaurer

HuggingFaceDocBuilderDev · 2024-06-29T22:22:06Z

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

notebooks/en/enterprise_cookbook_gradio.ipynb

merveenoyan · 2024-07-01T10:31:44Z

notebooks/en/enterprise_cookbook_gradio.ipynb

@@ -0,0 +1,5796 @@
+{


BTW one thing cool about gradio is it has direct integration with transformers, so you can call gr.Interface.load() here instead of calling pipeline and then Interface. and for more complex second part you could do a bare function and then pass inside Interface.

Reply via ReviewNB

By this you mean direct integration with the Hub right? Ie load works for models in the hub already.

I wanted to feature this as well (in fact it was part of my original writeup) but I ended up thinking it would make this recipe too long. Maybe I can add a TIP mention in this part to point readers to the load feature.

Actually this fails

gr.load( "distil-whisper/distil-large-v3", src="models", inputs=gr.Audio(type="filepath"), # "filepath" passes a str path to a temporary file containing the audio outputs=gr.Textbox(show_copy_button=True), # give users the option to copy the results).launch() ).launch(debug=True)

w/ the following traceback:

Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/gradio/queueing.py", line 532, in process_events response = await route_utils.call_process_api( File "/usr/local/lib/python3.10/dist-packages/gradio/route_utils.py", line 276, in call_process_api output = await app.get_blocks().process_api( File "/usr/local/lib/python3.10/dist-packages/gradio/blocks.py", line 1928, in process_api result = await self.call_function( File "/usr/local/lib/python3.10/dist-packages/gradio/blocks.py", line 1514, in call_function prediction = await anyio.to_thread.run_sync( File "/usr/local/lib/python3.10/dist-packages/anyio/to_thread.py", line 33, in run_sync return await get_asynclib().run_sync_in_worker_thread( File "/usr/local/lib/python3.10/dist-packages/anyio/_backends/_asyncio.py", line 877, in run_sync_in_worker_thread return await future File "/usr/local/lib/python3.10/dist-packages/anyio/_backends/_asyncio.py", line 807, in run result = context.run(func, *args) File "/usr/local/lib/python3.10/dist-packages/gradio/utils.py", line 832, in wrapper response = f(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/gradio/external.py", line 371, in query_huggingface_inference_endpoints data = fn(*data) # type: ignore File "/usr/local/lib/python3.10/dist-packages/huggingface_hub/inference/_client.py", line 415, in automatic_speech_recognition response = self.post(data=audio, model=model, task="automatic-speech-recognition") File "/usr/local/lib/python3.10/dist-packages/huggingface_hub/inference/_client.py", line 273, in post hf_raise_for_status(response) File "/usr/local/lib/python3.10/dist-packages/huggingface_hub/utils/_errors.py", line 371, in hf_raise_for_status raise HfHubHTTPError(str(e), response=response) from e huggingface_hub.utils._errors.HfHubHTTPError: 413 Client Error: Payload Too Large for url: https://api-inference.huggingface.co/models/distil-whisper/distil-large-v3 (Request ID: eWMj4weC7hhXnrCKf_p-d)

apparently in recent version of gradio this was swapped with from_pipeline which is essentially transformers integration for gradio. it doesn't need to call any API whatsoever it just loads the model and the pipeline into an Interface by inferring their i/o

thank you! added a TIP highlighting that constructor

notebooks/en/enterprise_cookbook_gradio.ipynb

merveenoyan · 2024-07-01T10:31:44Z

notebooks/en/enterprise_cookbook_gradio.ipynb

@@ -0,0 +1,5796 @@
+{


at the end they should call launch with no share we should mention it

Reply via ReviewNB

not sure what you are referring to here re: share?

I meant one does demo.launch(share=True) when you want to set a tunnel, but this shouldn't be when gradio is ran in Spaces.

merveenoyan · 2024-07-01T10:31:44Z

notebooks/en/enterprise_cookbook_gradio.ipynb

@@ -0,0 +1,5796 @@
+{


I'd add this at the end, I feel like further readings in middle of pages divert readers' attention a lot

Reply via ReviewNB

merveenoyan · 2024-07-01T10:31:44Z

notebooks/en/enterprise_cookbook_gradio.ipynb

@@ -0,0 +1,5796 @@
+{


I would also add an intro to Blocks API to this recipe, it's more fundamental than features like flagging IMHO

Reply via ReviewNB

skipping this.

merveenoyan

left very general comments, thank you for this recipe!

notebooks/en/enterprise_cookbook_gradio.ipynb

stevhliu · 2024-07-01T16:29:22Z

notebooks/en/enterprise_cookbook_gradio.ipynb

@@ -0,0 +1,5796 @@
+{


Might also be nice to link directly to the text and slider components

Reply via ReviewNB

notebooks/en/enterprise_cookbook_gradio.ipynb

stevhliu

Very nice demonstration of a transcription tool! 👏

notebooks/en/_toctree.yml

notebooks/en/enterprise_cookbook_gradio.ipynb

This reverts commit bae2d39.

stevhliu

Cool! I think once the toctree is resolved, we can merge! 🥳

Cookbook recipe for demos with Gradio.

5afdecb

merveenoyan reviewed Jul 1, 2024

View reviewed changes

stevhliu reviewed Jul 1, 2024

View reviewed changes

notebooks/en/_toctree.yml Outdated Show resolved Hide resolved

MoritzLaurer reviewed Jul 3, 2024

View reviewed changes

notebooks/en/enterprise_cookbook_gradio.ipynb Show resolved Hide resolved

dmaniloff added 17 commits July 4, 2024 13:24

title update

846f4d3

no need to install the hub library.

daa489f

fix headings.

bd0dfb4

"transcription" & fix headings.

7023df9

include gradio link at top.

7f30a06

assertive wording.

50b538e

try it out sentece before launch.

5292e94

clickable link.

6594f2c

disclosure.

ff52e04

infclient & encourage fine-trained tokens.

dcb478a

contents of app & requirements.

f0188b7

tip.

2a35135

typo.

5f1ae2f

typo.

738e2e3

link to Audio component.

fdd7d3e

make it a list.

e88614e

further reading at the bottom.

c943e8e

dmaniloff requested review from MoritzLaurer, stevhliu and merveenoyan July 4, 2024 19:50

load alternative.

bae2d39

Revert "load alternative."

346832c

This reverts commit bae2d39.

stevhliu approved these changes Jul 8, 2024

View reviewed changes

dmaniloff added 2 commits July 8, 2024 13:56

Add tip for from_interface

cb9fca6

Merge branch 'main' into enterprise-cookbook-gradio

f62348c

stevhliu merged commit 05199cb into huggingface:main Jul 8, 2024
1 check passed

dmaniloff mentioned this pull request Jul 8, 2024

Enterprise cookbook gradio fixes #141

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Cookbook recipe for demos with Gradio. #133

Cookbook recipe for demos with Gradio. #133

dmaniloff commented Jun 29, 2024

review-notebook-app bot commented Jun 29, 2024

dmaniloff commented Jun 29, 2024

HuggingFaceDocBuilderDev commented Jun 29, 2024

merveenoyan Jul 1, 2024 •

edited

Loading

dmaniloff Jul 4, 2024

dmaniloff Jul 4, 2024 •

edited

Loading

merveenoyan Jul 5, 2024

dmaniloff Jul 8, 2024

merveenoyan Jul 1, 2024 •

edited

Loading

dmaniloff Jul 4, 2024

merveenoyan Jul 5, 2024

merveenoyan Jul 1, 2024 •

edited

Loading

merveenoyan Jul 1, 2024 •

edited

Loading

dmaniloff Jul 4, 2024

merveenoyan left a comment

stevhliu Jul 1, 2024 •

edited

Loading

stevhliu left a comment

stevhliu left a comment

Cookbook recipe for demos with Gradio. #133

Cookbook recipe for demos with Gradio. #133

Conversation

dmaniloff commented Jun 29, 2024

What does this PR do?

Who can review?

review-notebook-app bot commented Jun 29, 2024

dmaniloff commented Jun 29, 2024

HuggingFaceDocBuilderDev commented Jun 29, 2024

merveenoyan Jul 1, 2024 • edited Loading

Choose a reason for hiding this comment

dmaniloff Jul 4, 2024

Choose a reason for hiding this comment

dmaniloff Jul 4, 2024 • edited Loading

Choose a reason for hiding this comment

merveenoyan Jul 5, 2024

Choose a reason for hiding this comment

dmaniloff Jul 8, 2024

Choose a reason for hiding this comment

merveenoyan Jul 1, 2024 • edited Loading

Choose a reason for hiding this comment

dmaniloff Jul 4, 2024

Choose a reason for hiding this comment

merveenoyan Jul 5, 2024

Choose a reason for hiding this comment

merveenoyan Jul 1, 2024 • edited Loading

Choose a reason for hiding this comment

merveenoyan Jul 1, 2024 • edited Loading

Choose a reason for hiding this comment

dmaniloff Jul 4, 2024

Choose a reason for hiding this comment

merveenoyan left a comment

Choose a reason for hiding this comment

stevhliu Jul 1, 2024 • edited Loading

Choose a reason for hiding this comment

stevhliu left a comment

Choose a reason for hiding this comment

stevhliu left a comment

Choose a reason for hiding this comment

merveenoyan Jul 1, 2024 •

edited

Loading

dmaniloff Jul 4, 2024 •

edited

Loading

merveenoyan Jul 1, 2024 •

edited

Loading

merveenoyan Jul 1, 2024 •

edited

Loading

merveenoyan Jul 1, 2024 •

edited

Loading

stevhliu Jul 1, 2024 •

edited

Loading