Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump gradio from 4.17.0 to 4.19.2 in /prompt_translation/dashboard_template #2

Closed
23 changes: 20 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,13 +27,13 @@ Our first DIBT activity is focused on ranking the quality of prompts. We have al

There are not enough language-specific benchmarks for open LLMs! We want to create a leaderboard for more languages by leveraging the community! You can find more information about this project in the [MPEP README](prompt_translation/README.md).

### 3. Creating a dashboard for tracking the translation efforts
#### 2.1 Creating a dashboard for tracking the translation efforts

Once you have your annotation suite running on a Hugging Face Space, you can easily set up a dashboard to track the annotation effort. Follow the steps in [`03_create_dashboard.ipynb`](./prompt_translation/03_create_dashboard.ipynb) to set up one for the language you are working on.

You can also check the status of all translation efforts in our [Multilingual Dashboard](https://huggingface.co/spaces/DIBT/PromptTranslationMultilingualDashboard).
You can also check the status of all translation efforts in our [Multilingual Dashboard](https://huggingface.co/spaces/DIBT/PromptTranslationMultilingualDashboard). Do you want the language you're working on to be added there? Then you can reach out to @davidberenstein1957 (David Berenstein), @.dvs13 (Daniel van Strien) and @ignacioct (Ignacio Talavera) in the 🤗 [Hugging Face Discord Channel](https://discord.gg/hugging-face-879548962464493619).

#### Contribute translations
##### Contribute translations

*Want to contribute translations?* Currently, these translation efforts are underway:

Expand All @@ -51,6 +51,23 @@ You can also check the status of all translation efforts in our [Multilingual Da
- [Portuguese](https://dibt-portuguese-prompt-translation-for-portuguese.hf.space)
- [Cantonese](https://dibt-cantonese-prompt-translation-for-cantonese.hf.space/)

*Want to work on a language that's not listed?* You can follow the steps to set up a new annotation effort by going to `prompt_translation/` and checking out the three notebooks:

- In the first one, you'll learn how to set up a prompt translation space using Argilla and Hugging Face Spaces.
- In the second one, you'll see how to upload the prompt translation data for the language of your choice.
- In the third one, we show how to easily set up a dashboard to track the annotation efforts.

#### 2.2 CRON jobs for data exports

To register your dataset within https://huggingface.co/DIBT and avoid overlapping responses, we also recommend you to reach out to @davidberenstein1957 (David Berenstein), @.dvs13 (Daniel van Strien) and @ignacioct (Ignacio Talavera) in the 🤗 [Hugging Face Discord Channel](https://discord.gg/hugging-face-879548962464493619). They will congigure a CRON job in this [GitHub repo](https://github.com/argilla-io/dataset-cron-refresh) to safely export your data and share it with the world :)

#### 2.3 Fix dashboard after CRON jobs addition and dashboard cache removal

We have outlined 2 more steps to update the workspace after an update in step 2.1 and the addition of step 2.2.

- 2.1) In order to avoid caching information and always having an up to date dashboard, we've introduced a fix in the dashboard template. You can either delete the current dasboard and create a new one or reproduce the [PR fix](https://github.com/huggingface/data-is-better-together/commit/a52fbe9b97e43aeca497faf02dccd0dec7dbe070) for the dashboard template.
- 2.2) After having configured the CRON job, data is exported to the "owner" workspace, hence the workspace used for the dashboard needs to be updated by setting the workspace environment variable equal to "owner" (minus the accolades).

## Other guides

The Data is Better Together community has created several guides to support efforts to create valuable datasets via the open source community. Currently, we have the following guides:
Expand Down
4 changes: 3 additions & 1 deletion prompt_translation/01_setup_prompt_translation_space.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -67,6 +67,8 @@
"3. Setup the Space secrets\n",
"4. Load the DIBT data into the Argilla Space\n",
"5. Begin translating the data!\n",
"6. Create a dashboard\n",
"7. Configure a CRON job for data exports\n",
"\n",
"\n",
"This notebook will walk through step 1-3. Some of the steps are done using the `huggingface_hub` CLI, other parts of the process can only be done in the UI, but we will also show how to do them using the API.\n",
Expand Down Expand Up @@ -489,7 +491,7 @@
"source": [
"## Next step\n",
"\n",
"Once you have gotten the confirmation that the above steps have been completed, we can move to the next notebook and upload the data to the Argilla Space."
"Once you have gotten the confirmation that the above steps have been completed, we can move to the next notebook and upload the data to the Argilla Space. To get registered within the main prompt dashboard and configure a CRON job for data exports recommend you to contact @davidberenstein1957 (David Berenstein), @.dvs13 (Daniel van Strien) and @ignacioct (Ignacio Talavera) in the 🤗 Hugging Face [Discord Channel](https://discord.gg/hugging-face-879548962464493619)."
]
}
],
Expand Down
2 changes: 1 addition & 1 deletion prompt_translation/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -61,7 +61,7 @@ An automatic approach to evaluating instruction-following models. It uses LLM-ba

### How can I keep track of the overall progress of the translation effort?

The best way to track the progress of your translation effort is to set up the progress dashboard. You can find instructions on how to do this [here](./prompt_translation/03_create_dashboard.ipynb). This will allow you to monitor the progress of the translation task and see how many prompts have been translated as well as the number of people who have contributed to the translation effort.
The best way to track the progress of your translation effort is to set up the progress dashboard. You can find instructions on how to do this [here](./prompt_translation/03_create_dashboard.ipynb). This will allow you to monitor the progress of the translation task and see how many prompts have been translated as well as the number of people who have contributed to the translation effort. There also is a [multi-lingual dashboard](https://huggingface.co/spaces/DIBT/PromptTranslationMultilingualDashboard) to which your credential can be added by contacting David Berenstein (Argilla) or Daniel van Strien (Hugging Face).

### Should translations use local examples or be as accurate as possible?

Expand Down
2 changes: 1 addition & 1 deletion prompt_translation/dashboard_template/requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ ffmpy==0.3.1
filelock==3.13.1
fonttools==4.48.1
fsspec==2024.2.0
gradio==4.17.0
gradio==4.19.2
gradio_client==0.9.0
h11==0.14.0
httpcore==1.0.2
Expand Down