Should huggingface_hub be added to requirements.txt?

[emilesilvis]

No description provided.

[carmocca]

Downloading weights is not strictly required to use the project. For instance, to pretrain the model.

This is why that package is not part of requirements.txt

[emilesilvis]

Makes sense! If desired, I can edit the README to add pip install huggingface_hub where required.

[carmocca]

Good idea. But you should add it to the howtos about downloading data, not the README

[emilesilvis]

#97

[nahakiole]

I ran into the issue after following the tutorial here again: https://lightning.ai/pages/blog/falcon-a-guide-to-finetune-and-inference/

Maybe a idea would be to use the extras_require feature in the setup.py and create multiple versions?

extras_require={
    'download':  ['huggingface_hub'],  # These are additional requirements for the "download" version
},

Then we could add pip install .[download] to the documentation.
I think it would be important to add this in the main readme.md.