Mirror all weights on HF from Kaggle

[divyashreepathihalli]

• Automated Detection of Missing Uploads on HF assuming Kaggle is our source of truth
• The JSON file keeps track of the most up to date uploaded presets on HuggingFace
• Everytime the mirroring script is run, the missing presets are uploaded on HF and the tracking JSON is updated
• Gemma model preset uploads are skipped since the keras variants are uploaded through the main Google account

[SamanehSaadat]

Thanks, Divya! The automatic sync would be very helpful!
Just left some nit comments.

[SamanehSaadat]

Are we planning to run this script automatically?

[divyashreepathihalli]

It is a good idea to set it up to run automatically once a day. For now it is run manually.

[SamanehSaadat]

These have already been uploaded?

[divyashreepathihalli]

That is right

[SamanehSaadat]

Thanks, Divya!