Download model without loading

[BobaZooba]

Description

User had insufficient RAM for the prepare step at xllm-demo project, it arises because, during this step, the model is downloaded and loaded into RAM. This approach is suboptimal, redundant, and may lead to similar instances that you've experienced. Simply downloading the model will suffice.

Type of Change

• 📚 Examples / docs / tutorials / dependencies update
• 🔧 Bug fix (non-breaking change which fixes an issue)
• 🥂 Improvement (non-breaking change which improves an existing feature)
• 🚀 New feature (non-breaking change which adds functionality)
• 💥 Breaking change (fix or feature that would cause existing functionality to change)
• 🔐 Security fix

Checklist

• I've updated the code style using make codestyle.
• I've written tests for all new methods and classes that I created.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (bb2b5a6) 80.2% compared to head (4aa17cb) 80.2%.

Additional details and impacted files

@@           Coverage Diff           @@
##            main     #13     +/-   ##
=======================================
- Coverage   80.2%   80.2%   -0.0%     
=======================================
  Files         38      38             
  Lines       1357    1356      -1     
=======================================
- Hits        1088    1087      -1     
  Misses       269     269             

Flag	Coverage Δ
unit	80.2% <100.0%> (-<0.1%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.