Add score_pruning_activations (step 2/6)

[danielkorzekwa]

What does this PR do?

• Add score_pruning_activations.py

Notes:

• validate_model.py still depends on Nvidia internal code (will be changed in the subsequent MR)
• sharded_checkpoint_utils.py - for now it needs to use DeciLM from internal Nvidia code, to be changed in the next MR

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 74.37%. Comparing base (b121945) to head (54c1505).
⚠️ Report is 57 commits behind head on feature/compress.

Additional details and impacted files

@@                 Coverage Diff                  @@
##           feature/compress     #563      +/-   ##
====================================================
+ Coverage             73.40%   74.37%   +0.96%     
====================================================
  Files                   180      182       +2     
  Lines                 18127    18219      +92     
====================================================
+ Hits                  13306    13550     +244     
+ Misses                 4821     4669     -152     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[kevalmorabia97]

Thanks for the PR. It still needs some improvement before we can merge. Lets make sure we remove anything not needed for score_pruning_activations, remove pickle usage, remove outdated things (e.g. lit-llama support, quantization, etc.), review docstrings and update outdated things there.