fix: FakeTensors appearing in get_attr calls

[gs-olive]

Description

• Register all constants as model parameters, which do not get fake-ified by the active FakeTensor context
• Buffers and other constant registrations can be fake-ified, which is problematic for TRT tracing

Fixes #2658

Type of change

Please delete options that are not relevant and/or add your own.

• Bug fix (non-breaking change which fixes an issue)

Checklist:

• [ x ] My code follows the style guidelines of this project (You can use the linters)
• [ x ] I have performed a self-review of my own code
• [ x ] I have commented my code, particularly in hard-to-understand areas and hacks
• [ x ] I have made corresponding changes to the documentation
• [ - ] I have added tests to verify my fix or my feature
  • Pending CI verification on existing models
• [ x ] New and existing unit tests pass locally with my changes
• [ x ] I have added the relevant labels to my PR in so that relevant reviewers are notified

[zewenli98]

Looks good to me! I'm just wondering if PyTorch has documentation to illustrate what kind of types will be fake-ified?

[gs-olive]

Thanks for the review - I haven't found any concrete documentation on this topic; this is mainly a workaround that I've found to work for a few key models and not break others. This documentation on FakeTensor is what I am using currently.

[bowang007]

LGTM.

[bowang007]

@gs-olive can you merge this one?
This can make us a lot easier every time using the nightly container.
Thanks!

[gs-olive]

Since testing is not working in CI, running the Dynamo test suite locally to verify

[peri044]

LGTM