Investigate large compilation time for `hf_t5_large`

[anijain2305]

[anijain2305]

Repro - https://gist.github.com/anijain2305/11daefea5c2538fa1bfc49a8a26135de

This takes roughly 400 seconds to compile. There is a bad looking kernel here - https://gist.github.com/anijain2305/b713d3d04093ac78813e820d5e73fc31

Trying to prevent accumulation of large amount of code in just 1 kernel.