Make fx traced model with the use of past_key_values
pickable again?
#30575
Labels
Compilation
Issues related to torchdynamo and torchinductor
With the support of the
transformers.cache_utils.Cache
classes when doing symbolic trace (#30259), it is not possible to pickle a traced model which usespast_key_values
, should we work to add support for that?The text was updated successfully, but these errors were encountered: