[CI] clear ~/.cache/torch_extensions
between builds
#14520
Merged
~/.cache/torch_extensions
between builds
#14520