[Misc] Reduce supported Punica dtypes

[WoosukKwon]

This PR reduces the supported dtype combinations in Punica to reduce the binary size.

[youkaichao]

maybe we can add some file size check in docker file, since we already have the wheel inside the docker image.

[simon-mo]

OSError: We couldn't connect to 'https://huggingface.co' to load this file, couldn't find it in the cached files and it looks like facebook/opt-125m is not the path to a directory containing a file named config.json.

Huggingface down again :( I guess we can't release today...

[Yard1]

I am pretty sure we need the fp16/bf16->fp32 and fp32->fp16/bf16 ones, as fp32 is used in the intermediate buffer between shrink and expand calls.

[WoosukKwon]

BTW, this PR is not ready yet. I need to check if I pruned the right dtype combinations. Now it seems it passes the Punica test.

[WoosukKwon]

@Yard1 Yes, I just figured it out and fixed it. Could you please take another look?

[mgoin]

Good call, +1 on measuring and clearly auditing what is contributing to the size of the wheel

[Yard1]

I think we may be using fp32 for testing