CI: Restore the old test matrix size

[leofang]

Follow-up of #1315. For convenience our test matrix was inflated during the CUDA 13.1 bring-up. But we really don't need to test 3 CUDA versions for each Python version. The old test matrix can be restored to achieve the same goal.