Creating this issue for the sake of keep tracking the issue and come back later to resolve it. In #1559, we tried forcing GPU tests in Windows. Turned out that GPU driver that CircleCI provides as default in windows-gpu
executor is too old to run GPU operation from PyTorch nightly. We need to fix this.
cc @NicolasHug @malfet @seemethere