[GH Actions] Build PyTorch without FA for memory usage (#334)

Build PyTorch with FA for memory usage

Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

.github/workflows/build.yml

@@ -20,7 +20,7 @@ jobs:
         with:
           submodules: recursive
       - name: 'Build'
-        run: pip install . -v
+        run: pip install . -v --no-deps
         env:
           NVTE_FRAMEWORK: pytorch
           MAX_JOBS: 1