Avoid OOM for large GEMM 32k & modify layernorm cutile

[hannahli-nv]

Description

Update codes.

This PR contains 2 new commit(s).

Commits included:

a3a32ef modify layernorm cutile
31db13c Avoid OOM for large GEMM 32k

CI Configuration

config:
  build: true
  # valid options are "ops" and "benchmark"
  test: ["ops", "benchmark"]

Checklist

• Code formatted and imports sorted via repo specifications (./format.sh)
• Documentation updated (if needed)
• CI configuration reviewed

[copy-pr-bot]

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

[hannahli-nv]

/ok to test b6144d5

[xjmxyt]

LGTM

[hannahli-nv]

/ok to test a3a32ef