Refactor custom SDPA op to separate kv cache update from the custom sdpa op

[kimishpatel]

Stack from ghstack (oldest at bottom):

• [Executorch][quant] Optimize per channel dequantize #5622
• [Executorch][llama] Add custom_sdpa and use that instead of sdpa_with_kv_cache #5621
• [Executorch] Update EXECUTORCH_LIBRARY macro #5620
• [Executorch][llama] Refactoring sdpa #5619
• [Executorch][llama] Update SDPA op to use quantized kv cache #5618
• Add update_quantized_cache op #5527
• -> Refactor custom SDPA op to separate kv cache update from the custom sdpa op #5617
• [ExecuTorch] Add quantized kv cache to llama #5616
• Fix dequantize per channel to handle double scale type #5524
• [ExecuTorch] Some updated to kv cache #5615

Differential Revision: D62301837

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/5617

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 6 New Failures

As of commit 73bf0b5 with merge base b2517d6 ():

NEW FAILURES - The following jobs have failed:

• pull / test-llama-runner-linux (bf16, buck2, portable) / linux-job (gh)
  RuntimeError: Command docker exec -t 3513a8174909ef086355934d47b8eaced0c15d9b7c36347906011c8543cce3e2 /exec failed with exit code 3
• pull / test-llama-runner-linux (fp32, buck2, portable) / linux-job (gh)
  RuntimeError: Command docker exec -t 73100f07644e1378e9e39a5f55175e9d46e053cd60aef9a20b342c54fa0e44bb /exec failed with exit code 3
• pull / test-llama-runner-linux (fp32, buck2, xnnpack+custom) / linux-job (gh)
  RuntimeError: Command docker exec -t 82969e0f865560af7e13f54b3b086b552c288d72dd8238574289c0e3940b683f /exec failed with exit code 3
• pull / test-llama-runner-linux (fp32, buck2, xnnpack+custom+qe) / linux-job (gh)
  RuntimeError: Command docker exec -t 2a9285dbd267c2b8cd0fce621841afb62f23474fb4cf840e0b9b276fd84e12a9 /exec failed with exit code 3
• pull / unittest / linux / linux-job (gh)
  kernels/quantized/test/test_quant_dequant_per_token.py::QuantizePerTokenTest::test_quantize_per_token_high_rank
• pull / unittest / macos / macos-job (gh)
  kernels/quantized/test/test_quant_dequant_per_token.py::QuantizePerTokenTest::test_quantize_per_token_large_tensor

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D62301837