Use .bin extension for tokenizer.

[shoumikhin]

Summary: .

Differential Revision: D63927363

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/5907

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures

As of commit d7e3655 with merge base 1052e3b ():

NEW FAILURES - The following jobs have failed:

• Apple / build-benchmark-app / macos-job (gh)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
• Apple / build-demo-ios / macos-job (gh)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
• Apple / upload-frameworks-ios (gh)
  ##[error]Credentials could not be loaded, please check your action inputs: Could not load credentials from any providers

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D63927363

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D63927363

[facebook-github-bot]

This pull request has been merged in 2f9f94a.

[shoumikhin]

@pytorchbot cherry-pick --onto release/0.4 -c fixnewfeature

[pytorchbot]

Cherry picking #5907

Command git -C /home/runner/work/executorch/executorch cherry-pick -x -X theirs 2f9f94a0625addb998c4b33d26603d45ca9ea5f3 returned non-zero exit code 1

Auto-merging extension/apple/Benchmark/Benchmark.xcodeproj/project.pbxproj
CONFLICT (modify/delete): extension/apple/Benchmark/Tests/LLaMA/LLaMATests.mm deleted in HEAD and modified in 2f9f94a06 (Use .bin extension for tokenizer. (#5907)).  Version 2f9f94a06 (Use .bin extension for tokenizer. (#5907)) of extension/apple/Benchmark/Tests/LLaMA/LLaMATests.mm left in tree.
error: could not apply 2f9f94a06... Use .bin extension for tokenizer. (#5907)
hint: After resolving the conflicts, mark them with
hint: "git add/rm <pathspec>", then run
hint: "git cherry-pick --continue".
hint: You can instead skip this commit with "git cherry-pick --skip".
hint: To abort and get back to the state before "git cherry-pick",
hint: run "git cherry-pick --abort".
hint: Disable this message with "git config advice.mergeConflict false"

Details for Dev Infra team

Raised by workflow job