Fix llama runner build

[neuropilot-captain]

Redirect third-party lib (abseil-cpp, re2) source to 'extension'

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/4817

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 27 New Failures, 1 Unrelated Failure

As of commit 45f66eb with merge base 8471c22 ():

NEW FAILURES - The following jobs have failed:

• Build documentation / build (buck2) / Build doc (gh)
  RuntimeError: Command docker exec -t 6d4ad14e82457cd1e830e38af48c7f2728f30d1a0abdd0a2b70ea95ec4ffda03 /exec failed with exit code 1
• pull / test-binary-size-linux / linux-job (gh)
  RuntimeError: [2024-08-26T01:54:34.287+00:00] Build ID: 379b64a5-febb-423e-8a92-fef7fd9764ab
• pull / test-binary-size-linux-gcc / linux-job (gh)
  RuntimeError: Command docker exec -t afdb18321d08255855a1c241703f939d8c099030ad0a3b8f1ae149e8ae50bc09 /exec failed with exit code 1
• pull / test-custom-ops-linux (buck2) / linux-job (gh)
  RuntimeError: Command docker exec -t 888eead9303f5222bf0a352a712a8f6553dd4a0f523fad9a6bfba90908a2b478 /exec failed with exit code 1
• pull / test-custom-ops-linux (cmake) / linux-job (gh)
  RuntimeError: Command docker exec -t 072958232ff8745f5d9fbd78346b7b97bd749702d6c445b2d77f023e66ad3ec6 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, buck2, portable) / linux-job (gh)
  RuntimeError: Command docker exec -t f14321a143c8297520c5f17be38b00759be7388b12752179f10edeac681b45f0 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, buck2, xnnpack+custom) / linux-job (gh)
  RuntimeError: Command docker exec -t 7c8c72a0e363946f9c681cf13bcea3e6bc72c8c753202a83d695348bbfc13473 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, buck2, xnnpack+custom+qe) / linux-job (gh)
  RuntimeError: Command docker exec -t 0d66ff41ce217972ea68ed9e9444b7ef4367b17811e01edf2d88281ad899046b /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, cmake, portable) / linux-job (gh)
  RuntimeError: Command docker exec -t e35a94e4689a84229acc96bcf61dc606c68398d3bbf9290a38a7fed25cdf39f0 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, cmake, xnnpack+custom) / linux-job (gh)
  RuntimeError: Command docker exec -t f9791e2a3206d6c5ddb95b294581983d0297afc1bf69c2f9eed5dd7f080b3c22 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, cmake, xnnpack+custom+qe) / linux-job (gh)
  RuntimeError: Command docker exec -t f94cd952c924129d4148672203acca1dc02ec86a0a74e623e1688bdcab1bfd08 /exec failed with exit code 1
• pull / test-llama-runner-linux-android (cmake) / linux-job (gh)
  RuntimeError: [2024-08-26T01:55:04.776+00:00] Build ID: 7cd41f28-dbf3-4764-9ecb-14639b513cc2
• pull / test-llama-runner-qnn-linux (fp32, cmake, qnn) / linux-job (gh)
  RuntimeError: [2024-08-26T01:55:38.303+00:00] Build ID: 784d7e82-09a3-4b56-8157-3f36a26d304b
• pull / test-llava-runner-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 886b418c4662bf7d745e32f3638b11ca9bc479b7b5986b0f094cd18f95b481a7 /exec failed with exit code 1
• pull / test-models-linux (buck2, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t 8cdaed321b5824fa3b2a41c16159dee75647e41e2cc527940f2ffc0d0e22faa4 /exec failed with exit code 1
• pull / test-models-linux (buck2, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t f055ebfeb882c921133a387a6c03459dd6bebf52c441df637f432f16acf30366 /exec failed with exit code 1
• pull / test-models-linux (cmake, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t 44e03af155f979ac42d453a0946ba05ca7b6c01105b4594819e367aaf06d674c /exec failed with exit code 1
• pull / test-models-linux (cmake, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t ff2679eb7a2afff13554e123edab67d4d6fe488a8412bdc1a4fa36e71798f147 /exec failed with exit code 1
• pull / test-models-linux (cmake, vit, portable, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t 55ac20fb32595ac653c7c3330b534bd0b7cee596f3449b1274c47bcfa8537dea /exec failed with exit code 1
• pull / test-models-linux (cmake, vit, xnnpack-delegation, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t 941191f2b7d7c8cdb09779b410952b25f7f8e19f5bba4eec7822c8de5b4a0235 /exec failed with exit code 1
• pull / test-pybind-build-linux (cmake) / linux-job (gh)
  RuntimeError: Command docker exec -t 7c01e00cf9d5070a71195d1483d3ebc3c02f9556bff404f6839c8612891ee081 /exec failed with exit code 1
• pull / test-quantized-aot-lib-linux (cmake) / linux-job (gh)
  RuntimeError: Command docker exec -t 743a34836a3f21453a723f12784cff43b0b17dc7c897dc0addfc0100b374dda7 /exec failed with exit code 1
• pull / test-selective-build-linux (buck2) / linux-job (gh)
  RuntimeError: Command docker exec -t d3a358df975fe7372fcc8f9117fe7d0fb453ea0d0ff7b43c90acf606a844d33e /exec failed with exit code 1
• pull / test-selective-build-linux (cmake) / linux-job (gh)
  RuntimeError: Command docker exec -t a5fb563608ac3a160245220106cbbce5c1b14bbc411db53400dfd662cdebe590 /exec failed with exit code 1
• pull / test-setup-linux-gcc (cmake) / linux-job (gh)
  RuntimeError: Command docker exec -t 6ddf3958ac52519e95b580781d819d88af0648eec472b53ca4a8f3b0ca82acb8 /exec failed with exit code 1
• pull / unittest / linux / linux-job (gh)
  RuntimeError: Command docker exec -t 840516469d9a481ba8dfdef474a6faacaeb2ab8c24ed882bde8fbf8d0892885e /exec failed with exit code 1
• pull / unittest-arm (buck2) / linux-job (gh)
  RuntimeError: Command docker exec -t 5b7a4db76ed36bb8fdfa1f694c7b33ab38ccdf9306e00f87cea5ef8600ed576d /exec failed with exit code 1

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• pull / unittest / macos / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[kirklandsign]

Could you please fix linter error?

#include <executorch/examples/models/llama2/tokenizer/llama_tiktoken.h>
#include <executorch/extension/llm/tokenizer/bpe_tokenizer.h>
#include <executorch/extension/llm/tokenizer/tiktoken.h>

[neuropilot-captain]

No problem

[digantdesai]

Seems like the linter job is still failing?

[kirklandsign]

Seems like the linter job is still failing?

Needs a rebase. I wouldn't worry about this one. It doesn't touch java code

[cccclai]

Thanks for the fix.

[cccclai]

Looks like unrelated CI failure