Separate CoreML util and inmemoryfs targets to be reusable

[jathu]

Summary

In this diff, we separate the targets for coreml/runtime/util and coreml/runtime/inmemoryfs.

Why?

As part of #9019, we want to support CoreML export out-of-the-box. Unfortunately, part of the workflow now includes installing an executorch+coreml binding as a pip wheel:

executorch/backends/apple/coreml/scripts/install_inmemoryfs.sh

Line 20 in 5fdfa51

pip install "$COREML_DIR_PATH/runtime/inmemoryfs"

This then gets used throughout the library. i.e.

executorch/backends/apple/coreml/compiler/coreml_preprocess.py

Line 19 in 5fdfa51

import executorchcoreml

So we want to now bake this pybinding into the main wheel. Ultimately this executorchcoreml module, gets built using inmemoryfs:

executorch/backends/apple/coreml/runtime/inmemoryfs/setup.py

Lines 17 to 38 in 5fdfa51

	ext_modules = [
	Pybind11Extension(
	"executorchcoreml",
	[
	"../util/json_util.cpp",
	"inmemory_filesystem.cpp",
	"inmemory_filesystem_py.cpp",
	"inmemory_filesystem_utils.cpp",
	"memory_buffer.cpp",
	"memory_stream.cpp",
	"reversed_memory_stream.cpp",
	],
	define_macros=[("VERSION_INFO", __version__)],
	cxx_std=cxx_std,
	extra_compile_args=["-mmacosx-version-min=10.15", "-g"],
	include_dirs=[
	"../../third-party/nlohmann_json/single_include",
	".",
	"../util",
	],
	),
	]

So, to enable creating a pybinding target, we must first decouple the util and inmemoryfs libraries so they can be used in coremldelegate and the future pybinding.

Test plan

This should really be a no-op w.r.t. builds. So, CI +

$ ./install_executorch.sh --pybind coreml

cc @larryliu0820 @lucylq

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/9481

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 7 New Failures, 1 Cancelled Job

As of commit 3172a23 with merge base 76ae537 ():

NEW FAILURES - The following jobs have failed:

• Apple / build-benchmark-app / macos-job (gh)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 65
• pull / test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t 9a7942f2b4855e6502581aa723ce2870e7dd1fa671e6d7610445b16f0ab684c9 /exec failed with exit code 1
• pull / unittest / macos / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• pull / unittest-editable / macos / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• trunk / test-arm-reference-delegation / linux-job (gh)
  RuntimeError: Command docker exec -t fb7c5a81af6dc2856b3fe2cb62b5ddd9911c7961cefb51dbdc7af479902ed9c1 /exec failed with exit code 1
• trunk / test-coreml-delegate / macos-job (gh)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
• trunk / unittest-release / macos / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

CANCELLED JOB - The following job was cancelled. Please retry:

• trunk / test-models-macos (mobilebert, xnnpack-quantization-delegation) / macos-job (gh)
  ##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[mergennachin]

See inline comments