Task Summary
Platform-integration step of the dataset-mounting feature (part of #6606), built on the mount infrastructure. Let the platform and users mount datasets and use them in Python UDFs:
- Engine mount client —
DatasetMountManager asks the node mounter to mount a dataset for the computing unit; the locator flows through PhysicalOp/WorkerConfig to the Python worker, which exposes the resolved local path.
- Per-computing-unit mount API — mount / list / unmount datasets on a CU (
ComputingUnitManagingResource + MounterClient), with FileResolver resolving dataset paths both ways.
- "Mount datasets into computing unit" UI.
- Python UDF dataset-variable bindings — bind each mounted dataset to a variable holding its local path (e.g.
open(f"{A}/file.csv")).
Task Type
Task Summary
Platform-integration step of the dataset-mounting feature (part of #6606), built on the mount infrastructure. Let the platform and users mount datasets and use them in Python UDFs:
DatasetMountManagerasks the node mounter to mount a dataset for the computing unit; the locator flows throughPhysicalOp/WorkerConfigto the Python worker, which exposes the resolved local path.ComputingUnitManagingResource+MounterClient), withFileResolverresolving dataset paths both ways.open(f"{A}/file.csv")).Task Type