This module houses parser classes that are responsible for data parsing on the workers for the PyArrow backend. Parsers for PyArrow backends follow an interface of pandas backend parsers </flow/modin/backends/pandas/parsers>
: parser class of every file format implements parse
method, which parses the specified part of the file and builds PyArrow tables from the parsed data, based on the specified chunk size and number of splits. The resulted PyArrow tables will be used as a partitions payload in the :py~modin.experimental.engines.pyarrow_on_ray.frame.data.PyarrowOnRayFrame
.
modin.backends.pyarrow.parsers