Skip to content

Latest commit

 

History

History
14 lines (11 loc) · 757 Bytes

parsers.rst

File metadata and controls

14 lines (11 loc) · 757 Bytes

PyArrow Parsers Module Description

This module houses parser classes that are responsible for data parsing on the workers for the PyArrow backend. Parsers for PyArrow backends follow an interface of pandas backend parsers </flow/modin/backends/pandas/parsers>: parser class of every file format implements parse method, which parses the specified part of the file and builds PyArrow tables from the parsed data, based on the specified chunk size and number of splits. The resulted PyArrow tables will be used as a partitions payload in the :py~modin.experimental.engines.pyarrow_on_ray.frame.data.PyarrowOnRayFrame.

Public API

modin.backends.pyarrow.parsers