[C++][Parquet] Unable to read Parquet files with list inside struct

[asfimport]

Is PyArrow currently unable to read in Parquet files with a vector as a column? For example, the schema of such a file is below:

{{<pyarrow._parquet.ParquetSchema object at 0x7f2d42493c88>
mbc: FLOAT
deltae: FLOAT
labels: FLOAT
features.type: INT32 INT_8
features.size: INT32
features.indices.list.element: INT32
features.values.list.element: DOUBLE}}

Using either pq.read_table() or pq.ParquetDataset('/path/to/parquet').read() yields the following error: ArrowNotImplementedError: Currently only nesting with Lists is supported.

From the error I assume that this may be implemented in further releases?

Environment: Ubuntu
Reporter: Jovann Kung
Assignee: Micah Kornfield / @emkornfield

Related issues:

• [C++] Rebase https://github.com/apache/parquet-cpp/pull/462# onto arrow repo (is related to)
• [Python] Fail to write nested data to Parquet via BigQuery API (is related to)

_{Note: This issue was originally created as ARROW-1599. Please see the migration documentation for further details.}

[asfimport]

Wes McKinney / @wesm:
Yes. It's quite a bit of work to handle decoding of lists within structs, and vice versa; we support reads of structs and lists / lists-of-lists but the full nested data read case has not yet been implemented. I just did some support work for this in PARQUET-1100 apache/parquet-cpp@4b09ac7 and I hope that we can get this completed by end of the year. Development help always appreciated

[asfimport]

Joshua Storck / @joshuastorck:
This PR should address this: apache/parquet-cpp#462. [~JKung], could you possibly test out that version or provide a sample file that you are trying to read so that I can add it to the unit tests?

[asfimport]

Wes McKinney / @wesm:
Closing to track all the work under ARROW-1644