feat(storage): support nested type in read_parquet.

[RinChanNOWWW]

I hereby agree to the terms of the CLA available at: https://databend.rs/dev/policies/cla/

Summary

• Don't push down filter to parquet reading if the field is a nested type. (arrow2 doesn't support constructing index page reader on nested type).
• Fix schema mismatch problem.
• Fix panic problem when reading complex nested types (such as Array(Tuple)).

Try to fix #9417.

Note

• Get fields on complex nested types can not succeed. Will be fixed in later PR.

> desc ttt;
+-------+-----------------------+------+---------+-------+
| Field | Type                  | Null | Default | Extra |
+-------+-----------------------+------+---------+-------+
| t     | ARRAY((INT32, INT32)) | NO   | []      |       |
+-------+-----------------------+------+---------+-------+
1 row in set (0.050 sec)

> select t[0]:a from ttt;
ERROR 1105 (HY000): Code: 1065, displayText = no overload satisfies `get((Int32, Int32) NULL, String)`

has tried possible overloads:
  get(Array(Nothing) NULL, UInt64 NULL) :: NULL     : unable to unify `(Int32, Int32)` with `Array(Nothing)`
  get(Array(T0 NULL), UInt64) :: T0 NULL            : unable to unify `(Int32, Int32) NULL` with `Array(T0 NULL)`
  get(Array(T0 NULL) NULL, UInt64 NULL) :: T0 NULL  : unable to unify `(Int32, Int32)` with `Array(T0 NULL)`
  get(Array(T0), UInt64) :: T0 NULL                 : unable to u

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment

Name	Status	Preview	Updated
databend	⬜️ Ignored (Inspect)		Jan 8, 2023 at 3:03AM (UTC)