-
Notifications
You must be signed in to change notification settings - Fork 27
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update mapping.md #873
Update mapping.md #873
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #873 +/- ##
=======================================
Coverage 95.21% 95.21%
=======================================
Files 51 51
Lines 1777 1777
Branches 175 175
=======================================
Hits 1692 1692
Misses 85 85 ☔ View full report in Codecov by Sentry. |
9. More information on Parquet logical type schemas can be found [here](https://github.com/apache/parquet-format/blob/master/LogicalTypes.md). Time types are available at multiple precisions; import `magnolify.parquet.logical.micros._`, `magnolify.avro.logical.millis._`, or `magnolify.avro.logical.nanos._` accordingly. | ||
10. See [protobuf.md](https://github.com/spotify/magnolify/blob/master/docs/protobuf.md) for more | ||
11. Logical types available at micro- or milli-second precision; import `magnolify.avro.logical.micros._` or `magnolify.avro.logical.millis._` accordingly. BigQuery-compatible conversions are available in `magnolify.avro.logical.bigquery._`. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this is great! 🙌
docs/mapping.md
Outdated
| `org.joda.time.LocalDate` | `INT`<sup>11</sup> | - | - | - | - | - | - | | ||
| `org.joda.time.DateTime` | `INT`<sup>11</sup> | - | - | - | - | - | - | | ||
| `org.joda.time.LocalTime` | `INT`<sup>11</sup> | - | - | - | - | - | - | | ||
| `java.util.UUID` | `STRING`<sup>4</sup> | - | ByteString (16 bytes) | - | `FIXED[16]`<sup>9</sup> | - | - | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm not sure the 9. note holds for the UUID in parquet here
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
good point! Removed it.
fyi: PR diff is much easier to read w/ rich formatting turned on!
Change summary:
AvroCompat
's effect on array type representation