-
-
Notifications
You must be signed in to change notification settings - Fork 140
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Field name with dot (.) #82
Comments
A dot is the Schema.PathSeparator and used in e.g. paths of StructField's as separator if you store e.g. (list of) structs |
The problem is, some viewer like ParquetFileViewer can't open the parquet files if column has a dot. |
Any update? Is this by design? Is it possible to fix it, or have a opt-in option to allow dots? |
Parquet spec does allow dots so Id say we should too. |
3 tasks
Fixed |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
This commit 16b55d5 added a validation to disallow fields with dots.
Do we really have a reason to don't accept dots? If I comment the throw line I can read a file with dots in column names, and the only failing test is the test that validates if it throws when we use dots.
I couldn't find any spec saying dots are not allowed.
Thanks.
The text was updated successfully, but these errors were encountered: