Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add an option for field type hinting on importing #205

Open
efirs opened this issue Feb 13, 2023 · 0 comments
Open

Add an option for field type hinting on importing #205

efirs opened this issue Feb 13, 2023 · 0 comments
Labels
data import

Comments

@efirs
Copy link
Collaborator

efirs commented Feb 13, 2023

Some type cannot be detected reliably, for example:

  • Byte arrays. Any alphabetical string, which length is multiple of 4 is a proper base64 incoded string.
  • Floats. It can be detected as integer if the sample set doesn't contain floating point.
  • Int32/Int64. No way to detect if it should be Int32.

This task is for explicitly specifying type of some field to improve the schema inference.

For example: --type-hint=field1:int32,field2.nested1=bytes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
data import
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ovaistariq @efirs