Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide descriptions for fields #35

Closed
larruda opened this issue Aug 5, 2018 · 3 comments · Fixed by #112
Closed

Provide descriptions for fields #35

larruda opened this issue Aug 5, 2018 · 3 comments · Fixed by #112

Comments

@larruda
Copy link

larruda commented Aug 5, 2018

Hello. I have a requirement to have descriptions in the fields of the tables on BigQuery. When loading an Avro export from DBeam into BQ, the descriptions are set according to a hard-coded sentence DBeam sets, such as:

From sqlType 4 INTEGER

I need a way to set the descriptions myself. Could you please let me know the best way to accomplish this in your option on DBeam? I can prepare a PR. Thank you.

@labianchin
Copy link
Collaborator

DBeam does not support that.

One idea to implement that would be to add another command line argument pointing to an avsc schema, which would be used to export.

While that still does not happen, I recommend to process data from DBeam exports in scio or beam translating to the appropriate schema.

@rulle-io
Copy link
Contributor

Agree, this is a vital feature to have in dbeam.

@rulle-io
Copy link
Contributor

Can be closed?

@rulle-io rulle-io linked a pull request Jan 18, 2023 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants