Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Convert camel case bigquery column names to snake case #671

Closed
relud opened this issue Jun 21, 2019 · 0 comments · Fixed by #689
Closed

Convert camel case bigquery column names to snake case #671

relud opened this issue Jun 21, 2019 · 0 comments · Fixed by #689
Assignees
@jklukas
Labels
ingestion-beam This applies to ingestion-beam

Comments

@relud
Copy link
Contributor

relud commented Jun 21, 2019

the direct to parquet datasets coerce camel case keys to snake case, but right now bigquery does not.

for migration convenience we should expose the columns as snake case by some means (e.g. bigquery views or coercion in the decoder)

cc @jklukas
@relud relud added the ingestion-beam This applies to ingestion-beam label Jun 21, 2019
@jklukas jklukas mentioned this issue Jun 27, 2019
Closed
jklukas added a commit that referenced this issue Jul 5, 2019
@jklukas
Coerce camelCase field names to snake_case in BQ sink
aaf56ff 
Fixes #671
@jklukas jklukas mentioned this issue Jul 5, 2019
Merged
jklukas added a commit that referenced this issue Jul 5, 2019
@jklukas
Coerce camelCase field names to snake_case in BQ sink
ca7b22c 
Fixes #671
@jklukas jklukas self-assigned this Jul 5, 2019
jklukas added a commit that referenced this issue Jul 16, 2019
@jklukas
Coerce camelCase field names to snake_case in BQ sink
d7f87a1 
Fixes #671
jklukas added a commit that referenced this issue Jul 17, 2019
@jklukas
Coerce camelCase field names to snake_case in BQ sink (#689)
51e99f7 
Fixes #671
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jklukas jklukas

Labels
ingestion-beam This applies to ingestion-beam
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Coerce camelCase field names to snake_case in BQ sink mozilla/gcp-ingestion
2 participants
@relud @jklukas