Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

StorageLoader: remove EMPTYASNULL for loading JSONs #942

Closed
alexanderdean opened this issue Aug 4, 2014 · 0 comments
Closed

StorageLoader: remove EMPTYASNULL for loading JSONs #942

alexanderdean opened this issue Aug 4, 2014 · 0 comments
Assignees
@alexanderdean
Labels
4. Storage
Milestone
Version 0.9.7

Comments

@alexanderdean
Copy link
Member

The problem:

  • A JSON property is marked as required in JSON Schema
  • The column in the Redshift table is set to NOT NULL
  • An empty string is passed in, ""
  • JSON Schema validation succeeds
  • The EMPTYASNULL condition on the COPY converts the "" to null
  • The row fails the load, as the NOT NULL constraint has been violated

/cc @yalisassoon
@alexanderdean alexanderdean added this to the Version 0.9.7 milestone Aug 4, 2014
@alexanderdean alexanderdean self-assigned this Aug 4, 2014
@alexanderdean alexanderdean changed the title EmrEtlRunner: remove EMPTYASNULL for loading JSONs StorageLoader: remove EMPTYASNULL for loading JSONs Aug 4, 2014
alexanderdean added a commit that referenced this issue Aug 4, 2014
@alexanderdean
StorageLoader: removed EMPTYASNULL for loading JSONs (fixes #942)
da625a6
@alexanderdean alexanderdean mentioned this issue Nov 7, 2014
Closed
chuwy pushed a commit to snowplow/snowplow-rdb-loader that referenced this issue Sep 5, 2017
@alexanderdean @chuwy
StorageLoader: removed EMPTYASNULL for loading JSONs (snowplow/snowpl…
0a2e2da 
…ow#942)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@alexanderdean alexanderdean

Labels
4. Storage
Projects
None yet
Milestone
Version 0.9.7
Development

No branches or pull requests
1 participant
@alexanderdean