Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PARQUET-369: Add shaded SLF4J NOP binding. #32

Closed
wants to merge 1 commit into from

Conversation

rdblue
Copy link
Contributor

@rdblue rdblue commented Sep 24, 2015

This silences the complaint that no logger implementation could be
found. No logger implementation was possible because the class that
SLF4J was trying to load had been relocated. The only options are to
relocate an implementation along with SLF4J or not shade SLF4J. This
adds the NOP logger to silence the warning.

@rdblue rdblue force-pushed the PARQUET-369-fix-slf4j-binding branch 2 times, most recently from d30941a to 8ff5c80 Compare September 24, 2015 20:51
@rdblue rdblue changed the title PARQUET-369: Fix shaded SLF4J binding. PARQUET-369: Add shaded SLF4J NOP binding. Sep 24, 2015
This silences the complaint that no logger implementation could be
found. No logger implementation was possible because the class that
SLF4J was trying to load had been relocated. The only options are to
relocate an implementation along with SLF4J or not shade SLF4J. This
adds the NOP logger to silence the warning.
@rdblue rdblue force-pushed the PARQUET-369-fix-slf4j-binding branch from 8ff5c80 to f993a91 Compare September 24, 2015 20:53
@liancheng
Copy link
Contributor

+1

Thanks for fixing this super annoying issue :)

@rdblue
Copy link
Contributor Author

rdblue commented Sep 24, 2015

Thanks for reviewing!

@rdblue
Copy link
Contributor Author

rdblue commented Sep 25, 2015

@julienledem could you take a look as well? Thanks!

@almike
Copy link

almike commented Oct 26, 2015

+1 Please merge this

@rdblue
Copy link
Contributor Author

rdblue commented Oct 26, 2015

@isnotinvain or @julienledem can you take a look at this?

@isnotinvain
Copy link
Contributor

+1

@asfgit asfgit closed this in 145f4df Oct 27, 2015
@rdblue
Copy link
Contributor Author

rdblue commented Oct 27, 2015

Thanks for the reviews @almike, @isnotinvain, and @liancheng!

@julienledem
Copy link
Member

looks good. thanks

@julienledem
Copy link
Member

agreed that we'd want to remove the shading for slf4j.

lekv pushed a commit to lekv/parquet-format that referenced this pull request Jul 31, 2017
…litate unit testing

Several things in this patch

* Adds PageReader abstraction, and a SerializedPageReader implementation
  according to the Parquet file format
* Adds a MockPageReader and a couple unit tests demonstrating end-to-end test
  without creating a Parquet file
* Adds a DataPageBuilder test fixture tool, may become part of the main write
  path later
* Adds PlainEncoder implementation for a few primitive types
* Fixes a few ColumnReader bugs exposed by the unit tests

Author: Wes McKinney <wes@cloudera.com>

Closes apache#32 from wesm/PARQUET-485 and squashes the following commits:

aa33078 [Wes McKinney] Fix function doc
e897a81 [Wes McKinney] Restore NumRequiredBits function after rebase
ee4d97a [Wes McKinney] Change PageReader::NextPage API to return shared_ptr<Page>(nullptr) on eos
0324021 [Wes McKinney] Clarify some comments
ec871c4 [Wes McKinney] Add include guards
e63bbdd [Wes McKinney] Move vector_equal to util/test-common.h
44a78a1 [Wes McKinney] Refactor to decouple page deserialization from column reader so that mock data pages cna be constructed in unit tests.
lekv pushed a commit to lekv/parquet-format that referenced this pull request Jul 31, 2017
Requires PARQUET-485 (apache#32)

The boolean Encoding::PLAIN code path was using RleDecoder, inconsistent with
other implementations of Parquet. This patch adds an implementation of plain
encoding and uses BitReader instead of RleDecoder to decode plain-encoded
boolean data. Unit tests to verify.

Also closes PR apache#12. Thanks to @edani for reporting.

Author: Wes McKinney <wes@cloudera.com>

Closes apache#34 from wesm/PARQUET-454 and squashes the following commits:

01cb5a7 [Wes McKinney] Use a seed in the data generation
0bf5d8a [Wes McKinney] Fix inconsistencies with boolean PLAIN encoding.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants