Skip to content

ARROW-6035: [Java] Avro adapter support convert nullable value - #4943

Closed
tianchen92 wants to merge 7 commits into
apache:masterfrom
tianchen92:ARROW-6035
Closed

ARROW-6035: [Java] Avro adapter support convert nullable value#4943
tianchen92 wants to merge 7 commits into
apache:masterfrom
tianchen92:ARROW-6035

Conversation

@tianchen92

Copy link
Copy Markdown
Contributor

Related to ARROW-6035.

A specific Avro unions type(has two types and one is null type) could convert to a nullable ArrowVector.
For instance, ["null", "string"] could represented by a VarcharVector which could has null value.

@codecov-io

codecov-io commented Jul 25, 2019

Copy link
Copy Markdown

Codecov Report

Merging #4943 into master will increase coverage by 2.23%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #4943      +/-   ##
==========================================
+ Coverage   87.48%   89.72%   +2.23%     
==========================================
  Files         994      667     -327     
  Lines      140683    98284   -42399     
  Branches     1418        0    -1418     
==========================================
- Hits       123074    88181   -34893     
+ Misses      17247    10103    -7144     
+ Partials      362        0     -362
Impacted Files Coverage Δ
cpp/src/gandiva/function_registry_test.cc 87.23% <0%> (-12.77%) ⬇️
cpp/src/arrow/flight/internal.cc 81.25% <0%> (-10.06%) ⬇️
cpp/src/parquet/arrow/reader.h 91.66% <0%> (-8.34%) ⬇️
cpp/src/plasma/eviction_policy.cc 93.18% <0%> (-6.82%) ⬇️
cpp/src/arrow/array/builder_binary.h 92.38% <0%> (-4.79%) ⬇️
cpp/src/arrow/flight/types.cc 89.24% <0%> (-3.16%) ⬇️
python/pyarrow/_plasma.pyx 89.28% <0%> (-2.82%) ⬇️
cpp/src/gandiva/precompiled/arithmetic_ops.cc 36.11% <0%> (-2.13%) ⬇️
cpp/src/arrow/status.h 93.54% <0%> (-2.06%) ⬇️
cpp/src/arrow/util/rle-encoding-test.cc 96.97% <0%> (-1.16%) ⬇️
... and 450 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bc837e6...8af1bfe. Read the comment docs.

Comment thread java/adapter/avro/src/main/java/org/apache/arrow/AvroToArrowUtils.java Outdated
Comment thread java/adapter/avro/src/main/java/org/apache/arrow/AvroToArrowUtils.java Outdated
Comment thread java/adapter/avro/src/main/java/org/apache/arrow/consumers/AvroIntConsumer.java Outdated
Comment thread java/adapter/avro/src/main/java/org/apache/arrow/consumers/AvroIntConsumer.java Outdated
@emkornfield

Copy link
Copy Markdown
Contributor

Sorry, will take a look tomorrow at the updates.

@emkornfield emkornfield left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks much nicer with delegation. Thank you. Still a few more points that need to be addressed.

Comment thread java/adapter/avro/src/main/java/org/apache/arrow/AvroToArrowUtils.java Outdated
Comment thread java/adapter/avro/src/main/java/org/apache/arrow/consumers/Consumer.java Outdated
@tianchen92

Copy link
Copy Markdown
Contributor Author

@emkornfield Build passed, I think we could get this merged :)

@emkornfield

Copy link
Copy Markdown
Contributor

yep. +1, thank you.

pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request Oct 24, 2025
Related to [ARROW-6035](https://issues.apache.org/jira/browse/ARROW-6035).

A  specific Avro unions type(has two types and one is null type) could convert to a nullable ArrowVector.
For instance, ["null", "string"] could represented by a VarcharVector which could has null value.

Closes apache#4943 from tianchen92/ARROW-6035 and squashes the following commits:

8af1bfe <tianchen> rename
be18c56 <tianchen> resolve comments
0e7adda <tianchen> fix writer
42979b7 <tianchen> fix
2cc3950 <tianchen> fix nullable check
92fb616 <tianchen> resolve comments
ffaa138 <tianchen> ARROW-6035:  Avro adapter support convert nullable value

Authored-by: tianchen <niki.lj@alibaba-inc.com>
Signed-off-by: Micah Kornfield <emkornfield@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants