Skip to content

ARROW-6767: [JS] Lazily bind batches in scan/scanReverse#5565

Closed
rolyatmax wants to merge 1 commit intoapache:masterfrom
rolyatmax:tb/lazily-bind-batches
Closed

ARROW-6767: [JS] Lazily bind batches in scan/scanReverse#5565
rolyatmax wants to merge 1 commit intoapache:masterfrom
rolyatmax:tb/lazily-bind-batches

Conversation

@rolyatmax
Copy link
Copy Markdown

I noticed some TODO comments in the JS client library that expressed interest in calling bind(batch) lazily. This PR implements that optimization and updates related tests.

Happy to make updates per feedback!

Created a JIRA issue here.

@github-actions
Copy link
Copy Markdown

github-actions bot commented Oct 2, 2019

@codecov-io
Copy link
Copy Markdown

codecov-io commented Oct 2, 2019

Codecov Report

Merging #5565 into master will increase coverage by 1.01%.
The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #5565       +/-   ##
==========================================
+ Coverage   88.58%   89.6%    +1.01%     
==========================================
  Files         967     102      -865     
  Lines      128766    6636   -122130     
  Branches     1501    1501               
==========================================
- Hits       114066    5946   -108120     
+ Misses      14335     679    -13656     
+ Partials      365      11      -354
Impacted Files Coverage Δ
js/src/compute/dataframe.ts 93.7% <100%> (+0.42%) ⬆️
python/pyarrow/ipc.pxi
r/R/filesystem.R
r/R/list.R
cpp/src/parquet/column_page.h
cpp/src/plasma/test/external_store_tests.cc
cpp/src/arrow/array/builder_decimal.cc
r/src/symbols.cpp
r/R/record-batch-writer.R
cpp/src/arrow/compute/compute_test.cc
... and 856 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5f93f85...8877a8f. Read the comment docs.

@kszucs kszucs closed this in 5050d87 Oct 3, 2019
@kszucs
Copy link
Copy Markdown
Member

kszucs commented Oct 3, 2019

Thanks @rolyatmax!

@rolyatmax rolyatmax deleted the tb/lazily-bind-batches branch October 3, 2019 14:28
kszucs pushed a commit that referenced this pull request Oct 5, 2019
I noticed some `TODO` comments in the JS client library that expressed interest in calling `bind(batch)` lazily. This PR implements that optimization and updates related tests.

Happy to make updates per feedback!

Created a JIRA issue [here](https://issues.apache.org/jira/browse/ARROW-6767).

Closes #5565 from rolyatmax/tb/lazily-bind-batches and squashes the following commits:

8877a8f <Taylor Baldwin> ARROW-6767:  lazily bind batches in scan/scanReverse

Authored-by: Taylor Baldwin <tbaldwin@uber.com>
Signed-off-by: Krisztián Szűcs <szucs.krisztian@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants