Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reduce number of read during ROOTFile and basket unpacking, use more async, add remote (HTTP) source, #154

Merged
merged 33 commits into from
Mar 2, 2022

Conversation

Moelf
Copy link
Member

@Moelf Moelf commented Mar 2, 2022

Everything in #150 except the xrootdgo_jll which is >= 1.6 only. I want to push all generic optimizations before finally adding the Go binding.

@codecov
Copy link

codecov bot commented Mar 2, 2022

Codecov Report

Merging #154 (a656576) into master (4de414d) will decrease coverage by 1.07%.
The diff coverage is 81.75%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #154      +/-   ##
==========================================
- Coverage   92.33%   91.26%   -1.08%     
==========================================
  Files          10       11       +1     
  Lines        1436     1523      +87     
==========================================
+ Hits         1326     1390      +64     
- Misses        110      133      +23     
Impacted Files Coverage Δ
src/displays.jl 76.08% <0.00%> (-15.48%) ⬇️
src/streamsource.jl 82.35% <82.35%> (ø)
src/iteration.jl 89.07% <87.50%> (+1.15%) ⬆️
src/UnROOT.jl 85.71% <88.88%> (-14.29%) ⬇️
src/bootstrap.jl 93.09% <100.00%> (+0.01%) ⬆️
src/root.jl 94.09% <100.00%> (+1.26%) ⬆️
src/types.jl 94.11% <100.00%> (+1.09%) ⬆️
... and 2 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4de414d...a656576. Read the comment docs.

@Moelf Moelf force-pushed the reduce_read_and_use_async branch from c6cdb7b to 21690fe Compare March 2, 2022 05:55
@Moelf Moelf changed the title reduce read and use async reduce number of read during ROOTFile and basket unpacking, use more async, add remote (HTTP) source, Mar 2, 2022
@Moelf
Copy link
Member Author

Moelf commented Mar 2, 2022

I promise I will fix code coverage later.

@Moelf Moelf merged commit 8a257b8 into JuliaHEP:master Mar 2, 2022
@tamasgal
Copy link
Member

tamasgal commented Mar 2, 2022

Awesome 👏 😃

@Moelf Moelf deleted the reduce_read_and_use_async branch March 2, 2022 14:33
Moelf added a commit to Moelf/UnROOT.jl that referenced this pull request Jun 23, 2022
…e async, add remote (HTTP) source, (JuliaHEP#154)


* reduce basket reading io from 4 -> 1

* use more OffsetBuffer when appropriate

* bump compatibility

* add HTTP source support

* Mmap based local file

* async chunking

* better error

* 100% lock-free

* scitoken ready

* faster display branch

* backport upgrade
Moelf added a commit to aminnj/UnROOT.jl that referenced this pull request Jun 23, 2022
…e async, add remote (HTTP) source, (JuliaHEP#154)


* reduce basket reading io from 4 -> 1

* use more OffsetBuffer when appropriate

* bump compatibility

* add HTTP source support

* Mmap based local file

* async chunking

* better error

* 100% lock-free

* scitoken ready

* faster display branch

* backport upgrade
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants