Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature/arrow2 #16

Merged
merged 101 commits into from
Feb 13, 2023
Merged

Feature/arrow2 #16

merged 101 commits into from
Feb 13, 2023

Conversation

chmp
Copy link
Owner

@chmp chmp commented Jun 15, 2022

No description provided.

chmp added 30 commits May 1, 2022 13:15
@chmp
Move all arrow interaction for schema into a separate module
1ca9527
@chmp
Remove all arrow references from the event module
cbea16f
@chmp
Move all arrow functionality into dedicated modules
4a92985
@chmp
Start arrow2 implementation
ed035c3
@chmp
Make arrow optional
9afeaf8
@chmp
Split to_record_batch into backend-specific and general parts
043e05a
@chmp
Add to_chunk for arrow2
64d139f
@chmp
Add polars example
cd0606c
@chmp
Cleanup make.py script
9fd1d74
@chmp
Add helper to write IPC files via arrow2
44b3000
@chmp
Start to factor out the generic part of from_record_batch
29d8c9b
@chmp
Implement from_chunk
761d373
@chmp
Merge branch 'main' into feature/arrow2
46a2f40
@chmp
Remove dead code
dfc2be7
@chmp
fix benches
08a4a57
@chmp
Add bench command to make.py
1189fda
@chmp
Update implementation notes
1fc0837
@chmp
Uüpdate arrow2 + improve tests
8dd484c
@chmp
Test round-tripping for events
e53a82e
@chmp
Test events for outer structures
c92fbf7
@chmp
Test events for nested structures
4370c90
@chmp
Include data in display for event
6f56a70
@chmp
Rework sources for arrow 2 (incl. structs & nested structs)
47e8bdd
@chmp
Start to implement event sinks
91472b6
@chmp
Add complete record builder
244e546
@chmp
Prepare to use data types for selection of serialization strategies
d4e5dc9
@chmp
Use fields to build sources
7ac2b11
@chmp
Implement datetime strategies and remove unused code
c0b118a
@chmp
Move backend tests into sub modules
eb7458a
@chmp
Split code into generic & arrow parts
fc79a43
@chmp
Add more complex benchmark
0512d65
@chmp
Update arrow2 to 0.15.0 (and re-add the example)
c8272e6
@chmp
Bump arrow2 to 0.16
0c025b1
@chmp
Add test of currently not supported flattened structures
d4d72a9
@chmp
Fix typo in docs
d6723ad
@chmp
Implement structs as outer elements
30453c2
@chmp
Bump year in license
3e68548
@chmp
Add backtraces to errors
e9df944
@chmp
Fix error messages
8cb2492
@chmp
Add test for currently unsupported outer maps serialization
0cf2ec3
@chmp
Unify strategy naming scheme
4d2a365
@chmp
Add more docs to the strategies
6e8a3f2
@chmp
Rename StructTracerMode to StructMode
9c5a78e
@chmp
Remove code duplication in structbuilder
4a51bb8
@chmp
Make backtraces in precommit optional
a3a6760
@chmp
Simplify structtracer impl
135841d
@chmp
Add helpers to handle sequences of items
054e699
@chmp
Add options to customize schema tracing
a6faf8a
@chmp
Add support for map_as_struct in ser/de
0c4f794
@chmp chmp mentioned this pull request Feb 11, 2023
Closed
5 tasks
@chmp chmp merged commit 0368c74 into main Feb 13, 2023
@chmp chmp deleted the feature/arrow2 branch February 13, 2023 18:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
1 participant
@chmp