-
Notifications
You must be signed in to change notification settings - Fork 79
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Read index API #1568
base: master
Are you sure you want to change the base?
Read index API #1568
Commits on May 31, 2024
-
Add restriction on the version of grcp needed to install ArcticDB
New versions require protobuf >= 5 which we don't support
Vasil Pashov committedMay 31, 2024 Configuration menu - View commit details
-
Copy full SHA for 136721b - Browse repository at this point
Copy the full SHA 136721bView commit details
Commits on Jun 5, 2024
-
Merge branch 'master' of github.com:man-group/ArcticDB
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 981bdae - Browse repository at this point
Copy the full SHA 981bdaeView commit details -
Add TDD style tests for the new read_index API
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 2f9a64c - Browse repository at this point
Copy the full SHA 2f9a64cView commit details -
Expand tests to cover more ground
* Different versions of as_of * date_rage * row_range * Different column slice size
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for fd13b8e - Browse repository at this point
Copy the full SHA fd13b8eView commit details -
Use the correct param name in fixture using version_store_factory
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for c974cdc - Browse repository at this point
Copy the full SHA c974cdcView commit details -
Add entry point for read_index_columns in python
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for d941d20 - Browse repository at this point
Copy the full SHA d941d20View commit details -
Add LocalVersionedEngine::get_version_identifier
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for bf23086 - Browse repository at this point
Copy the full SHA bf23086View commit details -
Add read_index_columns_internal funciton and call it from the public …
…interface
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for bd6e881 - Browse repository at this point
Copy the full SHA bd6e881View commit details -
Separate build read_query_filters into two functions one for rows and…
… one for cols
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 5ac734e - Browse repository at this point
Copy the full SHA 5ac734eView commit details -
Move !read_query.columns.empty() out of add_index_columns_to_query
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 264f0ff - Browse repository at this point
Copy the full SHA 264f0ffView commit details -
Pass the pipeline as a const bare pointer when setting the selected c…
…olumns
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 254a49a - Browse repository at this point
Copy the full SHA 254a49aView commit details -
Comment bucketize_dynamic in the proto file
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 94817d8 - Browse repository at this point
Copy the full SHA 94817d8View commit details -
Vasil Pashov committed
Jun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for f1983f2 - Browse repository at this point
Copy the full SHA f1983f2View commit details -
* Use shared_ptr for the pipeline context. It's needed because when queries are created a lambda captures the pointer and then the lambda object is returned. We want it to be copied so that the lambda is an owner. * Add comments to pipeline fields (selected_columns_ and overal_column_bitset_) * Fix pipeline context swap as it did not copy the overal column bitset
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 7b86694 - Browse repository at this point
Copy the full SHA 7b86694View commit details -
Read index columns in the CPP layer
Mark the correct columns both in the selected_columns and overall_column_bitset. After that the dataframe is read as usual and returned. The python layer needs additional work since it cannot denormalize it (probably because there is only one index column with no data columns). TODO: * The C++ is probably doing more than needed * Python denomalization
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 16e87f1 - Browse repository at this point
Copy the full SHA 16e87f1View commit details -
Fix read index for when range index is used
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 45102ca - Browse repository at this point
Copy the full SHA 45102caView commit details -
Use range based for in modify_descriptor
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for fc41710 - Browse repository at this point
Copy the full SHA fc41710View commit details -
Improve the way index columns are selected
The index columns are always the first columns in the stream descriptor. Thus we can check the count of the index columns and add the first n columns to the selected set, skipping the procedures of creating hash sets and checking if a field name is in the set.
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 0b287ed - Browse repository at this point
Copy the full SHA 0b287edView commit details -
Make the python read_index_coumns to return VersionedItem
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 4e3c031 - Browse repository at this point
Copy the full SHA 4e3c031View commit details -
Set read_query columns to be the index columns from the tsd
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 8aaf576 - Browse repository at this point
Copy the full SHA 8aaf576View commit details -
Vasil Pashov committed
Jun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for f30a5b0 - Browse repository at this point
Copy the full SHA f30a5b0View commit details -
Merge branch 'master' of github.com:man-group/ArcticDB
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 162c199 - Browse repository at this point
Copy the full SHA 162c199View commit details -
Fix bug introduced with earlier commit
Vasil Pashov committedJun 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 951cee7 - Browse repository at this point
Copy the full SHA 951cee7View commit details
Commits on Jun 6, 2024
-
Vasil Pashov committed
Jun 6, 2024 Configuration menu - View commit details
-
Copy full SHA for a132759 - Browse repository at this point
Copy the full SHA a132759View commit details -
Add comments and change function declaration
Vasil Pashov committedJun 6, 2024 Configuration menu - View commit details
-
Copy full SHA for 3ffdc43 - Browse repository at this point
Copy the full SHA 3ffdc43View commit details
Commits on Jun 7, 2024
-
Delete is_column_selected and use bitmagic's built in any_range
Vasil Pashov committedJun 7, 2024 Configuration menu - View commit details
-
Copy full SHA for 19984b2 - Browse repository at this point
Copy the full SHA 19984b2View commit details
Commits on Jun 10, 2024
-
Fix the way slices and keys are selected for a dataframe without row …
…filter
Vasil Pashov committedJun 10, 2024 Configuration menu - View commit details
-
Copy full SHA for df6549b - Browse repository at this point
Copy the full SHA df6549bView commit details
Commits on Jun 12, 2024
-
Enable more tests and fix some bugs in the tests
Vasil Pashov committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for 05b63dc - Browse repository at this point
Copy the full SHA 05b63dcView commit details -
Vasil Pashov committed
Jun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for 6d50233 - Browse repository at this point
Copy the full SHA 6d50233View commit details -
Set rowcount after reading rowrange index. Add python binding to get …
…the rowcount
Vasil Pashov committedJun 12, 2024 Configuration menu - View commit details
-
Copy full SHA for 7466696 - Browse repository at this point
Copy the full SHA 7466696View commit details
Commits on Jun 13, 2024
-
Extract _compute_filter_start_end_row into a function
Vasil Pashov committedJun 13, 2024 Configuration menu - View commit details
-
Copy full SHA for 13c57ab - Browse repository at this point
Copy the full SHA 13c57abView commit details -
Throw exception in case of multi key, pickled data, custom normalizer…
…s or recursive normalizers when trying to read index
Vasil Pashov committedJun 13, 2024 Configuration menu - View commit details
-
Copy full SHA for fbd6651 - Browse repository at this point
Copy the full SHA fbd6651View commit details -
Add tests for normalization, pickled data and staged writes for read …
…index functionality
Vasil Pashov committedJun 13, 2024 Configuration menu - View commit details
-
Copy full SHA for f6ef6ee - Browse repository at this point
Copy the full SHA f6ef6eeView commit details -
Vasil Pashov committed
Jun 13, 2024 Configuration menu - View commit details
-
Copy full SHA for 164138d - Browse repository at this point
Copy the full SHA 164138dView commit details
Commits on Jun 14, 2024
-
Refactor things in read_index_columns_impl
Vasil Pashov committedJun 14, 2024 Configuration menu - View commit details
-
Copy full SHA for a82df01 - Browse repository at this point
Copy the full SHA a82df01View commit details -
Remove test cases which don't make sense at the moment
Vasil Pashov committedJun 14, 2024 Configuration menu - View commit details
-
Copy full SHA for 17f1915 - Browse repository at this point
Copy the full SHA 17f1915View commit details -
Vasil Pashov committed
Jun 14, 2024 Configuration menu - View commit details
-
Copy full SHA for 2f9ff35 - Browse repository at this point
Copy the full SHA 2f9ff35View commit details -
Merge branch 'master' of github.com:man-group/ArcticDB
Vasil Pashov committedJun 14, 2024 Configuration menu - View commit details
-
Copy full SHA for 074be79 - Browse repository at this point
Copy the full SHA 074be79View commit details -
Merge branch 'master' into read-index-merge
Vasil Pashov committedJun 14, 2024 Configuration menu - View commit details
-
Copy full SHA for fa753f2 - Browse repository at this point
Copy the full SHA fa753f2View commit details -
Vasil Pashov committed
Jun 14, 2024 Configuration menu - View commit details
-
Copy full SHA for 36d0c7a - Browse repository at this point
Copy the full SHA 36d0c7aView commit details -
Fix compilation errors in the tests
Vasil Pashov committedJun 14, 2024 Configuration menu - View commit details
-
Copy full SHA for 9f42bf2 - Browse repository at this point
Copy the full SHA 9f42bf2View commit details -
Fix pytest fixture for read_index_columns
Vasil Pashov committedJun 14, 2024 Configuration menu - View commit details
-
Copy full SHA for 4a8b596 - Browse repository at this point
Copy the full SHA 4a8b596View commit details -
Vasil Pashov committed
Jun 14, 2024 Configuration menu - View commit details
-
Copy full SHA for d79d882 - Browse repository at this point
Copy the full SHA d79d882View commit details -
Vasil Pashov committed
Jun 14, 2024 Configuration menu - View commit details
-
Copy full SHA for bd31991 - Browse repository at this point
Copy the full SHA bd31991View commit details -
Fix lmdb_version_store_row_slice fixture in test read index
Vasil Pashov committedJun 14, 2024 Configuration menu - View commit details
-
Copy full SHA for 29518c8 - Browse repository at this point
Copy the full SHA 29518c8View commit details -
Test differences between pandas 1 and pandas 2 when reading index col…
…umns
Vasil Pashov committedJun 14, 2024 Configuration menu - View commit details
-
Copy full SHA for 43c535a - Browse repository at this point
Copy the full SHA 43c535aView commit details -
Omit library name from lmdb_version_store_row_slice
Vasil Pashov committedJun 14, 2024 Configuration menu - View commit details
-
Copy full SHA for 3eb997a - Browse repository at this point
Copy the full SHA 3eb997aView commit details -
Replace yield with return in lmdb_version_store_row_slice fixture
Vasil Pashov committedJun 14, 2024 Configuration menu - View commit details
-
Copy full SHA for a626b4d - Browse repository at this point
Copy the full SHA a626b4dView commit details