New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Avoid VDB Index copy with 'like' API #2687
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #2687 +/- ##
==========================================
- Coverage 84.37% 83.82% -0.55%
==========================================
Files 231 231
Lines 25902 25904 +2
==========================================
- Hits 21854 21715 -139
- Misses 4048 4189 +141
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
deeplake/core/tensor.py
Outdated
@@ -350,9 +350,10 @@ def extend( | |||
Raises: | |||
TensorDtypeMismatchError: Dtype for array must be equal to or castable to this tensor's dtype. | |||
""" | |||
old_dataset_length = self.num_samples |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is this change really necessary?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, in order to keep track of the initial records.
Kudos, SonarCloud Quality Gate passed! |
🚀 🚀 Pull Request
Deeplake Like No samples are copied, only the meta/info for the dataset and it’s tensors. But Like shouldn't copy the vdb index information from the tensor meta to the destination tensor. As currently the vdb index can only be created from vector store Init with the Index Parameters passed through it.
Impact
Description
Things to be aware of
Things to worry about
Additional Context