Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[small] remove chunk sizes from htypes #1037

Merged
merged 17 commits into from Jul 13, 2021
Merged

Conversation

verbose-void
Copy link
Contributor

also removed hub.core.typing since it wasn't really being used

@verbose-void verbose-void changed the title remove chunk sizes from htypes [small] remove chunk sizes from htypes Jul 9, 2021
@codecov
Copy link

codecov bot commented Jul 9, 2021

Codecov Report

Merging #1037 (16a9799) into main (b6e5601) will increase coverage by 0.06%.
The diff coverage is 96.05%.

Impacted file tree graph

@@            Coverage Diff             @@
##             main    #1037      +/-   ##
==========================================
+ Coverage   88.61%   88.67%   +0.06%     
==========================================
  Files          87       86       -1     
  Lines        3953     3939      -14     
==========================================
- Hits         3503     3493      -10     
+ Misses        450      446       -4     
Impacted Files Coverage Δ
hub/core/tests/common.py 100.00% <ø> (ø)
hub/htypes.py 100.00% <ø> (ø)
hub/core/sample.py 85.91% <66.66%> (-0.20%) ⬇️
hub/tests/common.py 70.96% <75.00%> (ø)
hub/core/meta/tensor_meta.py 90.21% <97.05%> (+2.09%) ⬆️
conftest.py 91.25% <100.00%> (ø)
hub/api/dataset.py 91.24% <100.00%> (+0.59%) ⬆️
hub/api/tests/test_api.py 99.12% <100.00%> (-0.01%) ⬇️
hub/api/tests/test_api_with_compression.py 100.00% <100.00%> (ø)
hub/constants.py 100.00% <100.00%> (ø)
... and 7 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b6e5601...16a9799. Read the comment docs.

hub/htypes.py Outdated
@@ -42,7 +41,6 @@

# these configs are added to every `htype`
COMMON_CONFIGS = {
"chunk_size": DEFAULT_MAX_CHUNK_SIZE,
"chunk_compression": DEFAULT_CHUNK_COMPRESSION,
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

chunk compression is removed in #1038

@@ -309,12 +309,23 @@ def __init__(self, htype: str, available_htypes: Sequence[str]):
class TensorMetaInvalidHtypeOverwriteValue(MetaError):
def __init__(self, key: str, value: Any, explanation: str = ""):
super().__init__(
"Invalid value {} for tensor meta key {}. {}".format(
"Invalid value '{}' for tensor meta key {}. {}".format(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's stick to fstrings everywhere so we don't need to do fstring replacement PRs in the future.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was an upstream change i just pulled in

Copy link
Contributor

@AbhinavTuli AbhinavTuli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@verbose-void verbose-void merged commit 4b53f2a into main Jul 13, 2021
@verbose-void verbose-void deleted the task/remove-chunk-sizes branch July 13, 2021 07:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants