Memory benchmarks

[KrishnaChaitanya1]

No description provided.

[github-actions]

Locust summary

Git references

Initial: e890baf
Terminal: 1c118a4

---

hub/api/dataset.py

Changes:

• Name: Dataset.from_tfds
  Type: function
  Changed lines: 155
  Total lines: 207
  Changes:
  • Name: Dataset.from_tfds.sampling
    Type: function
    Changed lines: 10
    Total lines: 10
  • Name: Dataset.from_tfds.dict_sampling
    Type: function
    Changed lines: 20
    Total lines: 20
  • Name: Dataset.from_tfds.generate_schema
    Type: function
    Changed lines: 3
    Total lines: 3
  • Name: Dataset.from_tfds.to_hub
    Type: function
    Changed lines: 22
    Total lines: 22
  • Name: Dataset.from_tfds.sdict_to_hub
    Type: function
    Changed lines: 7
    Total lines: 7
  • Name: Dataset.from_tfds.tensor_to_hub
    Type: function
    Changed lines: 12
    Total lines: 12
  • Name: Dataset.from_tfds.image_to_hub
    Type: function
    Changed lines: 12
    Total lines: 13
  • Name: Dataset.from_tfds.class_label_to_hub
    Type: function
    Changed lines: 7
    Total lines: 7
  • Name: Dataset.from_tfds.text_to_hub
    Type: function
    Changed lines: 4
    Total lines: 4
  • Name: Dataset.from_tfds.bbox_to_hub
    Type: function
    Changed lines: 3
    Total lines: 3
  • Name: Dataset.from_tfds.sequence_to_hub
    Type: function
    Changed lines: 2
    Total lines: 2
  • Name: Dataset.from_tfds.audio_to_hub
    Type: function
    Changed lines: 14
    Total lines: 15
  • Name: Dataset.from_tfds.video_to_hub
    Type: function
    Changed lines: 8
    Total lines: 9
  • Name: Dataset.from_tfds.transform_numpy
    Type: function
    Changed lines: 6
    Total lines: 6
  • Name: Dataset.from_tfds.my_transform
    Type: function
    Changed lines: 2
    Total lines: 2
• Name: Dataset
  Type: class
  Changed lines: 427
  Total lines: 1119
  Changes:
  • Name: Dataset.__init__
    Type: function
    Changed lines: 6
    Total lines: 146
  • Name: Dataset._check_and_prepare_dir
    Type: function
    Changed lines: 1
    Total lines: 41
  • Name: Dataset.filter
    Type: function
    Changed lines: 16
    Total lines: 21
  • Name: Dataset.to_pytorch
    Type: function
    Changed lines: 16
    Total lines: 35
  • Name: Dataset.to_tensorflow
    Type: function
    Changed lines: 88
    Total lines: 94
    Changes:
  • Name: Dataset.flush
    Type: function
    Changed lines: 1
    Total lines: 10
  • Name: Dataset.numpy
    Type: function
    Changed lines: 4
    Total lines: 13
  • Name: Dataset.__str__
    Type: function
    Changed lines: 1
    Total lines: 15
  • Name: Dataset._get_mode
    Type: function
    Changed lines: 1
    Total lines: 17
  • Name: Dataset.from_tensorflow
    Type: function
    Changed lines: 52
    Total lines: 80
    Changes:
  • Name: Dataset.from_tfds
    Type: function
    Changed lines: 155
    Total lines: 207
    Changes:
  • Name: Dataset.from_pytorch
    Type: function
    Changed lines: 85
    Total lines: 91
    Changes:
• Name: TorchDataset
  Type: class
  Changed lines: 78
  Total lines: 81
  Changes:
  • Name: TorchDataset.__init__
    Type: function
    Changed lines: 11
    Total lines: 11
  • Name: TorchDataset._do_transform
    Type: function
    Changed lines: 2
    Total lines: 2
  • Name: TorchDataset._init_ds
    Type: function
    Changed lines: 14
    Total lines: 14
  • Name: TorchDataset.__len__
    Type: function
    Changed lines: 3
    Total lines: 3
  • Name: TorchDataset._get_active_item
    Type: function
    Changed lines: 13
    Total lines: 13
  • Name: TorchDataset.__getitem__
    Type: function
    Changed lines: 26
    Total lines: 27
  • Name: TorchDataset.__iter__
    Type: function
    Changed lines: 4
    Total lines: 4

hub/api/sharded_datasetview.py

Changes:

• Name: ShardedDatasetView
  Type: class
  Changed lines: 22
  Total lines: 75
  Changes:
  • Name: ShardedDatasetView.__init__
    Type: function
    Changed lines: 2
    Total lines: 13
  • Name: ShardedDatasetView.slicing
    Type: function
    Changed lines: 13
    Total lines: 19
  • Name: ShardedDatasetView.__getitem__
    Type: function
    Changed lines: 3
    Total lines: 3
  • Name: ShardedDatasetView.__setitem__
    Type: function
    Changed lines: 2
    Total lines: 3
  • Name: ShardedDatasetView.schema
    Type: function
    Changed lines: 1
    Total lines: 2

hub/api/datasetview.py

Changes:

• Name: DatasetView
  Type: class
  Changed lines: 27
  Total lines: 290
  Changes:
  • Name: DatasetView.filter
    Type: function
    Changed lines: 19
    Total lines: 24
  • Name: DatasetView.to_tensorflow
    Type: function
    Changed lines: 3
    Total lines: 3
  • Name: DatasetView.to_pytorch
    Type: function
    Changed lines: 1
    Total lines: 13
  • Name: DatasetView.numpy
    Type: function
    Changed lines: 4
    Total lines: 16

hub/api/tensorview.py

Changes:

• Name: TensorView
  Type: class
  Changed lines: 2
  Total lines: 321
  Changes:
  • Name: TensorView.slice_fill
    Type: function
    Changed lines: 2
    Total lines: 12

hub/exceptions.py

Changes:

• Name: LargeShapeFilteringException
  Type: class
  Changed lines: 4
  Total lines: 4
  Changes:
  • Name: LargeShapeFilteringException.__init__
    Type: function
    Changed lines: 3
    Total lines: 3
• Name: AdvancedSlicingNotSupported
  Type: class
  Changed lines: 4
  Total lines: 4
  Changes:
  • Name: AdvancedSlicingNotSupported.__init__
    Type: function
    Changed lines: 3
    Total lines: 3

hub/store/azure_fs.py

Changes:

• Name: AzureBlobFileSystem
  Type: class
  Changed lines: 1
  Total lines: 151
  Changes:
  • Name: AzureBlobFileSystem.find
    Type: function
    Changed lines: 1
    Total lines: 14

hub/store/shape_detector.py

Changes:

• Name: ShapeDetector
  Type: class
  Changed lines: 2
  Total lines: 155
  Changes:
  • Name: ShapeDetector._get_chunks
    Type: function
    Changed lines: 2
    Total lines: 32

benchmarks/Memory Benchmarks/benchmark_memory_profile_hub.py

Changes:

• Name: cifar100_profile_cache
  Type: function
  Changed lines: 2
  Total lines: 2

benchmarks/Memory Benchmarks/benchmark_memory_profile_tf.py

Changes:

• Name: cifar100_tf_profile
  Type: function
  Changed lines: 2
  Total lines: 2

benchmarks/benchmark_tiledb_hub.py

Changes:

• Name: time_tiledb
  Type: function
  Changed lines: 30
  Total lines: 30
• Name: time_hub
  Type: function
  Changed lines: 17
  Total lines: 17

benchmarks/benchmark_zarr_hub.py

Changes:

• Name: time_zarr
  Type: function
  Changed lines: 41
  Total lines: 41
• Name: time_hub
  Type: function
  Changed lines: 17
  Total lines: 17

examples/basic.py

Changes:

• Name: main
  Type: function
  Changed lines: 1
  Total lines: 23

examples/big_image.py

Changes:

• Name: main
  Type: function
  Changed lines: 1
  Total lines: 21

examples/large_dataset_build.py

Changes:

• Name: create_large_dataset
  Type: function
  Changed lines: 4
  Total lines: 27

examples/mnist_upload_speed_benchmark.py

Changes:

• Name: main
  Type: function
  Changed lines: 1
  Total lines: 20

examples/new_api_intro.py

Changes:

• Name: main
  Type: function
  Changed lines: 1
  Total lines: 23

hub/api/tests/test_converters.py

Changes:

• Name: test_to_from_tensorflow
  Type: function
  Changed lines: 1
  Total lines: 26
• Name: test_to_from_tensorflow_datasetview
  Type: function
  Changed lines: 1
  Total lines: 26

hub/api/tests/test_dataset.py

Changes:

• Name: test_datasetview_repr
  Type: function
  Changed lines: 1
  Total lines: 11
• Name: test_dataset_filtering
  Type: function
  Changed lines: 14
  Total lines: 68
• Name: test_dataset_filtering_2
  Type: function
  Changed lines: 4
  Total lines: 19
• Name: test_dataset_filtering_3
  Type: function
  Changed lines: 3
  Total lines: 11
• Name: test_check_label_name
  Type: function
  Changed lines: 4
  Total lines: 26

hub/api/tests/test_objectview.py

Changes:

• Name: test_objectview
  Type: function
  Changed lines: 3
  Total lines: 64

hub/api/tests/test_sharded_dataset.py

Changes:

• Name: test_sharded_dataset
  Type: function
  Changed lines: 2
  Total lines: 24

hub/cli/auth.py

Changes:

• Name: register
  Type: function
  Changed lines: 1
  Total lines: 17

hub/schema/bbox.py

Changes:

• Name: BBox
  Type: class
  Changed lines: 1
  Total lines: 31

hub/store/tests/test_shape_detector.py

Changes:

• Name: test_shape_detector_wrong_shape
  Type: function
  Changed lines: 3
  Total lines: 5
• Name: test_shape_detector_wrong_shape_2
  Type: function
  Changed lines: 4
  Total lines: 6
• Name: test_shape_detector_wrong_shape_3
  Type: function
  Changed lines: 4
  Total lines: 6

hub/tests/test_exceptions.py

Changes:

• Name: test_exceptions
  Type: function
  Changed lines: 2
  Total lines: 34

[codecov]

Codecov Report

Merging #638 (1c118a4) into master (8faed02) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #638   +/-   ##
=======================================
  Coverage   88.46%   88.46%           
=======================================
  Files          52       52           
  Lines        3745     3745           
=======================================
  Hits         3313     3313           
  Misses        432      432           

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8faed02...1c118a4. Read the comment docs.

[mynameisvinn]

@KrishnaChaitanya1 thanks for this PR. Mind giving me some context behind this PR so I can provide feedback?

[benchislett]

Hey guys. Good start on this, but I think we can get a bit more out of the tools. I'm going to branch off master and try to generalize our benchmarks so we get time, memory, and network on all metrics across the board. Updates to follow.

[KrishnaChaitanya1]

@mynameisvinn . I asked @haiyangdeperci to see if the changes I made to memory benchmarks code is okay or not. Hence made this PR so that it can be checked. This PR is about the memory benchmarks which I tried using memory-profiler.

[benchislett]

Proposing to close this in favor of #642 and move further discussion there.

[mynameisvinn]

consolidating with #642