Skip to content

Conversation

@mykhailo-kuchma
Copy link
Contributor

@mykhailo-kuchma mykhailo-kuchma commented Aug 30, 2023

The new API uses a SAX parser and a JSON byte stream to parse the
layer partitions while they are downloading. Using this approach we
can process large responses without any memory impact, since we do not
wait for the full response, and parse it afterward.

Relates-To: OLPEDGE-2832

Signed-off-by: Mykhailo Kuchma ext-mykhailo.kuchma@here.com

@mykhailo-kuchma mykhailo-kuchma changed the title Poc/olpedge 2832 POC GetPartitionsIncremental API Aug 30, 2023
@mykhailo-kuchma mykhailo-kuchma force-pushed the poc/OLPEDGE-2832 branch 2 times, most recently from 577f0ce to 4c4bf1d Compare August 31, 2023 07:43
@mykhailo-kuchma mykhailo-kuchma changed the title POC GetPartitionsIncremental API Add StreamLayerPartitions API Aug 31, 2023
@mykhailo-kuchma mykhailo-kuchma force-pushed the poc/OLPEDGE-2832 branch 2 times, most recently from 3d2dbc3 to e81f28a Compare August 31, 2023 15:01
@mykhailo-kuchma mykhailo-kuchma force-pushed the poc/OLPEDGE-2832 branch 3 times, most recently from a94a62c to 92b80c1 Compare September 1, 2023 10:41
@codecov
Copy link

codecov bot commented Sep 1, 2023

Codecov Report

Merging #1427 (cfc841a) into master (a657055) will decrease coverage by 0.48%.
Report is 1 commits behind head on master.
The diff coverage is 55.97%.

❗ Current head cfc841a differs from pull request most recent head 677848c. Consider uploading reports for the commit 677848c to get more accurate results

@@            Coverage Diff             @@
##           master    #1427      +/-   ##
==========================================
- Coverage   80.42%   79.94%   -0.48%     
==========================================
  Files         337      339       +2     
  Lines       12809    13041     +232     
  Branches     1389     1415      +26     
==========================================
+ Hits        10301    10425     +124     
- Misses       1941     2042     +101     
- Partials      567      574       +7     
Files Changed Coverage Δ
...p-cpp-sdk-core/include/olp/core/client/OlpClient.h 100.00% <ø> (ø)
...nclude/olp/dataservice/read/VersionedLayerClient.h 100.00% <ø> (ø)
...-sdk-dataservice-read/src/VersionedLayerClient.cpp 92.86% <0.00%> (-7.14%) ⬇️
...-dataservice-read/src/VersionedLayerClientImpl.cpp 81.85% <0.00%> (-4.53%) ⬇️
...dk-dataservice-read/src/VersionedLayerClientImpl.h 100.00% <ø> (ø)
...ice-read/src/repositories/PartitionsRepository.cpp 75.97% <0.00%> (-8.50%) ⬇️
...dataservice-read/src/generated/api/MetadataApi.cpp 52.00% <18.18%> (-9.73%) ⬇️
olp-cpp-sdk-core/src/client/PendingUrlRequests.cpp 88.55% <25.00%> (-1.37%) ⬇️
olp-cpp-sdk-core/src/client/OlpClient.cpp 85.11% <53.33%> (-2.08%) ⬇️
...aservice-read/src/repositories/AsyncJsonStream.cpp 77.78% <77.78%> (ø)
... and 1 more

... and 1 file with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

New API is using a SAX parser and a JSON byte stream to parse the
layer partitions while they are downloading. Using this approach we
can process large responses without any memory impact, since we do not
wait for the full response, and parse it afterwards.

Relates-To: OLPEDGE-2832

Signed-off-by: Mykhailo Kuchma <ext-mykhailo.kuchma@here.com>
@mykhailo-kuchma mykhailo-kuchma merged commit 614ed1b into master Sep 1, 2023
@mykhailo-kuchma mykhailo-kuchma deleted the poc/OLPEDGE-2832 branch September 1, 2023 12:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants