Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fetch runs table without Bravado deserialization #1573

Merged
merged 9 commits into from Nov 24, 2023

Conversation

Raalsky
Copy link
Contributor

@Raalsky Raalsky commented Nov 23, 2023

Before submitting checklist

  • Did you update the CHANGELOG? (not for test updates, internal changes/refactors or CI/CD setup)
  • Did you ask the docs owner to review all the user-facing changes?

Copy link

codecov bot commented Nov 23, 2023

Codecov Report

Attention: 18 lines in your changes are missing coverage. Please review.

Comparison is base (766f0ae) 79.97% compared to head (9b9e300) 73.81%.

Files Patch % Lines
src/neptune/api/searching_entries.py 66.66% 9 Missing ⚠️
...eptune/internal/backends/hosted_neptune_backend.py 28.57% 5 Missing ⚠️
...e/metadata_containers/metadata_containers_table.py 71.42% 4 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #1573      +/-   ##
==========================================
- Coverage   79.97%   73.81%   -6.16%     
==========================================
  Files         291      292       +1     
  Lines       14511    14233     -278     
==========================================
- Hits        11605    10506    -1099     
- Misses       2906     3727     +821     
Flag Coverage Δ
e2e ?
e2e- ?
e2e-management ?
e2e-s3 ?
e2e-s3-gcs ?
e2e-standard ?
macos 73.51% <62.50%> (-6.20%) ⬇️
macos-latest ?
py3.10 ?
py3.7 73.81% <62.50%> (-5.64%) ⬇️
py3.7.16 ?
py3.8 ?
py3.9 ?
ubuntu 73.67% <62.50%> (-6.07%) ⬇️
ubuntu-latest ?
unit 73.81% <62.50%> (-0.49%) ⬇️
windows 72.99% <62.50%> (-6.72%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.



def iter_over_pages(
*, iter_once: Callable[..., List[Any]], step: int, max_server_offset: int = 10000
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What do you think not pass callable here and always call get_single_page inside? And rename it to get leaderboard_entries?

To make it not so general

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe move max_server_offset to const?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, I agree with your suggestion but as we're going to reimplement the pagination (move from offset + limit to starting_after) it's probably not worth it right now as we're going to get rid of max_server_offset.

I'm not sure about getting rid of callable here as this potentially abstracts the whole pagination scheme and simplifies a testing setup. I'll try to remember this suggestion to address that with the next Pull Request.

Copy link
Contributor

@artsiomtserashkovich artsiomtserashkovich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Raalsky Raalsky merged commit f927f95 into master Nov 24, 2023
4 checks passed
@Raalsky Raalsky deleted the rj/fetch-runs-bravado-no-deserialization branch November 24, 2023 14:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants