Skip to content

TDL-16246: Make MAX_API_RESPONSE_SIZE configurable and add pagination for card stream. #30

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

savan-chovatiya
Copy link
Contributor

@savan-chovatiya savan-chovatiya commented Nov 18, 2021

Description of change

TDL-16246: Make MAX_API_RESPONSE_SIZE configurable

  • Added support of configurable parameter cards_response_size in config file for card stream.(Default : 1000)
  • Added pagination for the card stream.

Manual QA steps

  • The verified output of the old tap with data emitted with a new approach for card stream.
  • Provided limit in integer, and string format and verified that it's used in the request.

Risks

  • Minimal. Test coverage suggests no issues with pagination.

Rollback steps

  • revert this branch

Copy link

@dbshah1212 dbshah1212 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, provided some comment changes.

@savan-chovatiya savan-chovatiya changed the title TDL-16246: Added config parameter and pagination fo card stream TDL-16246: Make MAX_API_RESPONSE_SIZE configurable and add pagination for card stream. Nov 18, 2021
Copy link
Contributor

@kspeer825 kspeer825 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved with 1 comment.

* Dry up the unittest

1. Remove unused imports
2. Add a default config that each test uses
3. Use `setUp` to create a shared variable
4. Order assertions so it's (expected, actual)
5. Simplify the mocking to just one function
6. Simplify the API for `mocked_get`

* Fix the doc strings, update the test class name
@dsprayberry dsprayberry mentioned this pull request Sep 28, 2022
@dsprayberry dsprayberry merged commit b5cd877 into master Sep 28, 2022
@dsprayberry dsprayberry deleted the TDL-16246-make-max-api-response-size-configurable-for-cards branch September 28, 2022 20:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants