Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HTTP node in pagination mode ignore batch settings #8062

Closed
nosovk opened this issue Dec 15, 2023 · 2 comments
Closed

HTTP node in pagination mode ignore batch settings #8062

nosovk opened this issue Dec 15, 2023 · 2 comments
Labels
in linear Issue or PR has been created in Linear for internal review

Comments

@nosovk
Copy link
Contributor

nosovk commented Dec 15, 2023

Describe the bug
When we try to use pagination mode in n8n, we can produce big amount of requests, which causes hitting of rate limits.
To avoid such behavior, we need to make some pauses between requests.
I was trying to use batch mode settings to provide timeout between requests:
image
but it seems that those settings are ignored in batch mode.

To Reproduce
Steps to reproduce the behavior:

  1. Create HTTP node
  2. Setup HTTP paginated request
  3. Measure amount of requests in a seccond
  4. See error

Expected behavior
I expect, that if I set some pause in batch settings, that those settings applied to paginated requests.

Environment (please complete the following information):

  • OS:Вщслук
  • n8n Version [e.g. 1.18.1]
  • Node.js Version [e.g. 20]
  • Database system [PGSql]
  • Operation mode [main]
@Joffcom
Copy link
Member

Joffcom commented Jan 2, 2024

Hey @nosovk,

Thanks for the report I have created NODE-1029 as our internal dev ticket to look into adding this.

@Joffcom
Copy link
Member

Joffcom commented Jan 18, 2024

Hey @nosovk,

Good news, We have added a batch setting just for pagination which has been working well with systems like hubspot. This was released in 1.24.0, For now I am going to close this but if you are still seeing an issue after upgrading let me know and we can open it again.

@Joffcom Joffcom closed this as completed Jan 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
in linear Issue or PR has been created in Linear for internal review
Projects
None yet
Development

No branches or pull requests

2 participants