fix: handle graphql rate limit

[mishraomp]

---

Thanks for the PR!

Any successful deployments (not always required) will be available below.
API available
Frontend available

Once merged, code will be promoted and handed off to following workflow run.
Main Merge Workflow

[Copilot]

Pull Request Overview

This PR adds retry logic with exponential backoff and jitter to the GraphQL query function to handle GitHub API rate limits.

• Introduces getGraphQlResponseOnQuery with configurable retry attempts and backoff
• Implements detailed logging for rate‐limit retries
• Documents the new function with JSDoc

Comments suppressed due to low confidence (1)

crawler/src/main.js:161

• Consider adding unit tests or integration tests that mock rate-limit responses and verify that the retry count, exponential backoff delays, and success/failure paths behave as expected.

async function getGraphQlResponseOnQuery(query) {

[Copilot]

Pull Request Overview

A PR to improve rate limit handling for GraphQL queries by implementing exponential backoff with jitter.

• Introduces new environment-based delay constants (BASE_DELAY, MAX_DELAY, and JITTER_FACTOR).
• Adds the getGraphQlResponseOnQuery function which implements retry logic with exponential backoff and jitter.