feat: add search_after cursor pagination

[poyrazK]

Summary

• Add search_after: Option<Vec<Value>> to SearchRequest for cursor-based pagination
• Add sort_values: Option<Vec<Value>> to SearchHit (returned on every hit)
• When search_after is provided, skip to the first doc whose sort values are greater than the cursor (O(1) instead of O(n))
• sort_values includes [sort_field_value, score, doc_id] for stable tie-breaking
• search_after and from are mutually exclusive (validated at request time)
• search_after requires sort field to be specified (validated at request time)

Test plan

• cargo test --workspace — all tests pass
• cargo clippy --workspace --all-targets — clean

API usage example

// First request
GET /myindex/_search
{"size": 10, "sort": [{"created_at": "desc"}]}

Response includes sort_values on each hit:
{"hits": [{"id": "1", "sort_values": ["2024-01-15T10:30:00Z", 1.0, "1"]}]}

// Second request - use last hit's sort_values
GET /myindex/_search
{"size": 10, "search_after": ["2024-01-15T10:30:00Z", 1.0, "1"]}

[coderabbitai]

Warning

Rate limit exceeded

@poyrazK has exceeded the limit for the number of commits that can be reviewed per hour. Please wait 42 minutes and 40 seconds before requesting another review.

To keep reviews running without waiting, you can enable usage-based add-on for your organization. This allows additional reviews beyond the hourly cap. Account admins can enable it under billing.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

ℹ️ Review info

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: b0351a14-ccd9-439a-8b40-2ea8ccc4d48b

📥 Commits

Reviewing files that changed from the base of the PR and between 92ae7e7 and 3adc0f4.

📒 Files selected for processing (4)

• rust/crates/cloudsearch-common/src/lib.rs
• rust/crates/cloudsearch-common/tests/round_trip.rs
• rust/crates/cloudsearch-index/src/lib.rs
• rust/crates/cloudsearch-index/tests/coverage.rs

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch feat/search-after-pagination

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[poyrazK]

It's okay to merge