Skip to content

fix(redis): Do not remove handled request data from request queue#1787

Merged
vdusek merged 3 commits intoapify:masterfrom
kozlice:redis-queue-keep-data
Mar 12, 2026
Merged

fix(redis): Do not remove handled request data from request queue#1787
vdusek merged 3 commits intoapify:masterfrom
kozlice:redis-queue-keep-data

Conversation

@kozlice
Copy link
Contributor

@kozlice kozlice commented Mar 12, 2026

Description

Unlike FS and SQL storages that keep handled requests data, Redis removes it.

Issues

?

Testing

A dedicated unit test added.

Manual testing: using RedisQueueClient, enqueue a page, run crawler, check if :data key holds request info.

Checklist

  • CI passed

@kozlice kozlice changed the title fix: Do not remove request data from Redis fix: Do not remove handled request data from Redis Mar 12, 2026
@kozlice
Copy link
Contributor Author

kozlice commented Mar 12, 2026

Looks like an unrelated test got stuck and failed.

@janbuchar janbuchar requested a review from Mantisus March 12, 2026 10:27
Copy link
Collaborator

@vdusek vdusek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice! Just a note regarding the testing...

Copy link
Collaborator

@vdusek vdusek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks @kozlice !

@vdusek vdusek changed the title fix: Do not remove handled request data from Redis fix(redis): Do not remove handled request data from request queue Mar 12, 2026
@vdusek vdusek merged commit 3008c61 into apify:master Mar 12, 2026
30 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants