Skip to content

Conversation

@vdusek
Copy link
Collaborator

@vdusek vdusek commented Nov 18, 2025

Description

  • Use only pipes (|) as separators when constructing unique_key values.
  • Since the changes affect only the unique_key of the always_enqueue requests, it is not a breaking change.
  • The random string component is placed at the beginning, so an always_enqueue unique key looks like this:
unique_key='7VnDVJgE3TrjbDl86|GET|e3b0c442|e3b0c442|https://crawlee.dev/'

This format is slightly better for debugging, as the individual parts of the unique key (including the URL) are easier to identify.

Issues

Testing

  • Current tests pass.

Checklist

  • CI passed

@vdusek vdusek self-assigned this Nov 18, 2025
@vdusek vdusek added the t-tooling Issues with this label are in the ownership of the tooling team. label Nov 18, 2025
@github-actions github-actions bot added this to the 128th sprint - Tooling team milestone Nov 18, 2025
@vdusek vdusek merged commit af46a37 into master Nov 18, 2025
25 of 26 checks passed
@vdusek vdusek deleted the unify-separators-in-unique-key-construction branch November 18, 2025 14:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

t-tooling Issues with this label are in the ownership of the tooling team.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Unify separators in unique_key construction (| vs _)

4 participants