Skip to content

Add an extend_context option for adding members to the crawling context #2131

Description

@vdusek

ContextPipeline is internal, so there is no supported way to put custom members on the crawling context - users have to subclass the crawler. JS v4 exposes an extendContext option that runs before navigation, making its members visible to the navigation hooks and the request handler alike, and additionally lets navigation hooks override context members.

JS implementation: apify/crawlee#3119, apify/crawlee#3672

✍️ Drafted by Claude Code

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request.t-toolingIssues with this label are in the ownership of the tooling team.

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions