fix(scrapy): Resolve Crawlee's request data round-trip failure in request conversion

[vdusek]

Summary

• Adds a reproduction test for a bug where to_apify_request() fails with CrawleeRequestData() argument after ** must be a mapping, not CrawleeRequestData after two roundtrips through Scrapy↔Apify request conversion when spiders propagate userData to follow-up requests
• Root cause: Request.from_url() writes a CrawleeRequestData object into UserData.__pydantic_extra__['__crawlee'], which is then found by .get('__crawlee') on the next roundtrip and passed to CrawleeRequestData(**obj) instead of CrawleeRequestData(**dict)
• Test is marked xfail until the fix is applied

Test plan

• Reproduction test added and confirmed to trigger the exact error from production
• Fix to be applied in to_apify_request() to sanitize user_data before passing to Request.from_url()
• Remove xfail marker after fix

🤖 Generated with Claude Code

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 86.47%. Comparing base (e343ed5) to head (febd963).
⚠️ Report is 1 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master     #832      +/-   ##
==========================================
+ Coverage   86.44%   86.47%   +0.02%     
==========================================
  Files          48       48              
  Lines        2899     2905       +6     
==========================================
+ Hits         2506     2512       +6     
  Misses        393      393              

Flag	Coverage Δ
e2e	38.03% <0.00%> (-0.08%)	⬇️
integration	59.44% <0.00%> (-0.13%)	⬇️
unit	74.45% <100.00%> (+0.05%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[vdusek]

@honzajavorek Could you please confirm this fix resolves your issue?

[honzajavorek]

Wow, quick fix! 👀 I'll try next week, too much on my plate now.

[vdusek]

@honzajavorek try it then with the latest beta and let us know, thanks