Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Rust SDK check_crawl_status errors if there are arrays in the metadata #1304

Open
justindgm opened this issue Mar 6, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@justindgm
Copy link

Describe the Bug
I suspect that when calling check_crawl_status, the Rust SDK expects all of the metadata fields to be strings, even though sometimes they can be Vec.

For example

"viewport": ["width=device-width, initial-scale=1", "width=device-width,initial-scale=1.0,maximum-scale=1.0,user-scalable=no,viewport-fit=cover"]

or

"twitter:image": ["http://localhost:3000/#{FALLBACK_IMAGE}", "https://images.contentstack.io/v3/assets/bltdc2476c7b6b194dd/blt46acaa0d3fe3fd06/66db08a7b89507bdf18d1c3d/Sports_Impact_Report.jpg"]

If you have a crawl with vector metadata like this, then the Rust SDK will throw the error

Error: Failed to parse response: invalid type: sequence, expected a string

However, if your crawl has only string fields in the metadata, it works as expected.

To Reproduce

  1. Get a crawl with vectors in the metadata
  2. Call check_crawl_status with that crawl id using the rust sdk

Expected Behavior
The sdk should throw an error

Environment (please complete the following information):

  • OS: macOS Sequoia 15.3
  • Firecrawl Rust SDK Version: 1.0.0
  • Node.js Version: N/A
@justindgm justindgm added the bug Something isn't working label Mar 6, 2025
@blackmad
Copy link

blackmad commented Mar 7, 2025

I think I'm probably getting this error too - "https://www.cnn.com/: Failed to parse response: invalid type: sequence, expected a string"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants