We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
@crawlee/core
Currently when dataset used as requestsFromUrl and contains request-alike data item objects userData is ignored, instead when-if userData contains urls each added as separate request. Sample https://api.apify.com/v2/datasets/rl2e6Xcs11vMMCvyN/items?clean=true&format=json
requestsFromUrl
[{ "url": "https://www.facebook.com/wayoflifesq/", "userData": { "channelDescriptionLinks": [ { "text": "Instagram", "url": "https://www.instagram.com/wayoflifesq/?hl=en" }, { "text": "Twitter", "url": "https://twitter.com/wayoflifesq?lang=en" }, { "text": "Facebook", "url": "https://www.facebook.com/wayoflifesq/" } ], "inputChannelUrl": "https://www.youtube.com/channel/UC3kfx81WYXgNBf1bNIcO5Fg", "channelName": "WAYOFLIFESQ" } }]
Its almost working https://console.apify.com/view/runs/S4KFp0kfbV3NEXwAJ Idea is to pass dataset as startUrls in input:
{ "startUrls": [ { "requestsFromUrl": "https://api.apify.com/v2/datasets/rl2e6Xcs11vMMCvyN/items?clean=true&format=csv" } ] }
Just add proper parsing, needs to be more accurate
No response
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Which package is the feature request for? If unsure which one to select, leave blank
@crawlee/core
Feature
Currently when dataset used as
requestsFromUrl
and contains request-alike data item objects userData is ignored, instead when-if userData contains urls each added as separate request.Sample https://api.apify.com/v2/datasets/rl2e6Xcs11vMMCvyN/items?clean=true&format=json
Motivation
Its almost working https://console.apify.com/view/runs/S4KFp0kfbV3NEXwAJ
Idea is to pass dataset as startUrls in input:
Ideal solution or implementation, and any additional constraints
Just add proper parsing, needs to be more accurate
Alternative solutions or implementations
No response
Other context
No response
The text was updated successfully, but these errors were encountered: