Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Setting mode in conf.json is ignored #50

Open
DerChaot opened this issue Aug 15, 2019 · 1 comment
Open

Setting mode in conf.json is ignored #50

DerChaot opened this issue Aug 15, 2019 · 1 comment

Comments

@DerChaot
Copy link

Are you submitting a bug report or a feature request?

Bug report.

What is the current behavior?

Changing the mode from page-only to page-same-domain as described in the manual wont change the search behavior.

{
"use": "puppeteer",
"headless": true,
"script": "./userFns.js",
"mode": "page-same-domain",
"depth": 5,
"seeds": [
"...."
],
"warc": {
"naming": "url",
"append": "true"
},
"connect": {
"launch": true,
"host": "localhost",
"port": 9222
},
"crawlControl": {
"globalWait": 60000,
"inflightIdle": 1000,
"numInflight": 2,
"navWait": 8000
}
}

What is the expected behavior?

The search mode should change.

How to fix.

If I write the search mode under crawlControl it does change.
{
"use": "puppeteer",
"headless": true,
"script": "./userFns.js",
"seeds": [
"....."
],
"warc": {
"naming": "url",
"append": "true"
},
"connect": {
"launch": true,
"host": "localhost",
"port": 9222
},
"crawlControl": {
"globalWait": 60000,
"inflightIdle": 1000,
"numInflight": 2,
"navWait": 8000,
"mode": "page-same-domain",
"depth": 5
}
}
In the file config.yml the mode is also listed under crawlControl but its not in the manual.

@BubuAnabelas
Copy link

This seems to be a documentation error rather than a bug.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants