Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow for time masking #33

Open
thequbit opened this issue May 31, 2014 · 2 comments
Open

Allow for time masking #33

thequbit opened this issue May 31, 2014 · 2 comments

Comments

@thequbit
Copy link
Owner

Allow for certain times of the day to be masked off to prevent scraping. This will be used to not scrap during 'normal business hours'.

@thequbit
Copy link
Owner Author

thequbit commented Jun 3, 2014

This is only applicable within self dispatch mode. May be outside the scope of BarkingOwl lib, and to implement queue mode might need to be used. Will revisit.

@thequbit
Copy link
Owner Author

Thinking I will add this as an optional field to the url_data payload within the dispatcher. If not present, it will default to no mask.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant