Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to use perform login of portia? #601

Closed
Peter311 opened this issue Oct 18, 2016 · 2 comments
Closed

How to use perform login of portia? #601

Peter311 opened this issue Oct 18, 2016 · 2 comments

Comments

@Peter311
Copy link

When crawl one website, I need to login the website first.So I confige the perform login of portia.But it still don't work.Can you give a video address or tutorial,How to use perform login of portia?Thanks very much!

@ruairif
Copy link
Contributor

ruairif commented Jan 19, 2017

If the login requires Javascript interaction login is not possible at the moment

@ruairif ruairif closed this as completed Jan 19, 2017
@taylorsmurphy
Copy link

taylorsmurphy commented Apr 24, 2018

Is this still true? This issue pops up at the top of google seaches for "portia login" so it could be useful to flag it as fixed, not being developed (and so don't use portia if javascript might be involved), or whatever the case may be.

edit for posterity:

http://portia.readthedocs.io/en/latest/spiders.html?highlight=login#configuring-login-details

Configuring login details
If you need to log into a site, you can configure login details by ticking ‘Perform login’ in the spider properties menu. Here you can set the login URL, username and password.

Enabling JavaScript
You can enable JavaScript in your spider by ticking Enable JavaScript in the spider properties menu. Note that you’ll need to set the SPLASH_URL Scrapy setting to your Splash endpoint URL for JavaScript to work during the crawl.

So presumably you can now login and use javascript and, one would naturally assume, login when there's javascript involved

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants