Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sitediff init not creating Paths.txt #134

Closed
Saibot97 opened this issue Apr 6, 2022 · 5 comments
Closed

Sitediff init not creating Paths.txt #134

Saibot97 opened this issue Apr 6, 2022 · 5 comments

Comments

@Saibot97
Copy link

Saibot97 commented Apr 6, 2022

Hello,

I just installed Sitediff on a fresh Ubuntu VM with Ruby 2.6.6.
When i run the Sitediff init command, tried with a few webpages, it just creates the sitediff.yaml, no paths.txt at all.
Unbenannt

@kdborg
Copy link
Contributor

kdborg commented Apr 10, 2022

sitediff init https://4nes.com will create the initial file.
sitediff crawl will crawl the site and create the paths.txt file.

@Saibot97
Copy link
Author

Okay, i got it now.
The page im accessing has an htaccess and a normal login area.
The .htaccess got managed in url like: username:password@url
But is there a way to give sitediff user credentials for a login area ?

@kirk-brown-ew
Copy link
Collaborator

kirk-brown-ew commented Apr 12, 2022

In your sitediff.yml file you can add credentials to the curl options:

settings:
  curl_opts:
    userpwd: "username:password"

@Saibot97
Copy link
Author

Putted the credentials for the login Area in the settings like you said, but still get the same error when try to crawl.

The Error:
Unbenannt

And this is the Login-Area i need to pass

Unbenannt2

@kirk-brown-ew
Copy link
Collaborator

Those credential settings are for Basic HTTP Auth.

There isn't a way to log in via a form just yet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants