Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

-urls extract more than urls #29

Closed
bsysop opened this issue Jan 9, 2020 · 2 comments
Closed

-urls extract more than urls #29

bsysop opened this issue Jan 9, 2020 · 2 comments

Comments

@bsysop
Copy link

bsysop commented Jan 9, 2020

When run -urls arg, return also mailto: witch are in tag but are not exactly a URL

# hakrawler -domain ███████.com -scope subs -depth 1 -plain --urls
https://coach.███████.com/login
mailto:contato@███████.com

I think mailto: ftp: ssh: etc, are useful, but not is a url, maybe filter or make another arg to extract all protocols.

What do you think?

PS: I can send the url case in particular, dont want my client found his domain in public repo =]

@hakluke
Copy link
Owner

hakluke commented Jan 11, 2020

Hey @bsysop! I did notice this in testing but I'm not really concerned about it, I think including urls with schemas other than http/https is a good thing. If it's breaking tool chaining or something, you can always just pipe it into grep like this:

hakrawler -domain ███████.com -scope subs -depth 1 -plain --urls | grep http

@hakluke hakluke closed this as completed Jan 11, 2020
@bsysop
Copy link
Author

bsysop commented Jan 11, 2020

Perfect, thanks @hakluke

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants