-
-
Notifications
You must be signed in to change notification settings - Fork 304
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
option to get just urls #10
Comments
Solution would be to add url matching regex such as this to codebase with a urls only flag added to options
Temporary easy solution until then gospider -s https://jaeles-project.github.io/ -t 10 -d 1 -c 10 | grep -o -E "(([a-zA-Z][a-zA-Z0-9+-.]*\:\/\/)|mailto|data\:)([a-zA-Z0-9\.\&\/\?\:@\+-\_=#%;,])*" | sort -u | tee justurls.txt You alternatively can save the output with -o flag then grep the contents of output directories file (or files if multiple input sites such as live site subdomains in this example)
Feel free to replace
with
If already have list of domains in the file alivedomains.txt or whichever |
I feel "-q, --quiet Suppress all the output and only show URL" flag was meant for only showing the URL but its not working in the latest version v1.1.2. |
Same here. -q gives no effect. |
The -q option is not yet fully effective and continues to print unnecessary information to the screen. |
Would be cool an option to get just the urls alone without the [words] and everything else. like a flag to do that
The text was updated successfully, but these errors were encountered: