Releases: adamdehaven/fetchurls
Releases · adamdehaven/fetchurls
wget --reject-regex
Utilizes wget
--reject-regex
to filter files.
Handle invalid user input
Updates the $USER_SAVE_LOCATION
and $USER_FILENAME
back to the default if the user clears out the value during interactive mode.
Removing spaces from spinner
v3.3.1 Removing spaces from spinner
Update grep flows to be case-insensitive
v3.3.0 Fix grep to be case-insensitive for redirects
Changing bang to bin/bash
v3.2.5 Changing bang to bin/bash. Resolves #13
Check for user settings if non-interactive is set.
v3.2.4 Check for user settings if non-interactive is set. Fixes #12.
Fixing line endings
v3.2.3 Fixing line endings
Adding --ignore-robots flag
- Added
-i, --ignore-robots
flag which will ignore therobots.txt
file for the domain.
Fixing 3xx HTTP Status Codes
Splitting out HTTP status checking, fixing an issue with 3xx status codes.
Adding authentication
- Adding
--username
and-password
flags for URLs requiring authentication. The values get passed to the underlyingwget
command. - Adding
--sleep
flag to add delay between retrievals. - Fixes an issue related to option/flag processing.