What's new
Major refactor to improve working with large URL input lists
- Added goroutines to speed up working with large input lists, with a one second rate limit to avoid getting blocked or using up network resources.
- URLs are added to a queue and are now added recursively, so each link is searched for script source attribute tags and those are also searched for more source attribute tags, so no code should be missed
- Simplified some sections of the code and removed redundant legacy code
- Improved tests with assertions and added a mock server for testing getContents
- Improved comments and added docstrings