You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I would like to see an option to crawl and download offsite resources last, after the breadth-first grab of the target site.
I believe offsite links are already being distinguished. This option could be implemented by pushing such links to the back of the queue, or keeping a second queue to switch to after the primary one is finished.
I would like to see an option to crawl and download offsite resources last, after the breadth-first grab of the target site.
I believe offsite links are already being distinguished. This option could be implemented by pushing such links to the back of the queue, or keeping a second queue to switch to after the primary one is finished.
Related issue at ArchiveBot with rationales: ArchiveTeam/ArchiveBot#199
The text was updated successfully, but these errors were encountered: