Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question: RSSMix useless? #303

Closed
dataarchivist opened this issue Nov 20, 2019 · 6 comments
Closed

Question: RSSMix useless? #303

dataarchivist opened this issue Nov 20, 2019 · 6 comments

Comments

@dataarchivist
Copy link

dataarchivist commented Nov 20, 2019

I didnt try if AB can do it by itself, but for now, I use http://rssmix.com/ to merge my rss feeds into one to cronjob a lot of websites at once. Its fully free btw.
If its not already possible to catch them easily via txt file or something else, it would be nice to have.

@pirate
Copy link
Member

pirate commented Nov 20, 2019

Archivebox never re-downloads urls that have been already archived, so you can already pipe in all your RSS feeds without merging / deduplicating them first, so this isn't needed.

@pirate pirate closed this as completed Nov 20, 2019
@dataarchivist
Copy link
Author

Is an option to redownload a site again planned?

@pirate
Copy link
Member

pirate commented Nov 20, 2019

Yes, see #179

@dataarchivist
Copy link
Author

Archivebox never re-downloads urls that have been already archived

But its does for rss feeds.
So, if you merge the feeds, you normaly get every x hour an fresh rss with new links.

@pirate
Copy link
Member

pirate commented Nov 21, 2019

But its does for rss feeds.

It downloads the feed itself, but it doesn't re-download the pages within it after the first time.

@dataarchivist
Copy link
Author

But its does for rss feeds.

It downloads the feed itself, but it doesn't re-download the pages within it after the first time.

A normal feed didnt have the same link a second time. ;)
Anyway, I did this with another cron, it was just interesting to know.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants