RSSCrawler

A podcast archive program. Also suitable for normal RSS too.

Dependencies

• Python 3
• All modules listed in requirements.txt
• Network connection

Installation

git clone https://github.com/Jamesits/RSSCrawler.git
cd RSSCrawler
pip3 install -r requirements.txt

Configuration

Define which site to crawl in tasks.txt.

Set proxy and other config in config.py.

Running

Run python3 crawl.py.