This is a file I wrote for some friends who used to work at Gawker to scrape their post archives into a text format.
-
Clone or download this repo
-
Unzip it.
-
Open a Terminal (Press Command-Space and type "Terminal"), and navigate to the repo. Assuming you downloaded and unzipped in the Downloads folder:
cd ~/Downloads/gawker-archive-master
- Run the following command to download the pre-reqs. Your password will be required
sudo easy_install pip
- Run these command to install the pre-eqs
sudo pip install --upgrade setuptools
sudo pip install -r requirements.txt
- Run the script
python gawker.py --user your_username_here
Enjoy!