Semi-Automated Shop Finder
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
app
project
requirements
.gitignore
LICENSE.md
Makefile
README.md
addresses_hourly.py
analytics_hourly.py
categorize_hourly.py
debug.py
manage.py
migrate_sqlite_postgres.sh
printscreen_hourly.py
scrape.py
scrape_annotate.py
scrape_hourly.py
search_hourly.py

README.md

Another Web Scrapper

Install

Debian 7

Install dependencies:

#sudo aptitude install python-virtualenv ipython python-lxml python-crypto python-unidecode python-qt4 libqt4-webkit libqt4-core libqt4-gui libqt4-dev qt4-qmake xvfb
sudo aptitude install python-pyside.qtwebkit python-virtualenv ipython python-lxml python-crypto python-unidecode xvfb git

For sqlite3:

sudo aptitude install python-pysqlite2 sqlite3

For postgres: sudo aptitude install python-psycopg2

Then checkout repository and initialize environment:

git clone https://github.com/I-TREND/SASF.git
cd scrap
make initenv
bin/activate
make dev-setup

You will be asked for administrator user name and password.

Now you are ready to start server and enjoy:

sudo -u www-data  xvfb-run -a bin/python manage.py runserver 0.0.0.0:8000

Setup apache and mod-wsgi

sudo aptitude install apache2 libapache2-mod-wsgi