muh spider

Copyright (c) 2015-2016 Michael Hoyt.

• search
• spider
• httpd

Getting Started

1. cd PROJECT_ROOT
2. virtualenv -p python3 ./env
3. source ./env/bin/activate
4. pip install -r requirements.txt
5. python run.py --help

COPY-PASTA:

cd /spider
virtualenv -p python3 ./env
source ./env/bin/activate
pip install -r requirements.txt
python run.py --help

References

• The Anatomy of a Large-Scale Hypertextual Web Search Engine [1]

• Algorithm Design Techniques [2]

• The Power of Plain Text [3]

• Design Patterns: Elements of Reusable Object-oriented Software [4]

• Select, Insert, Delete: Flask-SQLAlchemy [5]

• Database Normalization [6]

• MIT 6.034 Artificial Intelligence, Fall 2010 (MITx) [7]

• Software Versioning [8]

• Google's Stack Circa 2003 [9]

Bibliography

[1] Brin, Sergey, and Lawrence Page. "The Anatomy of a Large-Scale Hypertextual Web Search Engine." The Anatomy of a Search Engine. Stanford University, n.d. Mon. 5 Jan 2015. http://infolab.stanford.edu/~backrub/google.html.

[2] Bentley, Jon Louis. "Algorithm Design Techniques." Programming Pearls. 2nd ed. Reading, MA: Addison-Wesley, 2000. 77-86. Print.

[3] Hunt, Andrew, and David Thomas. "The Power of Plain Text." The Pragmatic Programmer: From Journeyman to Master. Reading, MA: Addison-Wesley, 2000. 73-77. Print.

[4] Gamma, Erich, Richard Helm, Ralph Johnson, and John Vlissides. Design Patterns: Elements of Reusable Object-oriented Software. Reading, MA: Addison-Wesley, 1995. Print.

[5] "Select, Insert, Delete." Select, Insert, Delete — Flask-SQLAlchemy 0.16 Documentation. N.p., n.d. Web. 24 June 2015. https://pythonhosted.org/Flask-SQLAlchemy/queries.html.

[6] "Database Normalization." Wikipedia. Wikimedia Foundation, n.d. Web. 24 June 2015. https://en.wikipedia.org/wiki/Database_normalization.

[8] "Software Versioning." Wikipedia. Wikimedia Foundation, n.d. Web. 07 July 2015. https://en.wikipedia.org/wiki/Software_versioning.