#Web Crawler ##By Taufik Akbar Abdullah - 18212002
#Content
- crawler.py
- indexed/indexed.txt
#Use Crawler.py has two parameters. The first parameter is mode, the second parameter is the input. ##Available Modes
-crawl <url>To crawl the web starting from given url-search <term>To search term in the indexed result, will give the url of where it found your keyword
Example:
> $ python crawler.py -crawl http://www.github.com
> $ python crawler.py -search repository