Multithreaded-Web-Crawler

Web Crawler that does the job faster by using multithreading

Usage Guide

Load a text file full of URLs that you hope to crawl into inputFiles.

Run commands in this order:

1. make clean
2. make all
3. make test
   This simply runs the test file in the inputFiles directory which has 1,000,000 links in it

Resources

getaddrinfo() man page
Socket Programming C
snprintf()