A web crawler for google scholar authors profiles for authors from Coventry University. Also included is a vertical search engine similar to google scholar however it returns results where at least one author is from Coventry University. It is implemented using Flask and MySQL
NB: Commands issued are for a linux environment,however no one is limited.
- Create a new folder for the project and navigate into it
$ mkdir my_project
$ cd my_project
2.Inside the newly created folder create a virtual environment
$ Python3.9 -m venv < env name>
- Create another folder,name it "main",navigate to it and clone to it the applicatons files.
mkdir main
cd main
$ git clone https://github.com/Dev-Elie/Search-Weather-Wordnet-Location-Web-App.git
- Activate the virtual environment
$. venv/bin/activate
OR
$ source venv/bin/activate
- Navigate into the "main" folder and install the requirements.
$ pip install -r requirements.txt
- Make the run file an executable
$ chmod 777 run
- Launch the application
$ ./run
Incase you face any issues with refused connections,below is a quick fix;
- Restart your network on each subsequent crawl
- Intergrate a proxy service
Liked this project ?
Feel free to tweet about it