It is basically a technique or a process in which large amounts of data from a huge number of websites is passed through a web scraping software coded in a programming language and as a result, structured data is extracted which can be saved locally in text document.
- Python 3.x
- Requests library (
pip install requests) - BeautifulSoup library (
pip install beautifulsoup4)
- Run the
wiki_Scrapper.pyscript. - Enter the wikipedia url in the right format
- The data will be scrapped from wikipedia and converted into text file.
- The text file will be saved.
This project is licensed under the MIT License