A tool to extract names of github repos of any user
Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites using its HTML structure, In this post, I will explain basic fundaments of web scraping using python and also explore it by a live demonstration with two python libraries Beautifulsoup and requests respectively.
- basic understanding of web scraping
- how to extract data from a website using classes and HTML tags
- how to use requests module to get data
- how to use Beautifulsoup
- python3
- requests
- bs4
sudo apt-get python3-pip pip3 install requests pip3 install bs4
- run the file main.py by
python3 main.py
- Enter the username
- You'll be prompted if you want to store it in a file