Skip to content

karthikmprakash/github_repos_scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 

Repository files navigation

Github repo names of any user

A tool to extract names of github repos of any user

Introduction:

Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites using its HTML structure, In this post, I will explain basic fundaments of web scraping using python and also explore it by a live demonstration with two python libraries Beautifulsoup and requests respectively.

What you will learn from this post:

  • basic understanding of web scraping
  • how to extract data from a website using classes and HTML tags
  • how to use requests module to get data
  • how to use Beautifulsoup

Requirements:

  • python3
  • requests
  • bs4

Installation:

sudo apt-get python3-pip pip3 install requests pip3 install bs4

How to run this code

  • run the file main.py by python3 main.py
  • Enter the username
  • You'll be prompted if you want to store it in a file

Releases

No releases published

Packages

No packages published

Languages