Skip to content
GoogleScholar Web Scraping using Free VPN In Python
Python
Branch: master
Clone or download

Latest commit

Fetching latest commit…
Cannot retrieve the latest commit at this time.

Files

Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
GoogleScholarWebScraping.py
README.md
_config.yml

README.md

GoogleScholar-WebScraping-Using-VPN

Since Google Scholar doesn’t provide any API this Script can be used to Web scrap Google Scholar to get Citations and Authors for a Published paper. Here we are providing the papers from DBLP website. By using free VPN, this program overcomes the google captcha .The program works in the following way

  1. Importing Packages
  2. Getting published papers from DBLP website for a provided link
  3. Getting free VPN
  4. Google Scholar web search for the given paper
  5. Scraping the Google Scholar
  6. Converting the data into Data Frame and saving it as CSV output
You can’t perform that action at this time.