Skip to content

M-HamzaKhan/github-data-scraper

Repository files navigation

GitHub Profile Data Extractor

This project contains two Python scripts for extracting GitHub profile data and contribution statistics.

Scripts

  1. Github_Daily_Monthly_Script.py - Extracts daily and monthly contribution data using GraphQL API
  2. Github_Script.py - Extracts comprehensive profile data including repositories and commits

Setup

  1. Install dependencies:
pip install -r requirements.txt
  1. Set your GitHub token as environment variable:
# Windows
set GITHUB_TOKEN=your_github_token_here

# Linux/Mac
export GITHUB_TOKEN=your_github_token_here
  1. For the daily/monthly script, create github_profile_urls.csv with GitHub profile URLs

Usage

Daily/Monthly Contributions

python Github_Daily_Monthly_Script.py

Full Profile Data

python Github_Script.py

Output

  • Daily/Monthly script creates Excel files in Daily_Monthly_Data/ folder
  • Profile script creates Excel files in TASK/ folder

Requirements

  • Python 3.7+
  • Valid GitHub Personal Access Token
  • Internet connection for API calls

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages