Skip to content

gigachad80/Go-Screpo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🚀 Project Name : Go-Screpo

Maintenance

Go-Screpo :

📌 Overview

Go-Screpo is a web scraper which scrapes all the Github repos from target user and saves all the repos in JSON format . E.g :

 [
  {
    "name": "TxtRipper",
    "description": "Hunt robots.txt via CLI",
    "url": "https://github.com/gigachad80/TxtRipper"
  },
  {
    "name": "gigachad80",
    "description": "",
    "url": "https://github.com/gigachad80/gigachad80"
  }
 ]

Note

When I say it can scrape 1K+ repositories within 52 seconds, I mean that if the target user has around 1,000 repositories, it will take approximately 52 seconds. If the user has fewer repositories, it will take even less time—typically around 4–5 seconds.

🤔 Why This Name?

Cause it scrape repos and it's written in Go

📚 Requirements & Dependencies

  • Golang

📥 Installation Guide & Usage :

⚡ Quick Install:

  1. Git clone this URL.
git clone https://github.com/gigachad80/Go-Screpo
Now build go binary depending on your architecture.

OR

  1. You can directly run via go run screpo.go <target user>

🍃 Usage :

go screpo.go <target user>

E.g : go run screpo.go gigachad80

OR

.\screpo.exe gigachad80 ( Windows )
./screpo gigachad80 ( Linux )

⌚ Total Time taken to develop , test .

Approx 43 min. An additional 26 minutes were spent attempting to add extra features, but I was unable to complete them.

🙃Why I Created This

Just for fun , now it depends on you how you'll use it.

💓 Credits:

📞 Contact

📧 Email: pookielinuxuser@tutamail.com

📄 License

Licensed under GNU AGPL v3

Last Updated : June 6,2025

About

Scrape 1K+ repos within 52 sec from the targeted user

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages