Skip to content

kaankarakoc42/Scrapy-Github-Spider

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Scrapy-Github-Spider

Github spider with scrapy

skills used

skills state
selectors ✔️
items ✔️
piplines ✔️
spider with args ✔️
middlewares

run

scrapy crawl github -a username="your github username" or scrapy crawl github -a usernames=['1','2']

for setting output path

scrapy crawl github -a username="your github username" -o test.json

About

Github spider with scrapy

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages