Skip to content

mixu/npmjs-github-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

npmjs-github-crawler

For fetching metadata about npm packages from github.

find-git-packages.js

This thing:

  • reads the npm database from a local copy,
  • finds the packages that have set a repository (type = git)
  • writes them to stdout as newline-separated JSON

crawl.js

This thing:

  • reads an input file of newline-separated JSON
  • goes to github and fetches the repository metadata for the specific repository
  • writes that metadata to ./cache
  • obeys the github rate limit

About

Gets github metadata for the repos in the npm database

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published