Skip to content

clone git repos, sha256 all of the files, catalog it all

License

Notifications You must be signed in to change notification settings

jpegleg/recurse-catalog

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

# recurse-catalog
recata: Cataloging data sets in csv format as date,hash,url,uri,dataset recursively for a given directory.
source-data: Recording the URL and the URI where the data came from
recurse-catalog: clones the git repos and is a wrapper for recata and source-data 

Usage of recurse-catalog:

# call program # target the local code repo # repo url # repo uri context # realm keyword
recurse-catalog /mnt/repo/jpegleg/ https://github.com /jpegleg/fe-html-template jpegleg-github-dev

There will be several .dat and .csv files output and the recurse-catalog. 
The load.csv is truncated each time while the others are cataloged by timestamp.
The load.csv is indended to be shipped off to a database for tracking etc,
while the timestamped data files are packed up into a local copy.

About

clone git repos, sha256 all of the files, catalog it all

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages