-
Notifications
You must be signed in to change notification settings - Fork 1
Wayne-X/CSPAutoGen
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
CSPAutoGen: on-the-fly CSP generator with flexible deployment. Work done at Northwestern University under Professor Yan Chen with wmcalyj and wayne-x. Adds better scraping and js based template tools, relative to previous repo. "EECS-495-CSP" contains Mengchao's scraping tools "templateStage" contains Wayne's template creation/matching tools ////////////////////////////////////// SETUP Install the following: node.js mongodb node inspector python ////////////////////////////////////// TRAINING 1. start mongodb sudo service mongodb stop sudo mongod 2. start db server (in separate terminal) node EECS-495-CSP/CSP-Applier/training/db_server.js 3. crawl and scrape for scripts (in separate instance) -- reads the URLs from sources.txt, crawls and scrapes -- saves to mongodb -- -- database: webcontents -- -- collection: purescripts cd EECS-495-CSP && exec ./render_site.sh -f sources.txt -m 10 4. end crawling and scraping cd EECS-495-CSP && exec ./stop_all.sh focus on db server terminal, ctrl+c 5. begin script training node templateStage/makeTemplate.js ////////////////////////////////////// MATCHING 1. start mongodb sudo service mongodb stop sudo mongod 2. start db server (in separate terminal) node EECS-495-CSP/CSP-Applier/training/db_server.js 3. crawl and scrape for scripts (in separate instance) -- reads the URLs from sources.txt, crawls and scrapes -- saves to mongodb -- -- database: webcontents -- -- collection: compareScripts ??? cd EECS-495-CSP && exec ./render_site.sh -f sources.txt -m 10 // todo, ask Mengchao to modify write collection 4. end crawling and scraping cd EECS-495-CSP && exec ./stop_all.sh focus on db server terminal, ctrl+c 5. match (by script or by collection) node templateStage/ifMatch.js dbName collectionName domainName [script ObjectID] node templateStage/ifMatch.js webcontents compareScripts cnn node templateStage/ifMatch.js webcontents compareScripts cnn 56f2eea51cd7e16f99b900ee
About
Automated CSP generator with flexible deployment. Affiliated with Northwestern University
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published