Skip to content
LOD visualization tool for humanities datasets
Branch: master
Clone or download
Latest commit b7c2ef2 Sep 30, 2018
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
bin document the source of the zip file used by amalgamate_xml.py May 18, 2018
css
data add REEDElizabethanSample and CanAuthorsBiography Jun 23, 2018
docs Merge branch 'beta' Jun 25, 2018
images use new close_all.png and close_box.png button on snippet boxes Feb 9, 2016
js add name and active flag Oct 24, 2017
lib Merge branch 'alpha' of github.com:smurp/huviz into alpha Jun 23, 2018
src
test add OnceRunner and use it in clean_up_all_dirt_once() Oct 21, 2017
vendor make GreenTurtle throw Errors not just console.log them Jan 26, 2017
views Merge branch 'alpha' of https://github.com/smurp/huviz into alpha Jun 22, 2018
.DS_Store Replaced with smaller version Jun 20, 2018
.coffeelint
.gitignore WIP: edge disconnection bugged Dec 30, 2013
Cakefile WIP: add huvis_node_ctrl.coff and Cakefile Nov 29, 2013
Gruntfile.coffee add OnceRunner and use it in clean_up_all_dirt_once() Oct 21, 2017
Makefile add amalgamate_xml.py which works but needs structural IDs in the data May 18, 2018
OrlandoXML.py export_ttl Nov 4, 2013
README.md add link to /smurp/huviz Sep 30, 2018
crrt.html WIP: convert to huviz.coffee Dec 1, 2013
extractOrlandoTagInfo.py move Node class to tagtree.py for use in OrlandoXML.py Oct 17, 2013
graph_ex1.png new screenshot Feb 10, 2015
issue_template.md upload issue template Jun 14, 2018
make_app.coffee VERY FAST snippet lookup using libxmljs Jun 2, 2014
old_huvis.html rename the node version to huvis.html, move node to port 9999 Dec 17, 2013
orlando2RDFregex3.txt initial add Oct 8, 2013
orlando2RDFregex4.txt WIP: peeking support ie highlighting and showing individual edges Aug 21, 2014
orlando2RDFxpath3.txt add --xpaths and --rules support to orlandoScrape.py Mar 13, 2015
orlandoScrape.py suppress 'skipping' spew Jun 11, 2016
orlando_short.xml initial add Oct 8, 2013
orlando_tag_admin.csv add orlando_tag_admin.{csv,md} Oct 17, 2013
orlando_tag_admin.md add orlando_tag_admin.{csv,md} Oct 17, 2013
orlando_tag_tree.json make the canonical form of orlando_tag_tree.json have sorted_keys Oct 19, 2013
orlando_tag_tree_PRETTY.json add orlando_tag_tree_PRETTY.json Oct 17, 2013
orlando_timeline.js changed dateOfdeath to dateOfDeath Oct 16, 2013
orlando_timeline.json
package.json add schema.org and FOAF ontologies, closes #138 Apr 6, 2018
predicate_sets.json add standardName Oct 16, 2013
requirements.txt get OrlandoOntologyPull5.ttl working with xPath Oct 22, 2015
schema.sql add incomplete sqlite support, see SqliteEmitter Mar 14, 2016
server.coffee add current code version as subliminal watermark at bottom closes #89 May 27, 2017
server.js add current code version as subliminal watermark at bottom closes #89 May 27, 2017
sparqlTesting.py add shebang and make sparqlTesting.py executable Nov 3, 2014
tagtree.py
timeline.html
turtle_test.html trivial Nov 4, 2013
yegodd.html WIP: YEG LOD: adding socrata meta-metadata format as seen at https://… Feb 23, 2014

README.md

huviz

Image

/cwrc/HuViz is a fork of /smurp/huviz

Installation

# Install huviz from github
git clone https://github.com/smurp/huviz.git

Installation (for running orlandoScrape.py)

# On OSX Mavericks install homebrew
http://crosstown.coolestguidesontheplanet.com/os-x/55


# If you want to run
# On OSX you should set up pyenv-virtualenv
https://github.com/yyuu/pyenv-virtualenv

# Make a virtualenv
pyenv virtualenv huvizenv

# use it
echo "PYENV_VERSION=huvizenv" > .python-version

# install the python requirements
pip install -r requirements.txt

Installation (for running the server)

# install NodeJS using NVM for most flexibility
# known to work on NodeJS >= v6.11.3
# (as of this writing, the latest Long Term Support version)

https://github.com/creationix/nvm#install-script

# Install `nvm` using the curl command in 'Install Script'.
# Then quit that Terminal window and start a new one to make sure its firing up automatically.
# There are tips at the bottom of the NVM README in case of problems.

# Then install the LTS version of `node` itself like this:
nvm install --lts

# Make sure you've got a suitable version of Node
node -v # expecting v6.11.3 or later

# Then do classic normal npm stuff
npm install # install needed modules

Running the server during development

npm run dev

Runner CLI tests during development

npm run watchTest

uses https://www.npmjs.com/package/npm-watch https://www.npmjs.com/package/mocha

Running the server

npm start

Operating orlandoScrape.py

--limit 2
    limit the number of writers processed

Converting XML to Turtle (TTL)

./orlandoScrape.py --outfile data/test_20.ttl  --limit 20 -v

See data/test_20.ttl

Converting XML to NQuads

./orlandoScrape.py  --outfile data/test_1.nq   --limit 1

See data/test_q.nq

Converting XML to JSON

How to produce the full JSON output as orlando_all_entries_2013-03-04.json (the default behaviour):

./orlandoScrape.py --infile orlando_all_entries_2013-03-04.xml --outfile orlando_all_entries_2013-03-04.json  --regexes orlando2RDFregex4.txt

How to produce the poetess JSON output as orlando_poetesses_2013-02-12.json:

./orlandoScrape.py --infile orlando_poetesses_2013-02-12.xml --outfile orlando_poetesses_2013-02-12.json  --regexes orlando2RDFregex4.txt

How to produce orlando_timeline.json

egrep 'dateOf|standardName' orlando2RDFregex4.txt > orlando_timeline.regex
./orlandoScrape.py --infile orlando_all_entries_2013-03-04.xml --outfile orlando_timeline.json --regex orlando_timeline.regex -v

Running the Orlando timeline locally

git clone https://github.com/smurp/huviz
python -m SimpleHTTPServer
open http://localhost:8000/timeline.html

Generating tag_tree.json

./extractOrlandoTagInfo.py --compact --outfile orlando_tag_tree.json
You can’t perform that action at this time.