Legacy

Run xWalk (FileMaker)

• update idp.data branches master and xwalk
• place latest HGV FileMaker dump into import directory (e.g. ~/projects/xWalk/data/HGV.xml)
• run conversion script xWalk.py [modified|new]
  • updates list of all HGV ids currently known to idp.data (java -Xms512m -Xmx1536m net.sf.saxon.Query -q:xql/getHgvId.xql > data/hgvId.xml)
  • updates list of all place ref URIs currently used by HGV (java -Xms512m -Xmx1536m net.sf.saxon.Query -q:xql/getPlaceRef.xql > data/placeRef.xml)
  • produces ca. 60 split files and 60 intermediate files (numbered from HGV1.xml to HGV66.xml plus one duplicates.xml)
  • does the conversion for both new and modified files by default
• push new and modified contents of idp.data folder HGV_meta_EpiDoc to github

Summary

assuming xWalk has been installed in a folder called ~/projects/xWalk

cd ~/data/idp.data/papyri/master; git fetch; git merge papyri/master;
cd ~/data/idp.data/papyri/xwalk; git fetch; git merge papyri/master; git push papyri xwalk_ossiriand:xwalk

[EXPORT FILEMAKER XML to ~/projects/xWalk/data/HGV.xml]

cd ~/projects/xwalk/
xWalk.py new

cd ~/data/idp.data/papyri/xwalk
git add HGV_meta_EpiDoc
git commit -m 'HGV xwalk new files (fmp12)' HGV_meta_EpiDoc

cd ~/projects/xwalk/
xWalk.py modified

cd ~/data/idp.data/papyri/xwalk
git add HGV_meta_EpiDoc
git commit -m 'HGV xwalk modified files (fmp12)' HGV_meta_EpiDoc

git push papyri xwalk_ossiriand:xwalk

Run xWalk using Oxygen

(allows us to make use of Saxon 9.4 EE, including new output parameters such as saxon:line-length)

Transformation scenarios

Update HGV Ids

• XML URL: file:/absolute/path/to/xwalk/trunk/HGVmeta_to_EpiDoc/data/void.xml
• XQuery URL: file:/absolute/path/to/xwalk/trunk/getHgvId.xql
• Transformator: Saxon-HE
• Parameters:
  • hgvMetaEpiDoc = /Volumes/Admin/idp.data/HGV_meta_EpiDoc readonly

Update Place Refs

• XML URL: file:/absolute/path/to/xwalk/trunk/HGVmeta_to_EpiDoc/data/void.xml
• XQuery URL: file:/absolute/path/to/xwalk/trunk/getPlaceRef.xql
• Transformator: Saxon-HE
• Parameters:
  • hgvMetaEpiDoc = /Volumes/Admin/idp.data/HGV_meta_EpiDoc readonly

Split

• XML URL: ${currentFileURL} (dummy entry, appropriate input files will be selected lateron)
• XSL URL: file:/absolute/path/to/xwalk/trunk/HGVmeta_to_EpiDoc/divide.xsl
• Transformator: Saxon-HE
• Parameters:
  • splitDirectory = ../split output directory for split files

Conversion

• XML URL: ${currentFileURL} (dummy file, will be replaced by split files)
• XSL URL: file:/absolute/path/to/xwalk/trunk/HGVmeta_to_EpiDoc/HGVmeta-converter.xsl
• Transformator: Saxon-EE
• Parameters:
  • fileMentionedDates = /Volumes/Admin/idp.data/HGV_metadata/XML_dump/MentionedDates.xml readonly
  • fileNomeList = /Volumes/Admin/idp.data/HGV_metadata/XML_dump/nomeList.xml readonly
  • fileRepository = /Volumes/Admin/idp.data readonly
  • outputPath = ../../HGV_meta_EpiDoc output directory for EpiDoc XML files
  • process = new (new, modified, all)

Transformation process

Preparations

• Update HGV ids manually
  • java -Xms512m -Xmx1536m net.sf.saxon.Query -q:../getHgvId.xql > data/hgvId.xml hgvMetaEpiDoc=/Users/Admin/idp.data/HGV_meta_EpiDoc
• Update place refs manually
  • java -Xms512m -Xmx1536m net.sf.saxon.Query -q:../getPlaceRef.xql > data/placeRef.xml hgvMetaEpiDoc=/Users/Admin/idp.data/HGV_meta_EpiDoc
• Fetch latest version of idp.data from github for readonly repository (idp.data) as well as for the working branch (idp.data_xwalk)
  • cd idp.data && git fetch && git merge origin/master
  • cd idp.data_walk && git fetch && git merge origin/master && git push origin xwalk_papyrillio:xwalk
• Export HGV FileMaker → XML (all records, all fields, UTF-8)
  • Place HGV FileMaker XML dump into import directory (idp.data/HGV_metadata/XML_dump/HGV.xml)
• Create empty folder for split files in idp.data
  • rm -rf HGV_metadata/split && mkdir HGV_metadata/split

Split-Scenario

• Choose HGV.xml from your Oxygen projects's idp.data repository
• Right click → Transform → Configure Transformation Scenario
• Run Split scenario

Conversion-Scenario

• Choose split directory from your Oxygen projects's idp.data repository
• Right click → Transform → Configure Transformation Scenario
• Run Conversion scenario (set process parameter to new, modified or all)

Clean-up

• Delete split directory
• Delete import file HGV.xml

Commit

• git add HGV_meta_EpiDoc
• git commit -m 'xwalk new/modified HGV files (*.fp7)' HGV_meta_EpiDoc

---