Document structure parsing as a separate component

[marcverhagen]

Simple document structure is now done in docmodel.parsers, and simple document structure is built in into the TarsqiDocument class by having the elements variable with its list of TarsqiDocElements, in addition, the output ttk format groups everything by document element.

It is probably better to use separate components for document structure where these components would be sensitive to the --source option and maybe the --genre option as well. This would probably involve doing away with TarsqiDocElement and putting the TagRepositories directly into the TarsqiDocument. Document structure would then be added as its own set of tags.

This would make the docmodel code cleaner and delegate structure to its own component.

[marcverhagen]

Did part of this in b065a91 and ee10e2b by pulling apart the document structure parser and the metadata parser.

[marcverhagen]

The elements list and its TarsqiDocParagraph members are still in place. All other changes were made. The question is whether it is a good idea to have the elements list and the doc_element tag as a tag in the ttk output that wraps around other ttk tags.

This may not be resolved till I play with importing data in the ttk format.

[marcverhagen]

Having played with the ttk format a bit I am now convinced that having the element list is a bad idea. There are some messy dependencies between TagRepositories on TarsqiDocElements that should not be there and that prove hard to debug.

So TarsqiDocElement will be retired. This is a bit involved and includes:

• Update SourceDoc to have just one TagRepository called tags.
• Remove elements from TarsqiDocument
• Add a TagRepository called tags or tarsqi_tags on TarsqiDocument. This pulls tags from source as needed, for example when the source is a TTK file with Tarsqi tags.
• Update the SourceParserXML.
• Update the SourceParserText.
• Update the SourceParserTTK.
• Update MetaData parser if needed.
• Update default document structure parser, just adding tags instead of create doc elements.
• Adjust PreprocessorWrapper.
• Adjust GUTimeWrapper.
• Adjust EvitaWrapper.
• Adjust SlinketWrapper.
• Adjust S2TWrapper.
• Adjust BlinkerWrapper

[marcverhagen]

Done in 1a9ffc3