Implement editing of more complex forms of span annotation: dependencies, co-references

[proycon]

No description provided.

[proycon]

Viewing implemented (in branch globviz), editing pending...

[proycon]

Various of these annotations are implemented using span roles, we need a way of presenting these in the editor, analogous to higher-order annotations (they can be considered a form of that), but with the added complexity that each has a span of its own, whilst the parent span element may also still have wrefs that do not fall under the scope of any role (consider e.g. predicate).

We have several sub issues:

• a) Implement a select span mechanism per span role
• b) Enable/disable select span mechanism for the parent span annotation (we may need an extra foliaspec property here)
• c) Submission of span roles to the back-end, and block creation of the span annotation when required span roles are not provided
• d) Automatically add annotation fields for required span roles when adding a span annotation (for example a dependency needs a head and a dependent).
• e) Semantic roles are not span roles but first-order span annotations nested in predicates. How to represent nesting in the editor?
• f) Syntactic units are not span roles but may be nested to form trees. Same question as e.

[proycon]

sub-issues a and b have been implemented now.

[proycon]

Complication regarding subissue c. Span annotation elements have their targets property set to everything in the span, recursing into span roles.
Solution: implemented a scope property that contains all targets with recursion, the targets property now only contains explicit targets.

A mechanism is needed for proper adding of span annotation prior to adding the span roles. Solution: FQL now supports the somewhat patchy ADD.. RESPAN NONE FOR SPAN ID x & ID y & ID z syntax that adds an entity but respans it immediately, even to an empty span if needed.

[proycon]

Subissue c: Query is formulated with subqueries now but fails in backend:

Query failed: error Forbidden: FoLiA Document Server error: FoLiA error in proycon/example: [ValueError] Unable to add object of type Word to Dependency . Type not allowed as child.

Query was: ADD dependency OF alpino-set WITH class "blah" annotator "proycon" annotatortype "manual" datetime now confidence NONE RESPAN NONE (ADD dep ID "undefined" SPAN  ID WR-P-E-J-0000000001.p.1.s.2.w.6) (ADD hd ID "undefined" SPAN  ID WR-P-E-J-0000000001.p.1.s.2.w.7) FOR SPAN  ID WR-P-E-J-0000000001.p.1.s.2.w.6 & ID WR-P-E-J-0000000001.p.1.s.2.w.7 FORMAT flat RETURN ancestor-target

Traceback:

 File "/home/proycon/lamachine/lib/python3.5/site-packages/foliadocserve-0.5-py3.5.egg/foliadocserve/foliadocserve.py", line 575, in query
    result =  query(doc,False,self.debug >= 2)
  File "/home/proycon/lamachine/lib/python3.5/site-packages/PyNLPl-1.1.0-py3.5.egg/pynlpl/formats/fql.py", line 1884, in __call__
    focusselection, targetselection = self.action(self, targetselector, debug) #selecting focus elements further constrains the target selection (if any), return values will be lists
  File "/home/proycon/lamachine/lib/python3.5/site-packages/PyNLPl-1.1.0-py3.5.egg/pynlpl/formats/fql.py", line 1655, in __call__
    focusselection.append( target[0].add(action.focus.Class, *target, **action.assignments) ) #handles span annotation too
  File "/home/proycon/lamachine/lib/python3.5/site-packages/PyNLPl-1.1.0-py3.5.egg/pynlpl/formats/folia.py", line 1594, in add
    return layer.append(child,*args,**kwargs)
  File "/home/proycon/lamachine/lib/python3.5/site-packages/PyNLPl-1.1.0-py3.5.egg/pynlpl/formats/folia.py", line 4216, in append
    return super(AbstractAnnotationLayer, self).append(child, *args, **kwargs)
  File "/home/proycon/lamachine/lib/python3.5/site-packages/PyNLPl-1.1.0-py3.5.egg/pynlpl/formats/folia.py", line 1413, in append
    child = Class(self.doc, *args, **kwargs)
  File "/home/proycon/lamachine/lib/python3.5/site-packages/PyNLPl-1.1.0-py3.5.egg/pynlpl/formats/folia.py", line 649, in __init__
    self.append(child)
  File "/home/proycon/lamachine/lib/python3.5/site-packages/PyNLPl-1.1.0-py3.5.egg/pynlpl/formats/folia.py", line 4071, in append
    return super(AbstractSpanAnnotation,self).append(child, *args, **kwargs)
  File "/home/proycon/lamachine/lib/python3.5/site-packages/PyNLPl-1.1.0-py3.5.egg/pynlpl/formats/folia.py", line 1438, in append
    elif Class or (isinstance(child, AbstractElement) and child.__class__.addable(self, set)): #(prevents calling addable again if already done above)
  File "/home/proycon/lamachine/lib/python3.5/site-packages/PyNLPl-1.1.0-py3.5.egg/pynlpl/formats/folia.py", line 1278, in addable
    raise ValueError("Unable to add object of type " + Class.__name__ + " to " + parent.__class__.__name__ + " " + extra + ". Type not allowed as child.")
[QUERY FAILED] FoLiA Error in proycon/example: [ValueError] Unable to add object of type Word to Dependency . Type not allowed as child.

[proycon]

Above problem is resolved by proycon/pynlpl@17589ac

[proycon]

Submission works mostly now, but response+update after submission is not complete yet

[proycon]

Submission works, resolved by latest foliadocserve update, subissue c should be done now. d was already solved earlier as well. e and f remain.

[proycon]

Nested span annotation (subissue e/f) mostly works now