Skip to content

0.4.3

Latest

Choose a tag to compare

@SergeyShk SergeyShk released this 26 Oct 02:12
a09d526

A patch of anyTS with the fixes found by the review of ruTS 0.19 on Russian corpora: the rule of subordinating marks from 0.4.2 gets a hook for the context of a mark, and the kinds of the coordinated clauses follow the words themselves.

Requirements

The same as anyTS 0.4.0: Python 3.11 or newer, spaCy 3.8.15 or newer within 3, preshed 3.0.11 or newer except 3.0.14 (3.0.15 fixes the tokenizer again).

pip install anyts==0.4.3

Features

  • SyntaxStats.is_subordinating_mark(token), a hook every dependent mark of a conjunct or a parataxis passes to make the clause subordinate, so a library reads the context of a word that is a conjunction and a pronoun (Russian «что ж», «что называется», «когда ..., то ...»). The default is the new is_subordinating_mark(token, subordinating_marks) of anyts.syntax_stats: the words of the mark with those of its fixed expression in the set. is_subordinate_clause_head and is_infinitive_clause_head take the check as is_subordinating_mark.

Changes of numbers

  • Conjuncts of a marked clause. A conjunct with a subject of its own, or an infinitive one, belongs to the marked clause it is coordinated to; one sharing the subject does not, as a model attaches the predicates of the main clause to the marked clause too.
  • The form of the word itself. An infinitive clause needs an infinitive of its own: a finite verb attached as a conjunct of an infinitive was an infinitive clause. A finite conjunct with a subject of its own of an infinitive takes the kind and the T-unit of the clause of the first word above the infinitives that is none (he came to help and she stayed: two T-units).
  • On a Spanish sample checked by the review, the clause heads without a kind are as many as in 0.4.2.

Fixes

  • Docs: the parts of split_paragraphs for dispersion are between blank lines; for a text with a paragraph on every line, its lines are the paragraphs, as in CohesionStats.

Links