Documentation: Please elaborate on the greedy parameter

[GrazingScientist]

Hi @adbar ,

could you please in you documentation go into detail on what the greedy parameter actually does. In the documentation, it is mentioned as if it would be self-explanatory. However, I really cannot estimate its potential/dangers.

Thanks! 😃

[adbar]

Quick update: I'm currently working on relevant code parts and I'm also redefining what the concept means. So I'm waiting for the code to stabilize before updating the documentation.

Basically the greedy option currently (v0.9.0) means:

1. a certain capacity to address affixes in an unsupervised way
2. a stronger reduction through a further iteration of the search algorithm
   e.g. "angekündigten" → "angekündigt" (standard) → "ankündigen" (greedy).

In the future it's probably going to be reduced to (2), the benefits of (1) will be integrated without needing intervention by the users. In some cases (2) is closer to stemming than to lemmatization, this should be mentioned in the docs.

[GrazingScientist]

Thanks for the update. Seems I need to consider being "greedy". 😁