Non-deterministic results for Catalan lemmatizer across different runs

[BLKSerene]

>>> import spacy
>>> [token.lemma_ for token in spacy.load('ca_core_news_sm')('parlada')]
['parlat']
>>> [token.lemma_ for token in spacy.load('ca_core_news_sm')('parlada')]
['parlat']
>>> [token.lemma_ for token in spacy.load('ca_core_news_sm')('parlada')]
['parlat']

================================ RESTART: Shell ================================
>>> import spacy
>>> [token.lemma_ for token in spacy.load('ca_core_news_sm')('parlada')]
['parlad']
>>> [token.lemma_ for token in spacy.load('ca_core_news_sm')('parlada')]
['parlad']
>>> [token.lemma_ for token in spacy.load('ca_core_news_sm')('parlada')]
['parlad']

May be related: #8421

• Operating System: Windows 10 x64
• Python Version Used: 3.8.10
• spaCy Version Used: 3.1.1

[polm]

Thanks for the report, that looks like a bug - we'll give it a look!

[polm]

For the record I was able to reproduce this on Linux.

import spacy
print([token.lemma_ for token in spacy.load('ca_core_news_sm')('parlada')])
print([token.lemma_ for token in spacy.load('ca_core_news_sm')('parlada')])
print([token.lemma_ for token in spacy.load('ca_core_news_sm')('parlada')])

[polm]

OK, I found the root of this problem. The lemmatizing function can find multiple potential lemmas for a word. When it does, they are accumulated in a list, but before returning them the list is made unique by calling list(set(forms)). However, the order of a set is not consistent from run to run in Python, and only the first entry in the resulting list is used normally, which causes the inconsistency we see here.

This looks like it also affects the lemmatizers for French, Dutch, Romanian, and Russian, or at least they have list(set(xxx)) calls.

I'll work on a fix for this. Thanks again for reporting!

[github-actions]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.