Prepare release

[chrzyki]

No description provided.

[FredericBlum]

This PR does not address #8 right? I think we have to take care of this, since this lead to many doubled entries.

[chrzyki]

No, this will be a separate PR.

[chrzyki]

Tests are allowed to fail for now. 47827ed and subsequent are a draft to use the online supplement as discussed in #8 to also fix lexibank/lexibank-analysed#49. Note that this is a very quick first draft for using the other data source and I fully expect cognates etc. not to be working 100% correctly for now.

Things I need to do:

1. verify the data (particularly in comparison to the old version)
2. verify cognate sets
3. verify languages (theoretically, the online supplement version of the dataset includes a substantial amount of additional languages)
4. answer the question whether the data sheet I'm using (i.e. based on English glosses) is indeed one that can be used or if rather should be 33403_SOURCE4_2_A.cognatesets.csv

[chrzyki]

No, this will be a separate PR.

Apologies, I just continued working in this PR!

[chrzyki]

Tests are allowed to fail for now. 47827ed and subsequent are a draft to use the online supplement as discussed in #8 to also fix lexibank/lexibank-analysed#49. Note that this is a very quick first draft for using the other data source and I fully expect cognates etc. not to be working 100% correctly for now.

Things I need to do:

1. verify the data (particularly in comparison to the old version)

2. verify cognate sets

3. verify languages (theoretically, the online supplement version of the dataset includes a substantial amount of additional languages)

4. answer the question whether the data sheet I'm using (i.e. based on English glosses) is indeed one that can be used or if rather should be `33403_SOURCE4_2_A.cognatesets.csv`

After a first spot checking everything looks good with using the online supplement rather than the previous raw TSV. The cognate sets also seem correct to me. @LinguList, this would close #8 (but I'm still going to do some more checks and clean up the XLSX->CSV process). It fixes the issue with the cognates occuring multiple times and leading to doublets (triplets, etc.) in the lexeme list and Lexibank.

Also, the online supplement version of the data contains more language (varieties) than the previous raw data file ((x) denotes that those were present in the previous version of the raw data):

• PLa (x)
• CW-QY (x)
• C-WC
• C-LJ
• C-LB
• C-CJ
• C-QS
• CE-YA
• W-SZP (x)
• W- SLZ
• W-DT
• W-YL
• E-DC (x)
• E-HS
• E-TS
• XZ (x)
• YL (young) (x, as just YL)
• YL (old)
• MD (x)
• Eka

Should those be included as well or were they excluded for a reason? (not an expert on the languages/studies so there might be a reason I'm not seeing here).

[LinguList]

Thanks a lot. In my opinion, the major work is done for now. Very cool, that you used the official data now, @chrzyki. If we realize that there are any different errors in the future, we can look into those in subsequent versions. For now, I'd say that this is good enough for lexibank 2.0.

[chrzyki]

Thank you very much for checking! I'll prepare the updated release for Lexibank 2.0.