-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update normalize.tsv #106
Update normalize.tsv #106
Conversation
Removing potentially incorrect normalisation: ł sometimes used for ɫ (i.e. lˠ) not ɬ, ƀ sometimes used for β not v
This is fine, will however cause a LOT of trouble, as many people use the damn L in our data, so this HAS side effects. I'd be inclined to leave the normalization, since if something has been normalized, this can always be retrieved from the code, and we even through warnings, if this happens now. |
But an alias is a good idea: this means, you will retain the original character, and can from there check that it is different. Is that a good compromise? |
I get that and it's annoying. But if people sometimes use ł to mean ɫ and sometimes to mean ɬ I don't see how either normalisation or an alias is likely to work. Is this not rather something that should be dealt with by an orthography profile? |
Leaving it in as a normalisation seems very risky to me. ɫ and ɬ are quite different beasts... |
so make an alias, as I said. |
If you use orthography profiles by now, they WILL point you to the use of aliases. |
Also to normalizations, so you can trace this as a researcher. |
E.g., this is the output we now (review pending) receive on a profile check in CLDF: Found 17 generated graphemes
Found 13 modified graphemes
|
Okay, can you clarify for me though what I exactly you are saying I should add as an alias? You mean ł as an alias of lˠ, right, alongside ɫ? Or do you mean I should rather add it as an alias of ɬ? I thought normalisation was for lookalikes, like : for ː etc. not for cases like this... |
sorry, I never saw your reply, @cormacanderson. I'll have to look into this tomorrow! |
So for me, the ł is a lookalike. It is less clear what KIND of lookalike it is, but you find it frequently in the literature, for both cases you mention. It may indeed be useful to say: let us drop our normalization, as it only normalizes arbitrarily in one direction, and let us force people to be more exact. |
So yes, @cormacanderson, just merge the PR if you agree still with the decision. For an update, this may force us to adjust some tests, but it is for the sake of clarity. |
Removing potentially incorrect normalisation: ł sometimes used for ɫ (i.e. lˠ) not ɬ, ƀ sometimes used for β not v.
(Currently checking IE-CoR transcriptions and have found cases)