Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Errors in data by Urban-2011-160 #1338

Closed
LinguList opened this issue Nov 10, 2023 · 11 comments
Closed

Errors in data by Urban-2011-160 #1338

LinguList opened this issue Nov 10, 2023 · 11 comments

Comments

@LinguList
Copy link
Contributor

I tried to be consistent, but a recent check showed spelling errors in my annotation of semantic changes in Urban-2011-160.
@xrotwang, we have a situation in this list that maybe warrants intervention by deciding how to handle these cases. My format is clear, it can be parsed, it does not throw errors apart from me having typos in the glosses, but we may want to model these cases in JSON to avoid problems, so if you have an idea how to handle this list, it would be very useful.

@LinguList
Copy link
Contributor Author

To provide explanation, I add a column semantic_change to the data, which looks in extreme cases like this:

[3] «smoke» > «fog/mist» (11 polysemies, 3 overt markings); [7] «smoke» > «dust» (8 polysemies, 4 overt markings); [8] «smoke» > «cloud» (7 polysemies, 2 overt markings)

The first order split is by a ; , each item of this list refers to a semantic change reference of the base concept ("smoke") to the other concept:

[3] «smoke» > «fog/mist» (11 polysemies, 3 overt markings)

Parsing can be done with regex of other modes, but obviously, this representation only works if an explanation is given, and my tests showed that the concept glosses, which are a key to other items in the list (fog/mist has a separate row) fail in three cases:

{
        "mirrow": "mirror",
        "straw/hay": "straw",
        "cheeck": "cheek",
        }

While these spelling errors are easily corrected, I wonder if we can make a consistent typical network link inside a concept list, that refers to another concept and adds (arbitrary) information. Should I try JSON?

@xrotwang
Copy link
Contributor

xrotwang commented Nov 10, 2023 via email

@LinguList
Copy link
Contributor Author

I have a concrete proposal of how to deal with this, using a new example by Winter-2022-103.
My JSON now looks like you can see below:

ID	NUMBER	ENGLISH	CONCEPTICON_ID	CONCEPTICON_GLOSS	SOURCES	TARGETS
Winter-2022-102-1	1	cloud	1489	CLOUD	[{"name": "smoke", "id": "Winter-2022-102-1", "overt_marking": 2, "polysemy": 7}, {"name": "sky", "id": "Winter-2022-102-85", "overt_marking": 2, "polysemy": 8}, {"name": "rain", "id": "Winter-2022-102-84", "overt_marking": 2, "polysemy": 4}]	[{"name": "fog/mist", "id": "Winter-2022-102-2", "overt_marking": 7, "polysemy": 24}, {"name": "day", "id": "Winter-2022-102-19", "overt_marking": 3, "polysemy": 2}, {"name": "sky", "id": "Winter-2022-102-85", "overt_marking": 11, "polysemy": 8}, {"name": "rain", "id": "Winter-2022-102-84", "overt_marking": 2, "polysemy": 4}]

@LinguList
Copy link
Contributor Author

So I have links of sources and targets (we could reduce to one of them), and a source node contains the ID of the source (Concepticon-Conceptlist-Entry-ID), the name of the concept, and other properties that would be properties of the edge from source current node.

@eva-dlce-zenodo
Copy link

I'd like to make the function of "id" here more explicit - borrowing syntax from CLDF markdown: We could use "ValueTable#cldf-Winter-2022-102-1" as value for "id" - and maybe call the the field valueReference?

@LinguList
Copy link
Contributor Author

Ah, okay, easy to do.

@LinguList
Copy link
Contributor Author

I'd prepare -- when I find time -- a PR for both Urban's previous dataset and Winter-2022-102.

@xrotwang
Copy link
Contributor

It would need to be FormTable and formReference, though. That's how we model glosses (i.e. items in concept lists) in concepticon-cldf: https://github.com/concepticon/concepticon-cldf/tree/main/cldf#table-glossescsv

@xrotwang
Copy link
Contributor

Btw.: In the current concepticon CLDF data, we have no standard way to refer to a "Concept", i.e. the set of all glosses for the same concept in one concept list. In your example above, that wouldn't be a problem, I think, because refering to the particular gloss (i.e. the concept in a particular language) is the right thing to do. But there may be cases, where we want to refer to a concept with many glosses in the same concept list, e.g. https://concepticon.clld.org/values/Luniewska-2016-299-2

@LinguList
Copy link
Contributor Author

Would the tabular representation not restrict the link anyway to a row which is a concept? I think for the Multi-Simlex-Data, we may have another version, where we'd want to link to a cell in the tabular data, which would then be not a concept, but a gloss?

@xrotwang
Copy link
Contributor

Ah, yes, if the data is represented in tabular form that could be made explicit through the metadata. I was thinking of something intermediate - i.e. some sort of JSON with some CLDF semantics.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants