Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Develop a method to search for the best subset of data (concept/language coverage) #6

Open
LinguList opened this issue Jul 1, 2017 · 0 comments

Comments

@LinguList
Copy link
Contributor

With lingpy's coverage method, we can search for mutual coverage in the data. However, for the CLICS case, if we want to have the three/four subsets (1000+ concepts for 300 languages, 500+ concepts for 500 languages, 250+ concepts for 1000 languages, one meta-set with all data), more sophistication is needed. I imagine using the concepticon to pre-analyse a couple of about 10 promising datasets in lexibank. Since coverage varies inside each dataset, however, the methods should further test for individual coverage for each language variety in the data. It is not yet clear how to do this in concrete, as the problem is not entirely trivial, but an approximation could preselect the most promising concepts based on concept coverage and then test for each language variety in the data, whether it conforms to a certain coverage threshold. These values would then be reported for each release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant