-
Notifications
You must be signed in to change notification settings - Fork 69
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
classifier: add core- and anti-HEP-ontology #2282
Conversation
* Adds a reduced ontology with only the core HEP keywords. * Adds an anti-HEP-ontology with keywords indicating irrelevance for HEP. Signed-off-by: fschwenn <florian.schwennsen@desy.de>
@fschwenn do you have instead changes WRT the current full ontology? And also, how do you think of using the antihep one? As soon as there is an antiHEP keyword matched then it's a reject? |
I hope not, anti-HEP contains for example Fibonacci, and we have 335 core records with Fibonacci in the fulltext. |
@michamos, @fschwenn I have digged the code and discovered that antiHEP KB is already there: https://github.com/inspirehep/inspire-next/blob/master/inspirehep/kbs/corepar.kb So the current meaning is: list all core keywords found in the paper that are not anti HEP. Now I am puzzled: why are there keywords that are core but anti hep? What does it mean? Is it because you want to consider these as keywords that you want to have in the record but not use as criteria to evaluate coreness of a paper? |
The HEP ontology is up to date. |
@fschwenn coming back to this.
Does that mean that you display all this information and then a human manually takes the final decision? All these metrics sounds like something we can compute and then we can train some ML to learn from the human decisions. |
Exactly. |
What exactly do you mean by #of core-PACS? Also How do you know core authors? Given that you need first to guess who is who? |
I aggregated a list of mappings 'PACS->plain text' from the different edditions of PACS lists, since for selection purposes '04.60.Bc' is not very helpful but 'Phenomenology of quantum gravity' is! I also added the information whether a PACS indicates COREness like for the example '04.60.Bc' and all PACS starting with 1. If a metadata of a journal article include PACS, I (my program) translates them to plain text and counts how many are CORE. |
* Updates the DESY maintained HEP ontology. Signed-off-by: fschwenn <florian.schwennsen@desy.de>
* Updates the DESY maintained HEP ontology. Signed-off-by: fschwenn <florian.schwennsen@desy.de>
* Updates the DESY maintained reduced HEP ontology with only the CORE keywords. Signed-off-by: fschwenn <florian.schwennsen@desy.de>
Adds a reduced ontology with only the core HEP keywords.
Adds an anti-HEP-ontology with keywords indicating irrelevance
for HEP.
Signed-off-by: fschwenn florian.schwennsen@desy.de