-
Notifications
You must be signed in to change notification settings - Fork 2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Tests that no one passed #69
Comments
This was referenced Jun 28, 2024
I've looked at the runs over time, and I want to chime in... Looking at 6/9- onward, I notice 25 assets that have consistently not been passed by any ARA:
And 3 assets that some ARAs only started passing recently (I don't know how consistent this is yet):
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
We weren't able to investigate every one, but there appears to be quite a few tests that no ARAs pass, simply because that bioentity doesn't show up at all. Might indicate a different CURIE or bioentity should be chosen (eg. might be an sub-optimal test). Of course, mixed in with these are genuine underlying KP/filtering/ARA ranking issues, but nonetheless some are suspicious. Examples include:
Test 1 asset 13 Anakinra
Test 9 asset 262 AZD 335
Test 9 asset 264 Talcid (eg. according to NodeNorm, has no CHEBI or CHEMBL, just a UMLS CURIE)
Test 24, assets 390, 391, 392, 394, 395, 396, 397
Test 22 assets 368, 369, 370
Test 28, assets 493, 494, 496
Test 29, asset 503: is defined with "output_id": "CHEMBL.TARGET:CHEMBL204", and "output_name": "UNIPROTKB:P00734" which is a mixture of thrombin the gene/F2, and the output_id isn't even recognized by the node normalizer
Test 30, asset 599 the target CHEMBL.TARGET:CHEMBL2439 isn't even recognized by the node normalizer. Is CHEMBL.COMPOUND:CHEMBL2107858 intended?
Test 32 assets 637 and 638
The text was updated successfully, but these errors were encountered: