Data Source Query does not show updates in 2.2 #396

nicklynch · 2017-08-18T09:09:19Z

The recent data updates in 2.2 are shown in the data returned from the Data Source query

http://alpha.openphacts.org:3002/2.2/sources

Shows ChEMBL 20 and older wiki pathways data

Has the void files been updated to show this new information?

ianwdunlop · 2017-08-18T10:43:44Z

The void files might be the old ones for chembl 20 (chembl_20.0_void.ttl) and wp (voidWp.ttl). If the new void files exist then the graph should be able to be cleared and new data put in.

<http://rdf.ebi.ac.uk/dataset/chembl/20.0/void.ttl#> a void:DatasetDescription ;
  dcterms:title "ChEMBL-RDF VoID Description" ;
  dcterms:description "This is the VoID description for a ChEMBL-RDF dataset" ;
  dcterms:issued "2015-01-14T00:00:00.000Z"^^xsd:dateTime ;
  pav:createdBy <http://orcid.org/0000-0002-8011-0300> ;
  pav:createdOn "2009-10-28T00:00:00.000Z"^^xsd:dateTime ;
  pav:lastUpdateOn "2015-01-14T00:00:00.000Z"^^xsd:dateTime ;
  foaf:primaryTopic :chembl_rdf_dataset ;
  pav:previousVersion <http://rdf.ebi.ac.uk/dataset/chembl/19.0/void.ttl#>

<http://rdf.wikipathways.org/>
      a       void:DatasetDescription ;
      dcterms:title "A VoID Description of the WikiPathways sets"@en ;
    dcterms:description "VoID description for the curated and Reactome WikiPathways VoID set based upon the wp vocabulary."@en ;
    pav:createdBy <https://jenkins.bigcat.unimaas.nl/job/GPML%20to%20GPML%20+%20WP%20RDF/> ;
    pav:createdOn "2015-11-18T15:54:28.683Z"^^xsd:dateTime ;
    dcterms:issued "2015-11-18T15:54:00Z"^^xsd:dateTime ;
    pav:lastUpdateOn "2016-05-13T08:13:00Z"^^xsd:dateTime ;
    pav:previousVersion <http://rdf.wikipathways.org/release20151118/> ;
    pav:createdWith <https://jenkins.bigcat.unimaas.nl/job/GPML%20to%20GPML%20+%20WP%20RDF/> ;
      foaf:primaryTopic <http://rdf.wikipathways.org/release20151118_2/>

Here is the full list:

from sparql

PREFIX void: <http://rdfs.org/ns/void#>
PREFIX foaf: <http://xmlns.com/foaf/0.1/>
PREFIX dcterms: <http://purl.org/dc/terms/>
PREFIX prov: <http://www.w3.org/ns/prov#>
PREFIX dcat: <http://www.w3.org/ns/dcat#>
SELECT  DISTINCT ?dataset   WHERE { GRAPH <http://www.openphacts.org/api/datasetDescriptors> {
?dataset a void:Dataset .
?description foaf:primaryTopic ?top_dataset .
OPTIONAL { ?dataset dcterms:title ?title . }
OPTIONAL { ?dataset void:subset ?subset . }
OPTIONAL { ?dataset dcterms:description ?dctDescription . }
OPTIONAL { ?dataset dcterms:license ?license . }
OPTIONAL { {?dataset prov:wasDerivedFrom ?derivedFrom . }
UNION { ?dataset prov:hadPrimarySource ?primarySource . }
UNION { ?dataset prov:wasQuotedFrom ?quotedFrom . }
UNION { ?dataset prov:wasRevisionOf ?revisionOf . }
}
OPTIONAL { ?dataset void:dataDump ?dataDump . }
OPTIONAL { ?dataset void:triples ?tripleNo . }
OPTIONAL { {?dataset foaf:homepage ?homepage . }
UNION { ?dataset dcat:landingPage ?landingPage . } }
}
  }

randykerber · 2017-08-18T11:33:02Z

We should first see if we can tell where this command is really getting it's info from.

Now that this comes up, a while back I vaguely recall seeing datasources output and after scanning it recognizing that it wasn't even remotely correct. And that it was coming from someplace unexpected. From some old cached file somewhere, or perhaps even something to do with conceptwiki.

AlasdairGray · 2017-08-18T12:14:49Z

It should really query the triplestore for the VoID information

stain · 2017-08-18T12:19:49Z

Yes, it’s from the http://www.openphacts.org/api/datasetDescriptors graph loaded separately from the void/ folders. If you update chembl then it comes with its own void file that you have to add to that graph (but first clear the old graph and reload from void/ to avoid double-chembl)

…

-- Stian Soiland-Reyes, eScience Lab School of Computer Science, The University of Manchester http://orcid.org/0000-0001-9842-9718 From: Alasdair Gray<mailto:notifications@github.com> Sent: 18 August 2017 13:14 To: openphacts/GLOBAL<mailto:GLOBAL@noreply.github.com> Cc: Subscribed<mailto:subscribed@noreply.github.com> Subject: Re: [openphacts/GLOBAL] Data Source Query does not show updates in 2.2 (#396) It should really query the triplestore for the VoID information — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub<#396 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AAPd5XDWPjPAesHVGOtGFYvlgysTL5djks5sZYA5gaJpZM4O7Swq>.

ianwdunlop · 2017-08-21T14:34:47Z

Data available via ftp including void eg ftp://ftp.ebi.ac.uk/pub/databases/chembl/ChEMBL-RDF/23.0/

randykerber · 2017-08-21T19:04:01Z

The http://www.openphacts.org/api/datasetDescriptors graph is loaded from the void.tar file here: https://data.openphacts.org/free/2.1/rdf/https://data.openphacts.org/free/2.1/rdf/

But I've not found any script for creating or loading that.

@stain -- Do you recall how the contents of that graph were created, is there a script? I didn't find anything in the ops-platform-setup project/repo.

nicklynch added the DATA label Aug 18, 2017

nicklynch added this to the 2.2 milestone Aug 18, 2017

nicklynch assigned randykerber Aug 18, 2017

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Data Source Query does not show updates in 2.2 #396

Data Source Query does not show updates in 2.2 #396

nicklynch commented Aug 18, 2017

ianwdunlop commented Aug 18, 2017

randykerber commented Aug 18, 2017

AlasdairGray commented Aug 18, 2017

stain commented Aug 18, 2017 via email

ianwdunlop commented Aug 21, 2017

randykerber commented Aug 21, 2017

Data Source Query does not show updates in 2.2 #396

Data Source Query does not show updates in 2.2 #396

Comments

nicklynch commented Aug 18, 2017

ianwdunlop commented Aug 18, 2017

randykerber commented Aug 18, 2017

AlasdairGray commented Aug 18, 2017

stain commented Aug 18, 2017 via email

ianwdunlop commented Aug 21, 2017

randykerber commented Aug 21, 2017