Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upload and link raw mass spectral data #79

Open
tsufz opened this issue Jun 24, 2019 · 22 comments
Open

Upload and link raw mass spectral data #79

tsufz opened this issue Jun 24, 2019 · 22 comments

Comments

@tsufz
Copy link
Member

tsufz commented Jun 24, 2019

#MetSoc2019, Towards FAIR Spectral Libraries workshop. There is a request to make raw mass spectral files associated with MassBank records available for the public via any repository. Should be vendor's format, not mzML.

@meier-rene
Copy link
Collaborator

Its already on the roadmap, but technical procedure is still undefined. We have this as WP in our next de.NBI funding period.

We can use this issue for discussion. You suggest any repository. This needs to be defined. I doubt that github is the right place because of the size of the data, because data might not be text based and will most likely not changed once it has been deposed.

@schymane
Copy link
Member

I have been using Zenodo a lot recently and am very happy so far - diverse datasets and very few issues (>56 datasets and only one failure on one file associated with one that I could solve in the end).
I have not yet tried with larger datasets but it may be worth starting.
Advantage for European sides: the cross-linking with OpenAIRE is nice for our reporting requirements.
The other efficient alternative I could think of is GNPS MassIVE FTP links - we have this for our Swiss Wastewater study. Zenodo gives a DOI and authorship, cross linking and a whole lot more features on the repository side; MassIVE comes with all that GNPS offers if it works on your files (it didn't work on mine tho).

@schymane
Copy link
Member

We are also discussing internal possibilities here ... we would have the capabilities but they are not up and running even internally yet for us as a group, our BioCore are running this for others.

@tsufz
Copy link
Member Author

tsufz commented Jun 25, 2019

I was just thinking about our UFZ repository for our records. However, they still not have DOI and thus the landing page and URL may change at any time....

@tsufz
Copy link
Member Author

tsufz commented Jun 25, 2019

However, we may firstly indroduce a new tag for the linking or should be use the comment tag?

@schymane
Copy link
Member

If this is something we want to try to implement systematically, I would prefer a new tag rather than overloading the COMMENT field with too many diverse comments.
Either e.g. a RAW_DATA entry in the first section, or SP$RAW_DATA?

@meowcat
Copy link

meowcat commented Jun 25, 2019

I would kind of like to use MassIVE or alternatively MetaboLights or MetabolomicsWorkbench so we don't fragment (pun intended) mass spec data over even more repositories. But if Zenodo is getting mass-spectrified already then I guess the argument is not so strong.

@schymane
Copy link
Member

Yes to considering MetaboLights and the MetabolomicsWorkbench but I have also heard a lot of feedback that it takes a while to get data into those two ...

@tsufz
Copy link
Member Author

tsufz commented Jun 25, 2019

Does Metabolights store raw data (meaning ventors' format, not mzML)? Actually, we have to store both vendor and open format.... I will talk to Reza Salek to discuss opportunities.

@justinjjvanderhooft
Copy link

justinjjvanderhooft commented Jun 25, 2019 via email

@tsufz
Copy link
Member Author

tsufz commented Jun 25, 2019

Yes, it does store raw data formats. Keeva from MetaboLights is also present at the Metabolomics2019 conference.

On Tue, 25 Jun 2019, 10:33 Tobias Schulze, @.***> wrote: Does Metabolights store raw data (meaning ventors' format, not mzML)? Actually, we have to store both vendor and open format.... I will talk to Reza Salek to discuss opportunities. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#79?email_source=notifications&email_token=AARV56FQJWIWBCJFQIWGTZ3P4HJ45A5CNFSM4H23ZJPKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYPPGWY#issuecomment-505344859>, or mute the thread https://github.com/notifications/unsubscribe-auth/AARV56C4PCLI5K7AEAMTAITP4HJ45ANCNFSM4H23ZJPA .

Thanks for the advice, I already contacted Keeva.

@sneumann
Copy link
Member

If referencing one or more individual spectra in some repository, the PSI spectrum identifier
could be used, which directly indexes individual scans in raw data:
http://www.psidev.info/usi
we need to find a few examples of prototypes already implementing this.
Yours, Steffen

@sneumann
Copy link
Member

Sebastian's request was to be able to obtain the input spectrum/spectra used in a record prior to processing.
And MetaboLights can (also) store vendor data, see MTBLS297, Sciex MTBLS2, Bruker and some more if we search for them. Yours, Steffen

@sneumann
Copy link
Member

sneumann commented Jun 25, 2019

As Example:
These records were done by Michele from MTBLS38:
https://msbi.ipb-halle.de/MassBank/Result.jsp?type=rcdidx&idxtype=site&srchkey=MetaboLights&sortKey=name&sortAction=1&pageNo=1&exec=
where the raw data is in MTBLS38 and has been imported to GNPS:
https://www.omicsdi.org/dataset/gnps/MSV000082791
and in particular
ftp://massive.ucsd.edu/MSV000082791/ccms_peak/raw/MTBLS38/(-)-epigallocatechin.mzXML
and I'll talk to Mingxun how to adress one particular scan in there.

@sneumann
Copy link
Member

Response from Ming:
https://massive.ucsd.edu/ProteoSAFe/usi.jsp#%7B%22usi%22%3A%22mzspec%3AMSV000082791%3A(-)-epigallocatechin%3Ascan%3A1000%22%7D

Using the identifier:
mzspec:MSV000082791:(-)-epigallocatechin:scan:1000

and then it is left to RMassBank etc. to specify the actual scan(s) to link

@schymane
Copy link
Member

schymane commented Jul 1, 2019

Here is a reference to the twitter conversation over the weekend:
https://twitter.com/martiwag/status/1145011749554393089

Main outcomes:

  • GNPS now gives DOIs
  • Should try if we can integrate GNPS and Zenodo (=> reporting benefits for EU)
  • GNPS discussions to follow up with @mwang87
  • Alternatives also MetaboLights and MetabolomicsWB
  • Role of DFSP to be discussed within NORMAN
  • Metadata fields needed
    gnps_metadata

@meowcat
Copy link

meowcat commented Jul 1, 2019

Using the identifier:
mzspec:MSV000082791:(-)-epigallocatechin:scan:1000

I think this would fit nicely

@schymane
Copy link
Member

schymane commented Jul 1, 2019

For the record Zenodo has 50 GB uploads - or contact them for larger.

@schymane
Copy link
Member

schymane commented Jul 1, 2019

Using the identifier:
mzspec:MSV000082791:(-)-epigallocatechin:scan:1000

I think this would fit nicely

Yes, but to hyperlink this would be difficult, we are wondering whether this should go in a MS$RAW: GNPS COMMENT field, since to create a hyperlink to the dataset alone we just need the MSVXXXX number

@schymane
Copy link
Member

schymane commented Jul 1, 2019

Metadata fieds in NORMAN DCTs:
http://norman-data.eu/DCT_NTS.xlsx

=> sampling description sheet

@justinjjvanderhooft
Copy link

justinjjvanderhooft commented Jul 1, 2019 via email

@schymane
Copy link
Member

schymane commented Jul 1, 2019

Here is the way to link to MassIVE datasets:
https://massive.ucsd.edu/ProteoSAFe/QueryMSV?id=MSV000084010
with the example of DOI:
10.25345/C50S8G

Thanks @mwang87

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants