IUC Contribution Fest - Metagenomics Tools and Workflows #299
Comments
|
👍 to biom, I'd be happy to do a phinch viz plugin/tool if a biom datatype was available |
|
@erasche - add to the TODO list and sign yourself up 😄 |
|
It would be lovely if we could get @jennaj on-board and maybe can create a workflow that we stick into the Tool Shed and myexperiments.org. |
|
@bgruening Funny this should come up here - it was also brought up last Fri at a data hack meeting. Metagenomics is definitely on the table for the next cycle. Maybe we can combine forces :) I'll email the data hacks with a link to this. |
|
Thanks @jennaj! |
|
Perhaps we need a bit of a big picture. Improving individual tools is necessary, but we should focus on entire types of MG workflows (e.g., what are potential complete workflows for doing human microbiome studies). This is best accomplished using actual biological projects. Can you guys make a list of analyses you are currently supporting. I'll describe mine |
|
@nekrut Great point and a very good first step. I'm looking to analyze 16S data to generate OTU percentages per sample and PCA plot for diversity analysis. Following a workflow similar to that outlined in http://nbviewer.ipython.org/github/biocore/qiime/blob/1.9.1/examples/ipynb/illumina_overview_tutorial.ipynb |
|
I like the idea of linking up the GalaxyScientists (@jennaj's data hackers) with the IUC for this - it would be good to have a project to foster some dialogue between these two groups. |
|
I am not a metagenomics person, but I have seen people struggling with the mothur tool (if you install it, you will see what I mean). My impression is that a few workflows would help a lot. If you look at the mothur documentation, you could easily get inspiration. For example here: http://www.mothur.org/wiki/Analysis_examples PS - You could consider doing a RAD-seq hackathon in the future. I would like to help on that one... |
|
I'm currently developing a Galaxy instance dedicated to gut microbiota data processing (metagenomics and metatranscriptomics). I made some wrappers for tools such as HUMAnN, MetaPhlAn, SortMeRNA, Reago, PRINSEQ, for which I did not find wrappers fitting my requirements. The aim is to construct a workflow to process data from intestinal microbiota. |
|
@bebatut this is awesome. If you like please join this hackathon and we could review your wrappers if you like.
@tiagoantao excellent suggestion! |
|
@bebatut MetaPhlAn and SortMeRNA are also on the Tool Shed, please do not reinvent the wheel, if something is missing please contribute to the already available tools! https://toolshed.g2.bx.psu.edu/view/rnateam/sortmerna/ @bgruening Should PRINSEQ also be published on the MTS or it's not ready yet? |
|
@bgruening @nsoranzo I saw the wrappers for Prinseq and SortMeRNA, but they do not correspond to what I wanted. For example, not all the parameters are accessible with SortMeRNA wrapper. |
|
@bebatut let's merge our wrappers during the hackthon and join (maintenance) forces! |
|
I think that there is a bug in the kraken data manager. Select partial library to download> Human Depending on my galaxy installation I am getting different errors. The most common is not being able to download human chromosomes. But works well with the other options |
|
https://test.galaxyproject.org/u/sjcc/w/16s Here is the king of stuff we are currently doing: Input > Quality Trim (FASTQ Quality Trimmer) > Join R1 + R2 (fastq-join) > remove reads with ambiguous bases (Manipulate FASTQ) > remove chimeras (cd-hit-dup) > assign reads to taxon (Kraken) > filter Kraken by confidence level (Kraken-filter) > translate taxon id number into taxon name (Kraken-translate) > report Kraken results (Kraken-report) Filter Kraken report to see what data you want (Filter) <-- I use this to isolate a taxonomic level (i.e. P, C, O, F, G, S) Rarefaction analysis (Vegan Rarefaction) |
|
@tiagoantao can you move this bug report to a proper issue, so it get not lost? |
|
I think we as Galaxy community should also consider a Brew related hackathon (https://github.com/Homebrew/homebrew-science/issues/2876) and I would like if we could schedule one or the other for November. Any particular thoughts on whether we should do this one in November and the Homebrew one in January or vice versa? |
|
November for the metagenomic Codefest and January for the next. Until then we can make the brew idea more concrete. |
|
What about the 5th and 6th of November? To early? |
|
@bgruening I'll be at a conference on the 5th and traveling on the 6th. I don't know if Anton intends to participate directly with the hackathon but he will be at the same conference. Obviously I have much less to contribute to a metagenomics hackathon than a collections one though, so feel free to continue without me. I could do the 19th and 20th or the 9th and 10th. |
|
2nd Nov 9th and 10th. Some of us might or could be in PA that are not otherwise, which could be nice if the primary reason for being there does not conflict (occurs later in the week). |
|
BIOM xref: galaxyproject/galaxy#941 |
|
I could do either of: 5th and 6th, 9th and 10th, or 19th and 20th. That said, the 9th and 10th are looking rather nice. |
|
@bgruening Can you do the 9th and 10th? |
|
If so I will sitting next to you and will have a hard time to motivate peoples from Freiburg remotely. |
|
Oh - yeah I suppose that might not be the best use of your limited time here. Forgot about that. |
|
30th of November and 1st of December? |
|
This works for me. |
|
@IyadKandalaft what do you think? #419 |
|
@bgruening My concrete questions are:
|
|
|
Sounds great! I would appreciate a bit of an intro, since I haven't done remote hackathons before. |
|
Sure, we can do this. In general don't hesitate to ask questions at any time. |
|
Hi everyone, just an update concerning: I don't know if this can be, totally or in part, of interest for the Mothur community but I remember that the engineer who has working on it, Mathieu Bahin, have made large improvements of the existing (old) Mothur Galaxy tools.... Maybe someone from the "Mothur Galaxy" community (@IyadKandalaft ?) can efficiently evaluate this? 2/ Qiime. The Ifremer colleagues have developped, totally from scratch if I don't make mistakes, Galaxy tools using Qiime 1.9. They have used the qiimetogalaxy script to create automatically the basis of Galaxy descriptors.... Once again, maybe this can be of interest for the "Qiime Galaxy" community (@lparsons).... or not ;) |
|
Apologies for arriving late: I've now got the okay from my superiors to contribute to the toolfest next week. We have a number of users who would like to use Qiime within Galaxy so I'd like to offer effort towards making an "official" toolshed version of the Qiime tools as originally proposed by @lparsons. We have a list of specific Qiime components that we're interested in, all of which are already have versions in Lance's github repo. So I'll be available to contribute general programming effort to work on any identified by the organisers (if there is such a list). However if there's a better way to contribute then please let me know - mainly we just want to help move this forward. Aside from that: a while ago I developed a data manager for the Mothur toolsuite, which is available on the test toolshed but never got developed further. If this is of interest to anyone here, again please let me know. |
|
@erasche @jmchilton the biom datatype proposed by @fescudie , who will participate to the hackathon, for the FROGS pipeline is maybe ok to propose to do a first phinch viz plugin/tool ? |
|
Just a side comment from someone that does not do metagenomics but sometimes help other people doing it: The mothur tool is very very complex to use a this stage. My impression is that a couple of well thought workflows would help a lot (even if the tool maintains the current format). For example an implementation of some of their SOPs: |
|
As one of the developers on the galaxy mothur tools, I agree that we need
|
|
@shujianbu do you have time tomorrow to help with Phinch integration? |
|
Hi everyone, Just few slides that we will use to briefly present the initiative, our pipelines and some To-Do.... : Presentation slides I will update this document during the hackathon event. Don't hesitate to comment / ask questions. In France this will begin in 17 minutes ;) |
|
I updated the original post with links to a google hangout and our IRC channel, feel free to join! |
|
Hi Bjorn, What's the context/scope of the project integration? I haven't maintained Thanks, On Sun, Nov 29, 2015 at 11:55 PM, Björn Grüning notifications@github.com
|
|
@shujianbu we want to integrate Phinch into Galaxy. The idea is to put Phinch in a Docker container and integrate it into Galaxy. Every biom dataset that is created in Galaxy can than be visualised with Phinch without leaving the analysis platform. Is/will Phinch be maintained? I have a pending PR since a few month. |
|
@yvanlebras awesome. When do you start? I will also update the main issue above regularly with news. Here is our first PR that adds the Mash package: #427 |
|
Work will continue in various branches, but I will close this one :) |
Remote Contribution Fest happens on 30 Nov and 1 Dec
We are planning a Remote Contribution Fest on 30th of November and 1st of December for developers to work mainly on Galaxy metagenomic tools.
The remote nature of this gives people who don't have the opportunity to come to GCC hackathons (which have always been productive and a lot of fun) a chance to participate in a Galaxy hackathon. Having a well defined topic will allow us to accomplish a lot and let people who don't have particular tasks in mind find something to work on very quickly.
We are collecting ideas to work on, but we expect to attract the most participation by simply getting tool developers interested in getting help adding collection support to their existing tools and workflows to show up and participate.
If you are interested in participating in the hackathon but not interested in actual tool development - we will assemble a list of smaller, manageable Python and JavaScript tasks to work on and certainly documentation is a chronically lacking for collections so we could use help there and no actual coding would be required.
We encourage ideas or advice about how to organize this so please let us know. A core group will be available on IRC all day and we will have 4 google hangouts across those days to organize, answer questions, and report progress.
We will do our best to coordinate and make this hackathon a nice and productive experience and we would like to especially focus on working reasonable hours and discourage overnighters.
All forms of contribution are welcome!
Original idea from @bgruening (galaxyproject/tools-devteam#26 (comment)). See #239 for information on the last hackathon.
Things to work on
Google Maps link - please add yourself
https://www.google.com/maps/d/edit?mid=zQipez5uCQ8I.khoUIhze9Fek&usp
Google Hangout
https://hangouts.google.com/call/iems2ffkpd4s7cyjoq4mi3hgwma
IRC
https://wiki.galaxyproject.org/News/IRCPublicLogProposal
The text was updated successfully, but these errors were encountered: