Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Just "raw" FASTA files shouldn't be allowed as an artifact. #953

Open
ElDeveloper opened this issue Mar 10, 2015 · 8 comments
Open

Just "raw" FASTA files shouldn't be allowed as an artifact. #953

ElDeveloper opened this issue Mar 10, 2015 · 8 comments

Comments

@ElDeveloper
Copy link
Member

Currently it is only possible to process FASTA studies that include quality files, otherwise you will get a pop-up saying that you need QUAL files.

@ElDeveloper ElDeveloper added this to the Alpha 0.1 milestone Mar 11, 2015
@ElDeveloper ElDeveloper self-assigned this Mar 11, 2015
@gregcaporaso gregcaporaso changed the title Allow to process FASTA studies without quality information qiita should be able to process fasta files when qual files are not provided Mar 11, 2015
@gregcaporaso
Copy link
Contributor

This seems to be a bigger problem that we initially thought. It turns out that Qiita tries to support this by not passing -q and -d if there are no qual files provided, but --min_qual_score 25 also needs to be excluded from the command in this case.

This pull request adds a more useful error message if a user runs Preprocess without both a fasta and qual file.

This illustrates the current issue:

$ split_libraries.py -f /Users/caporaso/Dropbox/code/qiita/qiita_core/../qiita_db/support_files/test_data/raw_data/10_seqs.fna -m /tmp/MMF_4bHU5Lp/seqs_MMF.txt -o /tmp/sl_outLlDL5C --barcode_type hamming_8 --max_ambig 6 --max_barcode_errors 1.5 --max_homopolymer 6 --max_primer_mismatch 0 --max_seq_len 1000 --min_qual_score 25 --min_seq_len 200 --qual_score_window 0 --reverse_primer_mismatches 0 --reverse_primers disable
Error in split_libraries.py: To specify a minimum quality score for reads, one must supply quality score files.

@wasade
Copy link
Contributor

wasade commented Mar 11, 2015

Any luck using a different/new preprocessed parameters set?

On Wed, Mar 11, 2015 at 4:25 PM, Greg Caporaso notifications@github.com
wrote:

This seems to be a bigger problem that we initially thought. It turns out
that Qiita tries to support this by not passing -q and -d if there are no
qual files provided, but --min_qual_score 25 also needs to be excluded
from the command in this case.

This pull request adds a more useful error message if a user runs
Preprocess without both a fasta and qual file.


Reply to this email directly or view it on GitHub
#953 (comment).

@gregcaporaso
Copy link
Contributor

I think that's one solution, but I think that's a bit deeper than I'm able to dive into Qiita at the moment (it sounds like that would have to be a change to the database schema, and that those are challenging to put in place). #972 improves the error message in the meantime.

@gregcaporaso gregcaporaso removed their assignment Mar 12, 2015
@wasade
Copy link
Contributor

wasade commented Mar 12, 2015

Does the act of setting the min qual score value (even to None) force
split_libraries to need qual?
On Mar 11, 2015 7:47 PM, "Greg Caporaso" notifications@github.com wrote:

I think that's one solution, but I think that's a bit deeper than I'm able
to dive into Qiita at the moment (it sounds like that would have to be a
change to the database schema, and that those are challenging to put in
place). #972 #972 improves the
error message in the meantime.


Reply to this email directly or view it on GitHub
#953 (comment).

@gregcaporaso
Copy link
Contributor

Passing any value for --min_qual_score makes -q required. I don't
think passing None would parse as the option parser expects an int.

On Wed, Mar 11, 2015 at 8:29 PM, Daniel McDonald notifications@github.com
wrote:

Does the act of setting the min qual score value (even to None) force
split_libraries to need qual?
On Mar 11, 2015 7:47 PM, "Greg Caporaso" notifications@github.com wrote:

I think that's one solution, but I think that's a bit deeper than I'm
able
to dive into Qiita at the moment (it sounds like that would have to be a
change to the database schema, and that those are challenging to put in
place). #972 #972 improves the
error message in the meantime.

Reply to this email directly or view it on GitHub
#953 (comment).

Reply to this email directly or view it on GitHub
#953 (comment).

@wasade
Copy link
Contributor

wasade commented Mar 12, 2015

That's annoying... so ya, even a new set of processed params wouldn't work.
It actually would be a small fix to make split_libraries handle this but
that would necessitate 1.9.1 and that would not be fun

On Wed, Mar 11, 2015 at 9:34 PM, Greg Caporaso notifications@github.com
wrote:

Passing any value for --min_qual_score makes -q required. I don't
think passing None would parse as the option parser expects an int.

On Wed, Mar 11, 2015 at 8:29 PM, Daniel McDonald <notifications@github.com

wrote:

Does the act of setting the min qual score value (even to None) force
split_libraries to need qual?
On Mar 11, 2015 7:47 PM, "Greg Caporaso" notifications@github.com
wrote:

I think that's one solution, but I think that's a bit deeper than I'm
able
to dive into Qiita at the moment (it sounds like that would have to be
a
change to the database schema, and that those are challenging to put in
place). #972 #972 improves the
error message in the meantime.

Reply to this email directly or view it on GitHub
#953 (comment).

Reply to this email directly or view it on GitHub
#953 (comment).


Reply to this email directly or view it on GitHub
#953 (comment).

@squirrelo squirrelo modified the milestone: Alpha 0.1 Apr 4, 2015
@antgonza antgonza modified the milestone: Alpha 0.3 Oct 10, 2015
@antgonza
Copy link
Member

As a group we decided to not allow just FASTA to be added in to the system as we can't actually use. Renaming the issue.

@antgonza antgonza changed the title qiita should be able to process fasta files when qual files are not provided Just "raw" FASTA files shouldn't be allowed as an artifact. Nov 17, 2016
@josenavas josenavas removed this from the Alpha 0.4 milestone Oct 4, 2017
@adswafford adswafford added this to the November 1st, 2017 milestone Oct 11, 2017
@antgonza
Copy link
Member

We need to change:

  • code and configuration of plugins
  • code in Qiita
  • documentation in Qiita
  • perhaps the upload configuration

@antgonza antgonza modified the milestones: November 1st, 2017, December 1st 2017 Oct 11, 2017
@adswafford adswafford modified the milestones: February 1st, 2018, March 1, 2018 Feb 14, 2018
@antgonza antgonza modified the milestones: Nov 2018 Update, Jan 2019 Dec 7, 2018
@antgonza antgonza modified the milestones: Jan 2019, Mar 2019 Jan 29, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

7 participants