Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Odd Error at end of SpecLibGen #421

Closed
DrDee79 opened this issue Aug 6, 2021 · 22 comments
Closed

Odd Error at end of SpecLibGen #421

DrDee79 opened this issue Aug 6, 2021 · 22 comments
Assignees
Labels

Comments

@DrDee79
Copy link

DrDee79 commented Aug 6, 2021

-Just trying to use the standard Fragpipe tutorial steps to generate a spectral library from DDA files. I get most of it done I believe but the log has an odd trace at the end I'd like to know if it's normal (as some of the files referenced in others don't appear):

Traceback (most recent call last):
File "C:\Users\q-tof\Downloads\FragPipe-16.0\fragpipe\tools\speclib\gen_con_spec_lib.py", line 212, in
easypqp = get_bin_path('easypqp', 'easypqp')
File "C:\Users\q-tof\Downloads\FragPipe-16.0\fragpipe\tools\speclib\gen_con_spec_lib.py", line 121, in get_bin_path
if dist.get('files') is None and sys.platform == "win32":
AttributeError: '_PackageInfo' object has no attribute 'get'
Process 'SpecLibGen' finished, exit code: 1
Process returned non-zero exit code, stopping
log_2021-08-06_11-12-22.txt

Cancelling 2 remaining tasks
@fcyu fcyu added the speclib label Aug 6, 2021
guoci added a commit that referenced this issue Aug 6, 2021
@guoci
Copy link
Member

guoci commented Aug 6, 2021

@DrDee79
Copy link
Author

DrDee79 commented Aug 6, 2021

Thank you! It worked on the test file I did, now to see if I can do multiples!

@DrDee79
Copy link
Author

DrDee79 commented Aug 9, 2021

Hi, Been testing this newer version and still getting errors though this one is different. Any advice?

Dorothy

easypqp, version 0.1.24
Executing ['C:\Users\q-tof\AppData\Local\Programs\Python\Python39\Scripts\easypqp.exe', 'convert', '--max_delta_unimod', '0.02', '--max_delta_ppm', '15.0', '--fragment_types', "['b','y',]", '--enable_unannotated', '--pepxml', 'C:\Users\q-tof\Desktop\DIA\PlasmaLib14-PlasmaDDALib\interact-20210625_CUBE_Plasma_5248_FAIMS_90secDE_Test_2uL.pep.xml', '--spectra', 'C:\Users\q-tof\Desktop\DIA\20210625_CUBE_Plasma_5248_FAIMS_90secDE_Test_2uL_uncalibrated.mgf', '--exclude-range', '-1.5,3.5', '--psms', '20210625_CUBE_Plasma_5248_FAIMS_90secDE_Test_2uL.psmpkl', '--peaks', '20210625_CUBE_Plasma_5248_FAIMS_90secDE_Test_2uL.peakpkl']
Info: There are psm.tsv and peptide.tsv. Will ignore --psm_fdr_threshold, --peptide_fdr_threshold, --protein_fdr_threshold, --pi0_lambda, --proteotypic, and --no-proteotypic.
Info: Reading file C:\Users\q-tof\Desktop\DIA\PlasmaLib14-PlasmaDDALib\20210625_CUBE_Plasma_5248_FAIMS_90secDE_Test_2uL.psmpkl.
Info: 23026 redundant PSMs identified after filtering with C:\Users\q-tof\Desktop\DIA\PlasmaLib14-PlasmaDDALib\psm.tsv and C:\Users\q-tof\Desktop\DIA\PlasmaLib14-PlasmaDDALib\peptide.tsv
base_name modified_peptide
0 20210625_CUBE_Plasma_5248_FAIMS_90secDE_Test_2uL 5309
Info: easypqp_rt_alignment_20210625_CUBE_Plasma_5248_FAIMS_90secDE_Test_2uL; Peptide overlap between run and reference: 5309.
Exception in thread Thread-1:
Traceback (most recent call last):
File "c:\users\q-tof\appdata\local\programs\python\python39\lib\threading.py", line 954, in _bootstrap_inner
self.run()
File "c:\users\q-tof\appdata\local\programs\python\python39\lib\site-packages\joblib\externals\loky\process_executor.py", line 555, in run
result_item, is_broken, bpe = self.wait_result_broken_or_wakeup()
File "c:\users\q-tof\appdata\local\programs\python\python39\lib\site-packages\joblib\externals\loky\process_executor.py", line 609, in wait_result_broken_or_wakeup
ready = wait(readers + worker_sentinels)
File "c:\users\q-tof\appdata\local\programs\python\python39\lib\multiprocessing\connection.py", line 884, in wait
ready_handles = _exhaustive_wait(waithandle_to_obj.keys(), timeout)
File "c:\users\q-tof\appdata\local\programs\python\python39\lib\multiprocessing\connection.py", line 816, in _exhaustive_wait
res = _winapi.WaitForMultipleObjects(L, False, timeout)
ValueError: need at most 63 handles, got a sequence of length 65
log_2021-08-09_11-26-37.txt

@DrDee79
Copy link
Author

DrDee79 commented Aug 9, 2021

Hi, Been testing this newer version and still getting errors though this one is different. Any advice?

Dorothy

easypqp, version 0.1.24
Executing ['C:\Users\q-tof\AppData\Local\Programs\Python\Python39\Scripts\easypqp.exe', 'convert', '--max_delta_unimod', '0.02', '--max_delta_ppm', '15.0', '--fragment_types', "['b','y',]", '--enable_unannotated', '--pepxml', 'C:\Users\q-tof\Desktop\DIA\PlasmaLib14-PlasmaDDALib\interact-20210625_CUBE_Plasma_5248_FAIMS_90secDE_Test_2uL.pep.xml', '--spectra', 'C:\Users\q-tof\Desktop\DIA\20210625_CUBE_Plasma_5248_FAIMS_90secDE_Test_2uL_uncalibrated.mgf', '--exclude-range', '-1.5,3.5', '--psms', '20210625_CUBE_Plasma_5248_FAIMS_90secDE_Test_2uL.psmpkl', '--peaks', '20210625_CUBE_Plasma_5248_FAIMS_90secDE_Test_2uL.peakpkl']
Info: There are psm.tsv and peptide.tsv. Will ignore --psm_fdr_threshold, --peptide_fdr_threshold, --protein_fdr_threshold, --pi0_lambda, --proteotypic, and --no-proteotypic.
Info: Reading file C:\Users\q-tof\Desktop\DIA\PlasmaLib14-PlasmaDDALib\20210625_CUBE_Plasma_5248_FAIMS_90secDE_Test_2uL.psmpkl.
Info: 23026 redundant PSMs identified after filtering with C:\Users\q-tof\Desktop\DIA\PlasmaLib14-PlasmaDDALib\psm.tsv and C:\Users\q-tof\Desktop\DIA\PlasmaLib14-PlasmaDDALib\peptide.tsv
base_name modified_peptide
0 20210625_CUBE_Plasma_5248_FAIMS_90secDE_Test_2uL 5309
Info: easypqp_rt_alignment_20210625_CUBE_Plasma_5248_FAIMS_90secDE_Test_2uL; Peptide overlap between run and reference: 5309.
Exception in thread Thread-1:
Traceback (most recent call last):
File "c:\users\q-tof\appdata\local\programs\python\python39\lib\threading.py", line 954, in _bootstrap_inner
self.run()
File "c:\users\q-tof\appdata\local\programs\python\python39\lib\site-packages\joblib\externals\loky\process_executor.py", line 555, in run
result_item, is_broken, bpe = self.wait_result_broken_or_wakeup()
File "c:\users\q-tof\appdata\local\programs\python\python39\lib\site-packages\joblib\externals\loky\process_executor.py", line 609, in wait_result_broken_or_wakeup
ready = wait(readers + worker_sentinels)
File "c:\users\q-tof\appdata\local\programs\python\python39\lib\multiprocessing\connection.py", line 884, in wait
ready_handles = _exhaustive_wait(waithandle_to_obj.keys(), timeout)
File "c:\users\q-tof\appdata\local\programs\python\python39\lib\multiprocessing\connection.py", line 816, in _exhaustive_wait
res = _winapi.WaitForMultipleObjects(L, False, timeout)
ValueError: need at most 63 handles, got a sequence of length 65
log_2021-08-09_11-26-37.txt

This seems to be only happening when I try to use the SpecLib with DDA files- I am able to get through the workflow with DIA 4 m/z files. I hope it's an easy fix!

@guoci
Copy link
Member

guoci commented Aug 10, 2021

Please install my version of EasyPQP and try again by using the following commands in Anaconda prompt:

pip uninstall -y easypqp
pip install git+https://github.com/guoci/easypqp@joblib_thread_fix

The issue is documented at joblib/loky#192

@DrDee79
Copy link
Author

DrDee79 commented Aug 11, 2021

Having a bit of trouble cloning from that link, can you double-check it?

Collecting git+https://github.com/guoci/easypqp@joblib_thread_fix
Cloning https://github.com/guoci/easypqp (to revision joblib_thread_fix) to c:\users\q-tof\appdata\local\temp\pip-req-build-3heqv7b0
Running command git clone -q https://github.com/guoci/easypqp 'C:\Users\q-tof\AppData\Local\Temp\pip-req-build-3heqv7b0'
ERROR: Error [WinError 2] The system cannot find the file specified while executing command git clone -q https://github.com/guoci/easypqp 'C:\Users\q-tof\AppData\Local\Temp\pip-req-build-3heqv7b0'

@guoci
Copy link
Member

guoci commented Aug 11, 2021

Is the error the same every time you run it?
I have tested it on a Windows computer.
image

@DrDee79
Copy link
Author

DrDee79 commented Aug 11, 2021

It's very odd as the easypqp is recognized as present by Fragpipe, but uninstalling says "Skipping easypqp as it is not installed."

Then the installation error is the same every time.

@DrDee79
Copy link
Author

DrDee79 commented Aug 11, 2021

So I was able to install using a different link git+https://github.com/grosenberger/easypqp.git@master, but keep getting the error with the one you had provided. Are both versions the same?

@guoci
Copy link
Member

guoci commented Aug 11, 2021

no, they are not the same

@DrDee79
Copy link
Author

DrDee79 commented Aug 11, 2021

Still not having luck with your link sorry.

@guoci
Copy link
Member

guoci commented Aug 11, 2021

Can you set RT lowess fraction to a non-zero value e.g. 0.05 and try again?
image

@DrDee79
Copy link
Author

DrDee79 commented Aug 11, 2021

That seemed to help with the errors!

@giorgiolivi
Copy link

Hi There,
I get the same error
Could you please help me how you figure out?
Thanks in advance.
Giorgio
File list provided
Traceback (most recent call last):
File "C:\Users\giorgio.DESKTOP-OR8T69I\Downloads\FragPipe-16.0\fragpipe\tools\speclib\gen_con_spec_lib.py", line 212, in
easypqp = get_bin_path('easypqp', 'easypqp')
File "C:\Users\giorgio.DESKTOP-OR8T69I\Downloads\FragPipe-16.0\fragpipe\tools\speclib\gen_con_spec_lib.py", line 121, in get_bin_path
if dist.get('files') is None and sys.platform == "win32":
AttributeError: '_PackageInfo' object has no attribute 'get'
Process 'SpecLibGen' finished, exit code: 1
Process returned non-zero exit code, stopping

@fcyu
Copy link
Member

fcyu commented Oct 18, 2021

@guoci Can you take a look when you have time?

Thanks,

Fengchao

@guoci
Copy link
Member

guoci commented Oct 18, 2021

@giorgiolivi that has been fixed, download link to the fixed version:
https://drive.google.com/drive/folders/1yLxJmXjN8tHpOos_eFRRfz4WjlMoAtV7?usp=sharing

@giorgiolivi
Copy link

giorgiolivi commented Oct 19, 2021 via email

@guoci
Copy link
Member

guoci commented Oct 19, 2021

@giorgiolivi can you post the full log?

@giorgiolivi
Copy link

giorgiolivi commented Oct 19, 2021 via email

@guoci
Copy link
Member

guoci commented Oct 19, 2021

@giorgiolivi Can you show me the list of files you have in F:\Gio_timsTOF_RawData_NT2_plus_mine_cell_fraction?
Also, the log is truncated.

@giorgiolivi
Copy link

giorgiolivi commented Oct 20, 2021 via email

@guoci
Copy link
Member

guoci commented Oct 20, 2021

Did you see any .mgf files?
Your log is still truncated, can you email me at teog@umich.edu?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants