Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem multiprocess in requirements #92

Closed
georgosgeorgos opened this issue Jun 20, 2022 · 5 comments · Fixed by #134
Closed

Problem multiprocess in requirements #92

georgosgeorgos opened this issue Jun 20, 2022 · 5 comments · Fixed by #134

Comments

@georgosgeorgos
Copy link
Contributor

georgosgeorgos commented Jun 20, 2022

The new multiprocess library version (0.70.13) gives problems when installing gt4sd-core using the development mode. I had to set multiprocess==0.70.12.2 to install the library.

@drugilsberg
Copy link
Contributor

Thanks for reporting.
Here it would be great to have a stack/error trace to understand what errors exactly.
I tried a build both on Ubuntu and Mac OS X and it went through without pinning the requirements.

@georgosgeorgos
Copy link
Contributor Author

There is no such issue when installing the library for standard use. I'm trying to reproduce it in development mode.

@georgosgeorgos
Copy link
Contributor Author

Installing in development mode pip install --no-deps -e . we have a problem related to the wheel version:

gt4sd-core git:(main) ✗ gt4sd-inference --algorithm_name PaccMannRL --algorithm_application PaccMannRLProteinBasedGenerator --target MVLSPADKTNVKAAWGKVGAHAGEYGAEALERMFLSFPTT --number_of_samples 10

Traceback (most recent call last):
File "/opt/anaconda3/envs/gt4sd_tmp/lib/python3.7/site-packages/pkg_resources/init.py", line 579, in _build_master
ws.require(requires)
File "/opt/anaconda3/envs/gt4sd_tmp/lib/python3.7/site-packages/pkg_resources/init.py", line 897, in require
needed = self.resolve(parse_requirements(requirements))
File "/opt/anaconda3/envs/gt4sd_tmp/lib/python3.7/site-packages/pkg_resources/init.py", line 788, in resolve
raise VersionConflict(dist, req).with_context(dependent_req)
pkg_resources.ContextualVersionConflict: (protobuf 3.20.1 (/opt/anaconda3/envs/gt4sd_tmp/lib/python3.7/site-packages), Requirement.parse('protobuf<3.20,>=3.9.2'), {'tensorboard'})

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/opt/anaconda3/envs/gt4sd_tmp/bin/gt4sd-inference", line 33, in
sys.exit(load_entry_point('gt4sd', 'console_scripts', 'gt4sd-inference')())
File "/opt/anaconda3/envs/gt4sd_tmp/bin/gt4sd-inference", line 25, in importlib_load_entry_point
return next(matches).load()
File "/opt/anaconda3/envs/gt4sd_tmp/lib/python3.7/site-packages/importlib_metadata/init.py", line 203, in load
module = import_module(match.group('module'))
File "/opt/anaconda3/envs/gt4sd_tmp/lib/python3.7/importlib/init.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1006, in _gcd_import
File "", line 983, in _find_and_load
File "", line 967, in _find_and_load_unlocked
File "", line 677, in _load_unlocked
File "", line 728, in exec_module
File "", line 219, in _call_with_frames_removed
File "/Users/ggi/_otehr/gt4sd-core/src/gt4sd/cli/inference.py", line 35, in
from ..algorithms.registry import ApplicationsRegistry
File "/Users/ggi/_otehr/gt4sd-core/src/gt4sd/algorithms/init.py", line 28, in
from .conditional_generation.guacamol.core import ( # noqa: F401
File "/Users/ggi/_otehr/gt4sd-core/src/gt4sd/algorithms/conditional_generation/guacamol/init.py", line 26, in
from .core import (
File "/Users/ggi/_otehr/gt4sd-core/src/gt4sd/algorithms/conditional_generation/guacamol/core.py", line 28, in
from ....training_pipelines.core import TrainingPipelineArguments
File "/Users/ggi/_otehr/gt4sd-core/src/gt4sd/training_pipelines/init.py", line 30, in
import pkg_resources
File "/opt/anaconda3/envs/gt4sd_tmp/lib/python3.7/site-packages/pkg_resources/init.py", line 3246, in
@_call_aside
File "/opt/anaconda3/envs/gt4sd_tmp/lib/python3.7/site-packages/pkg_resources/init.py", line 3221, in _call_aside
f(*args, **kwargs)
File "/opt/anaconda3/envs/gt4sd_tmp/lib/python3.7/site-packages/pkg_resources/init.py", line 3259, in _initialize_master_working_set
working_set = WorkingSet._build_master()
File "/opt/anaconda3/envs/gt4sd_tmp/lib/python3.7/site-packages/pkg_resources/init.py", line 581, in _build_master
return cls._build_from_requirements(requires)
File "/opt/anaconda3/envs/gt4sd_tmp/lib/python3.7/site-packages/pkg_resources/init.py", line 594, in _build_from_requirements
dists = ws.resolve(reqs, Environment())
File "/opt/anaconda3/envs/gt4sd_tmp/lib/python3.7/site-packages/pkg_resources/init.py", line 783, in resolve
raise DistributionNotFound(req, requirers)
pkg_resources.DistributionNotFound: The 'wheel>=0.26' distribution was not found and is required by tensorboard

@georgosgeorgos
Copy link
Contributor Author

Setting pip install wheel==0.26 and pip install protobuf==3.9.2 we can run inference.

@drugilsberg
Copy link
Contributor

Setting pip install wheel==0.26 and pip install protobuf==3.9.2 we can run inference.

Probably here, it's just about:

  • changing the <= to a < in this line
  • adding wheel>=0.26 in requirements.txt

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants