Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

457 analyze failed item, 645 ssmt base image, #680

Merged
merged 28 commits into from Mar 13, 2020
Merged

457 analyze failed item, 645 ssmt base image, #680

merged 28 commits into from Mar 13, 2020

Conversation

devclinton
Copy link
Member

@shchen-idmod
Copy link
Collaborator

shchen-idmod commented Mar 11, 2020

when I run pymake ssmt-image-local in idmtools_platform_comps dir, I got:

2020-03-11 16:30:13 [INFO    ]  Please be sure you are logged into the docker-production.packages.idmod.org Docker Repo
2020-03-11 16:30:13 [INFO    ]  Username:
shchen@idmod.org
Password:
2020-03-11 16:30:43 [INFO    ]  Username:Sending build context to Docker daemon  56.32kB
2020-03-11 16:30:43 [INFO    ]
2020-03-11 16:30:43 [INFO    ]  Step 1/8 : FROM idm-docker-production.packages.idmod.org/comps/ssmt/ubuntu18.04_ssmt_base:latest
2020-03-11 16:30:43 [INFO    ]  unauthorized: The client does not have permission for manifest
2020-03-11 16:30:43 [INFO    ]  PIP URL: http://localhost:7171/
2020-03-11 16:30:43 [INFO    ]  Running: docker build --network=host --build-arg PYPIURL=http://localhost:7171/ --build-arg PYPIHOST=localhost --build-arg SSMT_VERSION=0.3.0.10 --tag idm-docker-staging.packages.idmod.org/idmtools_comps_ssmt_worker:0.3.0.10 .
2020-03-11 16:30:43 [INFO    ]  Traceback (most recent call last):
2020-03-11 16:30:43 [INFO    ]  File "C:\Python37\Lib\runpy.py", line 193, in _run_module_as_main
2020-03-11 16:30:43 [INFO    ]  "__main__", mod_spec)
2020-03-11 16:30:43 [INFO    ]  File "C:\Python37\Lib\runpy.py", line 85, in _run_code
2020-03-11 16:30:43 [INFO    ]  exec(code, run_globals)
2020-03-11 16:30:43 [INFO    ]  File "C:\idmtools_cli_new_37\Scripts\pymake.exe\__main__.py", line 7, in <module>
2020-03-11 16:30:43 [INFO    ]  File "c:\idmtools_cli_new_37\lib\site-packages\pymake\_main.py", line 63, in main
2020-03-11 16:30:43 [INFO    ]  ignore_errors=opts['--ignore-errors'])
2020-03-11 16:30:43 [INFO    ]  File "c:\idmtools_cli_new_37\lib\site-packages\pymake\_pymake.py", line 143, in execute_makefile_commands
2020-03-11 16:30:43 [INFO    ]  check_call(parsed_cmd)
2020-03-11 16:30:43 [INFO    ]  File "C:\Python37\Lib\subprocess.py", line 347, in check_call
2020-03-11 16:30:43 [INFO    ]  raise CalledProcessError(retcode, cmd)
2020-03-11 16:30:43 [CRITICAL]  subprocess.CalledProcessError: Command '['python', 'build_docker_image.py', 'http://localhost:7171/']' returned non-zero exit status 1.
2020-03-11 16:30:43 [INFO    ]  python ../../dev_scripts/run.py -w '../../dev_scripts/local_pypi' -ex 'docker-compose up -d'
2020-03-11 16:30:43 [INFO    ]  python ../../dev_scripts/run.py -w '../../idmtools_core' -ex 'pymake release-local'
2020-03-11 16:30:43 [INFO    ]  python ../../dev_scripts/run.py -w '../../idmtools_models' -ex 'pymake release-local'
2020-03-11 16:30:43 [INFO    ]  python ../../dev_scripts/run.py -w '../../idmtools_platform_comps' -ex 'pymake release-local'
2020-03-11 16:30:43 [INFO    ]  python build_docker_image.py http://localhost:7171/
2020-03-11 16:30:43 [ERROR   ]  pymake docker-local did not succeed

I also try docker login docker-production.packages.idmod.org which was "Login Succeeded"

Copy link

@braybaud braybaud left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved, thanks @devclinton

@shchen-idmod
Copy link
Collaborator

Can not run "idmtools local start"

  File "c:\github_cli\idmtools\idmtools_platform_local\idmtools_platform_local\cli\local.py", line 71, in start
    cli_context.sm.create_services()
  File "c:\github_cli\idmtools\idmtools_core\idmtools\utils\decorators.py", line 167, in wrapper
    raise e
  File "c:\github_cli\idmtools\idmtools_core\idmtools\utils\decorators.py", line 163, in wrapper
    result = func(*args, **kwargs)
  File "c:\github_cli\idmtools\idmtools_platform_local\idmtools_platform_local\infrastructure\service_manager.py", line 156, in create_services
    raise e
  File "c:\github_cli\idmtools\idmtools_platform_local\idmtools_platform_local\infrastructure\service_manager.py", line 150, in create_services
    self._services[sn].get_or_create(spinner)
  File "c:\github_cli\idmtools\idmtools_platform_local\idmtools_platform_local\infrastructure\base_service_container.py", line 95, in get_or_create
    container = self.create(spinner)
  File "c:\github_cli\idmtools\idmtools_platform_local\idmtools_platform_local\infrastructure\workers.py", line 103, in create
    result = super().create(spinner)
  File "c:\github_cli\idmtools\idmtools_platform_local\idmtools_platform_local\infrastructure\base_service_container.py", line 153, in create
    raise e
  File "c:\github_cli\idmtools\idmtools_platform_local\idmtools_platform_local\infrastructure\base_service_container.py", line 115, in create
    container = self.client.containers.run(**container_config)
  File "c:\idmtools_cli_new_37\lib\site-packages\docker\models\containers.py", line 805, in run
    self.client.images.pull(image, platform=platform)
  File "c:\idmtools_cli_new_37\lib\site-packages\docker\models\images.py", line 444, in pull
    repository, tag=tag, stream=True, **kwargs
  File "c:\idmtools_cli_new_37\lib\site-packages\docker\api\image.py", line 414, in pull
    self._raise_for_status(response)
  File "c:\idmtools_cli_new_37\lib\site-packages\docker\api\client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "c:\idmtools_cli_new_37\lib\site-packages\docker\errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error: Not Found ("manifest for docker-staging.packages.idmod.org/idmtools/local_workers:0.3.0.nightly not found")

@devclinton
Copy link
Member Author

devclinton commented Mar 12, 2020

We have not pushed that image yet. Did you rebuild the image locally?

locally

@devclinton
Copy link
Member Author

Nevermind I see issues. For local builds of platform, we have to use idm-docker-staging on the local platform. Updated

@shchen-idmod
Copy link
Collaborator

shchen-idmod commented Mar 12, 2020

Local platform is OK with local build, Also pushed local_worker to aritifactory and tested with remote image. all good.

Now I have new issue with pymake ssmt-image-local:

2020-03-12 11:24:43 [INFO    ]  2020-03-12 11:24:43 [INFO    ]  python setup.py sdist
2020-03-12 11:24:43 [INFO    ]  2020-03-12 11:24:43 [INFO    ]  twine upload --verbose --repository-url http://localhost:7171 -u admin -p admin dist/*
2020-03-12 11:24:43 [INFO    ]  Please be sure you are logged into the docker-production.packages.idmod.org Docker Repo
2020-03-12 11:24:43 [INFO    ]  Username:
shchen@idmod.org
Password:
2020-03-12 11:24:54 [INFO    ]  Username:b'{"errors":[{"code":"NAME_UNKNOWN","message":"Repository name not known to registry.","detail":{"name":"idmtools/comps_ssmt_worker"}}]}'
2020-03-12 11:24:54 [INFO    ]  Traceback (most recent call last):

looks like I do not have permission with this new location
Update:
Mary is trying to manually create comps-ssmt-image folder now under staging idmtools

Update: still got the same error as above after Mary created a folder:comps_ssmt_worker under idmtools

Update: after we copy an image from old place to the new place, we can build now

@shchen-idmod shchen-idmod merged commit 1aad7e6 into InstituteforDiseaseModeling:dev Mar 13, 2020
@devclinton devclinton deleted the 457_analyze_failed_item branch March 27, 2020 00:49
@devclinton devclinton added this to the 1.0 milestone May 8, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants