Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix Docker build & register both flows #5

Merged
merged 1 commit into from
Oct 29, 2022
Merged

Fix Docker build & register both flows #5

merged 1 commit into from
Oct 29, 2022

Conversation

b-long
Copy link
Owner

@b-long b-long commented Oct 29, 2022 •
edited
Loading

Build Results

  • Succeeds: Yes

Flows working?

  • basic-add-flow: Yes
  • basic-pandas-flow: Yes

Full build log:

./aid/prefect/step-3-register-flow.sh
Configuration file exists at /Users/b-long/Library/Application Support/pypoetry, reusing this directory.

Consider moving configuration to /Users/b-long/Library/Preferences/pypoetry, as support for the legacy directory will be removed in an upcoming release.
/Users/b-long/Desktop/github/b-long/aid/.venv/lib/python3.10/site-packages/prefect/storage/docker.py:325: UserWarning: This Docker storage object has no `registry_url`, and will not be pushed.
  self._build_image(push=push)
[2022-10-29 08:19:36-0400] INFO - prefect.Docker | Building the flow's Docker storage...
Step 1/17 : FROM prefecthq/prefect:1.3.1-python3.10 as python-base
 ---> 16d2aaf55962
Step 2/17 : RUN pip install --upgrade pip
 ---> Using cache
 ---> fae3fb04dc81
Step 3/17 : RUN pip install poetry==1.2.1
 ---> Using cache
 ---> aa824fd58f5d
Step 4/17 : COPY README.md pyproject.toml poetry.lock /opt/aid/
 ---> Using cache
 ---> 96bb07a3cf51
Step 5/17 : COPY aid/ /opt/aid/aid/
 ---> Using cache
 ---> 1e4fecb6ac98
Step 6/17 : WORKDIR /opt/aid
 ---> Using cache
 ---> 494ea84fb41c
Step 7/17 : RUN poetry config virtualenvs.create false
 ---> Using cache
 ---> 70e09b24606c
Step 8/17 : RUN poetry config virtualenvs.prefer-active-python true
 ---> Using cache
 ---> be57cfc4745b
Step 9/17 : RUN poetry install --only main
 ---> Using cache
 ---> 9cdf673d2a51
Step 10/17 : ENV PREFECT__USER_CONFIG_PATH='/opt/prefect/config.toml'
 ---> Using cache
 ---> 2d852c634bb8
Step 11/17 : RUN pip install pip --upgrade
 ---> Using cache
 ---> e61014a9edc4
Step 12/17 : RUN pip show prefect || pip install git+https://github.com/PrefectHQ/prefect.git@1.3.1#egg=prefect[all_orchestration_extras]
 ---> Using cache
 ---> 5113dfdcc24a
Step 13/17 : RUN pip install 'wheel'
 ---> Using cache
 ---> 7b88cdb15842
Step 14/17 : RUN mkdir -p /opt/prefect/
 ---> Using cache
 ---> 58eb53198014
Step 15/17 : COPY ./tmplm8qi56k/basic-add-flow.flow /opt/prefect/flows/basic-add-flow.prefect
 ---> 7aeb73368234
Step 16/17 : COPY ./tmplm8qi56k/healthcheck.py /opt/prefect/healthcheck.py
 ---> e9ad094d9aa4
Step 17/17 : RUN python /opt/prefect/healthcheck.py '["/opt/prefect/flows/basic-add-flow.prefect"]' '(3, 10)'
 ---> Running in de008f43abfc
Beginning health checks...
System Version check: OK
Cloudpickle serialization check: OK
Result check: OK
All health checks passed.
Removing intermediate container de008f43abfc
 ---> 0253a517f3b8
Successfully built 0253a517f3b8
Successfully tagged basic-add-flow:basic-add-flow
Flow URL: http://localhost:8080/default/flow/04fd238c-575a-43d6-8e7b-e742ed81d16b
 └── ID: b270ddc3-86e8-463a-83c0-e78e53315cd6
 └── Project: aid-tenant
 └── Labels: []
Configuration file exists at /Users/b-long/Library/Application Support/pypoetry, reusing this directory.

Consider moving configuration to /Users/b-long/Library/Preferences/pypoetry, as support for the legacy directory will be removed in an upcoming release.
/Users/b-long/Desktop/github/b-long/aid/.venv/lib/python3.10/site-packages/prefect/storage/docker.py:325: UserWarning: This Docker storage object has no `registry_url`, and will not be pushed.
  self._build_image(push=push)
[2022-10-29 08:20:01-0400] INFO - prefect.Docker | Building the flow's Docker storage...
Step 1/17 : FROM prefecthq/prefect:1.3.1-python3.10 as python-base
 ---> 16d2aaf55962
Step 2/17 : RUN pip install --upgrade pip
 ---> Using cache
 ---> fae3fb04dc81
Step 3/17 : RUN pip install poetry==1.2.1
 ---> Using cache
 ---> aa824fd58f5d
Step 4/17 : COPY README.md pyproject.toml poetry.lock /opt/aid/
 ---> Using cache
 ---> 96bb07a3cf51
Step 5/17 : COPY aid/ /opt/aid/aid/
 ---> Using cache
 ---> 1e4fecb6ac98
Step 6/17 : WORKDIR /opt/aid
 ---> Using cache
 ---> 494ea84fb41c
Step 7/17 : RUN poetry config virtualenvs.create false
 ---> Using cache
 ---> 70e09b24606c
Step 8/17 : RUN poetry config virtualenvs.prefer-active-python true
 ---> Using cache
 ---> be57cfc4745b
Step 9/17 : RUN poetry install --only main
 ---> Using cache
 ---> 9cdf673d2a51
Step 10/17 : ENV PREFECT__USER_CONFIG_PATH='/opt/prefect/config.toml'
 ---> Using cache
 ---> 2d852c634bb8
Step 11/17 : RUN pip install pip --upgrade
 ---> Using cache
 ---> e61014a9edc4
Step 12/17 : RUN pip show prefect || pip install git+https://github.com/PrefectHQ/prefect.git@1.3.1#egg=prefect[all_orchestration_extras]
 ---> Using cache
 ---> 5113dfdcc24a
Step 13/17 : RUN pip install 'wheel'
 ---> Using cache
 ---> 7b88cdb15842
Step 14/17 : RUN mkdir -p /opt/prefect/
 ---> Using cache
 ---> 58eb53198014
Step 15/17 : COPY ./tmpxf6v1pxb/basic-pandas-flow.flow /opt/prefect/flows/basic-pandas-flow.prefect
 ---> f29937395f1a
Step 16/17 : COPY ./tmpxf6v1pxb/healthcheck.py /opt/prefect/healthcheck.py
 ---> be6cca8172f1
Step 17/17 : RUN python /opt/prefect/healthcheck.py '["/opt/prefect/flows/basic-pandas-flow.prefect"]' '(3, 10)'
 ---> Running in 533cfe011100
Beginning health checks...
System Version check: OK
Cloudpickle serialization check: OK
Result check: OK
All health checks passed.
Removing intermediate container 533cfe011100
 ---> 3ec7bab4103d
Successfully built 3ec7bab4103d
Successfully tagged basic-pandas-flow:basic-pandas-flow
Flow URL: http://localhost:8080/default/flow/5faa8a2e-b7a3-4faa-9369-9a6e94ffc46e
 └── ID: 13d78f83-c134-4771-aa2c-b0afac97dd08
 └── Project: aid-tenant
 └── Labels: []

Run log for "basic-add-flow":

29 October 2022,08:23:29 	agent	INFO	Submitted for execution: Container ID: 36340bd55758797c791b0df4c948c7f107a3162a7870c9d74c182371938b9456
29 October 2022,08:23:30 	prefect.CloudFlowRunner	INFO	Beginning Flow run for 'basic-add-flow'
29 October 2022,08:23:30 	prefect.CloudTaskRunner	INFO	Task 'addition_task': Starting task run...
29 October 2022,08:23:30 	prefect.addition_task	INFO	************Performing addition************
29 October 2022,08:23:30 	prefect.CloudTaskRunner	INFO	Task 'addition_task': Finished task run for task with final state: 'Success'
29 October 2022,08:23:30 	prefect.CloudFlowRunner	INFO	Flow run SUCCESS: all reference tasks succeeded

Run log for "basic-pandas-flow":

29 October 2022,08:22:54 	agent	INFO	Submitted for execution: Container ID: 6f1e0bee362548dc3f49a7101e0bde9ee26ebca0b09562db2001118de305ae61
29 October 2022,08:22:54 	prefect.CloudFlowRunner	INFO	Beginning Flow run for 'basic-pandas-flow'
29 October 2022,08:22:55 	prefect.CloudTaskRunner	INFO	Task 'pandas_task': Starting task run...
29 October 2022,08:22:55 	prefect.pandas_task	INFO	************Doing pandas thing for FOO='foo'************
29 October 2022,08:22:55 	prefect.CloudTaskRunner	INFO	Task 'pandas_task': Finished task run for task with final state: 'Success'
29 October 2022,08:22:55 	prefect.CloudFlowRunner	INFO	Flow run SUCCESS: all reference tasks succeeded

This was referenced Oct 29, 2022
Closed
Closed
Closed
Closed
@b-long b-long merged commit 705de04 into main Oct 29, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@b-long