Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

log streaming does not terminate if a job is terminated while streaming logs #63

Open
SinaChavoshi opened this issue Jul 17, 2020 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@SinaChavoshi
Copy link
Collaborator

I started a job with log streaming enabled. While the job was running I manually terminated the job in AI Platform training by clicking on stop job in the UI. The log streaming continued to run after 5 minutes until manual termination with the following:

  File ".../cloud/tensorflow_cloud/deploy.py", line 211, in _stream_logs
    output = process.stdout.readline()

I expected when the job is terminated on AI Platform training the log streaming should also terminate / stop.

@pavithrasv pavithrasv self-assigned this Jul 17, 2020
@pavithrasv pavithrasv added the bug Something isn't working label Jul 17, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants