Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error with piping the logs into a file. #14748

Open
5 tasks done
tchaton opened this issue Sep 16, 2022 · 0 comments
Open
5 tasks done

Error with piping the logs into a file. #14748

tchaton opened this issue Sep 16, 2022 · 0 comments
Assignees
Labels
app Generic label for Lightning App package bug Something isn't working

Comments

@tchaton
Copy link
Contributor

tchaton commented Sep 16, 2022

First check

  • I'm sure this is a bug.
  • I've added a descriptive title to this bug.
  • I've provided clear instructions on how to reproduce the bug.
  • I've added a code sample.
  • I've provided any other important info that is required.

Bug description

Reported by @kaushikb11

 lightning show logs app_id > log.txt

generated the following error.s

Exception ignored in: <function ApiClient.__del__ at 0x119540790>
Traceback (most recent call last):
  File/Users/kaushikbokka/apps/lightning-hpo/hpo-venv/lib/python3.9/site-packages/lightning_cloud/openapi/api_client.py”, line 88, in __del__
    self.pool.close()
  File/usr/local/Cellar/python@3.9/3.9.13_3/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/pool.py”, line 649, in close
    self._change_notifier.put(None)
  File/usr/local/Cellar/python@3.9/3.9.13_3/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/queues.py”, line 377, in put
    self._writer.send_bytes(obj)
  File/usr/local/Cellar/python@3.9/3.9.13_3/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/connection.py”, line 205, in send_bytes
    self._send_bytes(m[offset:offset + size])
  File/usr/local/Cellar/python@3.9/3.9.13_3/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/connection.py”, line 416, in _send_bytes
    self._send(header + buf)
  File/usr/local/Cellar/python@3.9/3.9.13_3/Frameworks/Python.framework/Versions/3.9/lib/python3.9/multiprocessing/connection.py”, line 373, in _send
    n = write(self._handle, buf)
OSError: [Errno 9] Bad file descriptor

How to reproduce the bug

You can launch an app in the cloud and pipe the logs into a file.

Error messages and logs


# Error messages and logs here please

Important info


#- Lightning Component (e.g. Trainer, LightningModule, LightningApp, LightningWork, LightningFlow):
#- PyTorch Lightning Version (e.g., 1.5.0):
#- Lightning App Version (e.g., 0.5.2):
#- PyTorch Version (e.g., 1.10):
#- Python version (e.g., 3.9):
#- OS (e.g., Linux):
#- CUDA/cuDNN version:
#- GPU models and configuration:
#- How you installed Lightning(`conda`, `pip`, source):
#- Running environment of LightningApp (e.g. local, cloud):

More info

No response

@tchaton tchaton added bug Something isn't working needs triage Waiting to be triaged by maintainers labels Sep 16, 2022
@awaelchli awaelchli added app Generic label for Lightning App package and removed needs triage Waiting to be triaged by maintainers labels Sep 16, 2022
@Borda Borda self-assigned this Nov 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
app Generic label for Lightning App package bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants