Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: event log empty for new notebook that is failing to start #1607

Closed
1 task done
christianvogt opened this issue Jul 28, 2023 · 4 comments · Fixed by #1608
Closed
1 task done

[Bug]: event log empty for new notebook that is failing to start #1607

christianvogt opened this issue Jul 28, 2023 · 4 comments · Fixed by #1608
Assignees
Labels
feature/ds-projects Data Science Projects feature (formerly Data Science Groupings - DSG) kind/bug Something isn't working priority/normal An issue with the product; fix when possible rhods-1.33

Comments

@christianvogt
Copy link
Contributor

Is there an existing issue for this?

  • I have searched the existing issues

Deploy type

OpenDataHub core version (eg. v1.6.0)

Version

1.7.0

Current Behavior

Maybe some relation to #579

My notebook server is not starting and the UI did not display any error message or event logs as to why. Dropping back to the console was the only way to understand that the dev cluster had a resource issue.

image

image

image
image

Expected Behavior

Event log and / or pod status should be presented to the user to understand why it's not starting.

Steps To Reproduce

Using a new dev cluster which has limited resources apparently.

  1. create a new project
  2. create a new workbench and use a large size. Consider adding a new notebookSizes entry to the OdhDashboardConfig if your notebook server still starts.
  3. Observe the pod not starting.
  4. Check the dashboard UI by clicking on Starting... and viewing the event log

Workaround (if any)

none in the dashboard

What browsers are you seeing the problem on?

Chrome

Anything else

No response

@christianvogt christianvogt added kind/bug Something isn't working untriaged Indicates the newly create issue has not been triaged yet priority/normal An issue with the product; fix when possible labels Jul 28, 2023
@christianvogt
Copy link
Contributor Author

The Notebook instance has no notebooks.kubeflow.org/last-activity annotation and therefore the UI assumes it hasn't started.

Here's what the UI should show:
image

image

@lucferbux
Copy link
Contributor

I think #793 is also related to this one right?

@christianvogt
Copy link
Contributor Author

I think #793 is also related to this one right?

Certainly the pod failing as described in that issue is similar with the same outcome. However that issue does talk about the expectation to look at more than just the pod for relevant status. So at least in part they should share the same resolution for the immediate use case described.

@Gkrumbach07 Gkrumbach07 added feature/notebook-controller KubeFlow NoteBook Controller (KFNBC) Feature feature/ds-projects Data Science Projects feature (formerly Data Science Groupings - DSG) and removed untriaged Indicates the newly create issue has not been triaged yet feature/notebook-controller KubeFlow NoteBook Controller (KFNBC) Feature labels Jul 31, 2023
@christianvogt christianvogt self-assigned this Jul 31, 2023
@christianvogt
Copy link
Contributor Author

@lucferbux unfortunately #793 will require additional changes because the error occurs on the StatefulSet before a pod is created. I tested a fix for this issue and it had no affect on #793

@andrewballantyne andrewballantyne modified the milestones: Current Release, Upcoming Release Aug 16, 2023
@andrewballantyne andrewballantyne removed this from the Current Release milestone Sep 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature/ds-projects Data Science Projects feature (formerly Data Science Groupings - DSG) kind/bug Something isn't working priority/normal An issue with the product; fix when possible rhods-1.33
Projects
Status: Done
Archived in project
Status: No status
Development

Successfully merging a pull request may close this issue.

5 participants