-
Notifications
You must be signed in to change notification settings - Fork 28.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-48650][PYTHON] Display correct call site from IPython Notebook #47009
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I feel the file name doesn't make much sense, but the line number really matters. Just a suggestion: is there a way to highlight the line number?
@allisonwang-db Actually that is a good point. Let me try highlighting and providing more useful debugging information from error message. |
Now we use the cell number instead of file name for better debuggability. Updated before/after in PR description. cc @allisonwang-db FYI |
…ontext_on_notebook
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This looks much better!
Merged to master. |
What changes were proposed in this pull request?
This PR proposes to display correct call site information from IPython Notebook.
Why are the changes needed?
We added
DataFrameQueryContext
for PySpark error message from #45377, but it does not working very well from IPython Notebook.Does this PR introduce any user-facing change?
No API changes, but the user-facing error message from IPython Notebook will be improved:
Before
After
NOTE: This also works when command is executed across multiple cells:
How was this patch tested?
Manually tested with IPython Notebook.
Was this patch authored or co-authored using generative AI tooling?
No