-
Notifications
You must be signed in to change notification settings - Fork 28.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-20496][SS] Bug in KafkaWriter Looks at Unanalyzed Plans #17787
Conversation
Test build #76236 has finished for PR 17787 at commit
|
/* No topic field or topic option */ | ||
var writer: StreamingQuery = null | ||
var ex: Exception = null | ||
try { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
no need for try
block
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done.
} | ||
} finally { | ||
} | ||
assert(ex.getMessage |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
what is the error message when you undo your changes?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
"'writeStream' can be called only on streaming Dataset/DataFrame;"
Test build #76239 has finished for PR 17787 at commit
|
Test build #76241 has finished for PR 17787 at commit
|
Test build #76247 has finished for PR 17787 at commit
|
Test build #76248 has finished for PR 17787 at commit
|
What changes were proposed in this pull request?
This now asserts that a plan has been analyzed before reading the schema.
How was this patch tested?
Existing Tests.
Please review http://spark.apache.org/contributing.html before opening a pull request.