Skip to content

Commit

Permalink
[SPARK-20296][TRIVIAL][DOCS] Count distinct error message for streaming
Browse files Browse the repository at this point in the history
## What changes were proposed in this pull request?
Update count distinct error message for streaming datasets/dataframes to match current behavior. These aggregations are not yet supported, regardless of whether the dataset/dataframe is aggregated.

Author: jtoka <jason.tokayer@gmail.com>

Closes #17609 from jtoka/master.

(cherry picked from commit 2e1fd46)
Signed-off-by: Sean Owen <sowen@cloudera.com>
  • Loading branch information
jtoka authored and srowen committed Apr 12, 2017
1 parent b2970d9 commit dbb6d1b
Showing 1 changed file with 2 additions and 3 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -103,9 +103,8 @@ object UnsupportedOperationChecker {
}
throwErrorIf(
child.isStreaming && distinctAggExprs.nonEmpty,
"Distinct aggregations are not supported on streaming DataFrames/Datasets, unless " +
"it is on aggregated DataFrame/Dataset in Complete output mode. Consider using " +
"approximate distinct aggregation (e.g. approx_count_distinct() instead of count()).")
"Distinct aggregations are not supported on streaming DataFrames/Datasets. Consider " +
"using approx_count_distinct() instead.")

case _: Command =>
throwError("Commands like CreateTable*, AlterTable*, Show* are not supported with " +
Expand Down

0 comments on commit dbb6d1b

Please sign in to comment.