Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-9814][SQL] EqualNotNull not passing to data sources #8096

Closed
wants to merge 3 commits into from
Closed

[SPARK-9814][SQL] EqualNotNull not passing to data sources #8096

wants to merge 3 commits into from

Conversation

HyukjinKwon
Copy link
Member

No description provided.

@@ -38,6 +38,14 @@ case class EqualTo(attribute: String, value: Any) extends Filter

/**
* A filter that evaluates to `true` iff the attribute evaluates to a value
* null safe and equal to `value`.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it'd be better if we expand this a bit to explain what null-safe means. e.g. similar to what's in mysql docs: http://dev.mysql.com/doc/refman/5.0/en/comparison-operators.html#operator%5Fequal-to

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should I write like this?

A filter that evaluates to true if the attribute evaluates to a value equal to value and if both the attribute and the value are null.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe this

Performs equality comparison, similar to [[EqualTo]]. However, this differs from [[EqualTo]] in that it returns true (rather than NULL) if both inputs are NULL, and false (rather than NULL) if one of the input is NULL and the other is not NULL.

@rxin
Copy link
Contributor

rxin commented Aug 11, 2015

Jenkins, test this please.

@SparkQA
Copy link

SparkQA commented Aug 11, 2015

Test build #40428 has finished for PR 8096 at commit 7cdcf1c.

  • This patch fails Scala style tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • case class EqualNullSafe(attribute: String, value: Any) extends Filter

@HyukjinKwon
Copy link
Member Author

Reset this please :)

@rxin
Copy link
Contributor

rxin commented Aug 11, 2015

Jenkins, retest this please.

@SparkQA
Copy link

SparkQA commented Aug 11, 2015

Test build #40481 has finished for PR 8096 at commit b3fe5d3.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • case class EqualNullSafe(attribute: String, value: Any) extends Filter

@rxin
Copy link
Contributor

rxin commented Aug 11, 2015

Thanks - I've merged this.

asfgit pushed a commit that referenced this pull request Aug 11, 2015
Author: hyukjinkwon <gurwls223@gmail.com>
Author: 권혁진 <gurwls223@gmail.com>

Closes #8096 from HyukjinKwon/master.

(cherry picked from commit 00c0272)
Signed-off-by: Reynold Xin <rxin@databricks.com>
@asfgit asfgit closed this in 00c0272 Aug 11, 2015
CodingCat pushed a commit to CodingCat/spark that referenced this pull request Aug 17, 2015
Author: hyukjinkwon <gurwls223@gmail.com>
Author: 권혁진 <gurwls223@gmail.com>

Closes apache#8096 from HyukjinKwon/master.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants