Skip to content

Minibatch Preprocessing: fix dependent var with special character#273

Closed
jingyimei wants to merge 4 commits intoapache:masterfrom
madlib:bug_minibatch_preprocessor
Closed

Minibatch Preprocessing: fix dependent var with special character#273
jingyimei wants to merge 4 commits intoapache:masterfrom
madlib:bug_minibatch_preprocessor

Conversation

@jingyimei
Copy link

@jingyimei jingyimei commented May 25, 2018

JIRA:MADLIB-1237

Previously, minibatch processing would error out when the specified
dependent variable has special characters within its values. We
fixed this in two places:

  1. in the query with WHERE condition, we use $$ to queto string instead
    of ' ' to do string equals.
  2. in the query with creating an array column, instead of using
    SELECT '{ele'withspecial_char, 'M,M', 'M$M'}'::text[],
    we call
    SELECT string_to_array(''ele'with
    special_char', 'M"M', 'M$M'', ',')::text[]

Install check test cases also get updated.
Co-Authored-by: Jingyi Mei jmei@pivotal.io

JIRA:MADLIB-1237

Previously, minibatch processing would error out when the specified
dependent variable has special characters within its values. We
fixed this in two places:
1. in the query with WHERE condition, we use $$ to queto string instead
   of ' ' to do string equals.
2. in the query with creating an array column, instead of using
   SELECT '{ele'with*special_char, 'M,M', 'M$M'}'::text[], we call
   SELECT string_to_array(''ele'with*special_char', 'M"M', 'M$M'', ',')::text[]

Install check test cases also get updated.
Co-Authored-by: Jingyi Mei <jmei@pivotal.io>
@asfgit
Copy link

asfgit commented May 25, 2018

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/madlib-pr-build/490/

Copy link
Contributor

@ArvindSridhar ArvindSridhar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

\w @orhankislal Looks good to us

@asfgit
Copy link

asfgit commented May 31, 2018

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/madlib-pr-build/494/

@asfgit
Copy link

asfgit commented Jun 13, 2018

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/madlib-pr-build/513/

@asfgit
Copy link

asfgit commented Jun 14, 2018

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/madlib-pr-build/514/

@jingyimei
Copy link
Author

Will handle those in another PR, closing this one.

@jingyimei jingyimei closed this Jun 14, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants