-
Notifications
You must be signed in to change notification settings - Fork 4.8k
HIVE-23807 Wrong results with vectorization enabled #1212
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
…han 1 child (Pengcheng Xiong, reviewed by Ashutosh Chauhan)
…nts on some operators (Jason Dere, reviewed by Gopal V)
…garwal via Thejas Nair)
…ukhin, reviewed by Gopal Vijayaraghavan)
…tResultSetMetaData (Pengcheng Xiong, reviewed by Ashutosh Chauhan)
…pplication (Wei Zheng, reviewed by Eugene Koifman)
…onfig should load defaults (Sergey Shelukhin, reviewed by Siddharth Seth)
…pplication, ADDENDUM
…autogather column stats is on (Pengcheng Xiong, reviewed by Ashutosh Chauhan)
…epping, reviewed by Sergio Pena, Ashutosh Chauhan)
…ion back to hive warehouse (Vihang Karajgaonkar, reviewed by Sergio Pena, Ying Chen)
…ion back to hive warehouse (Vihang Karajgaonkar, reviewed by Sergio Pena, Ying Chen) (addendum I)
…Shelukhin, reviewed by Siddharth Seth)
…rgey Shelukhin, reviewed by Siddharth Seth)
… Infinity value in double column (Pengcheng Xiong, reviewed by Ashutosh Chauhan)
…ition/list bucket tables & inserting cross blobstore tables (Rentao Wu, reviewed by Sergio Pena)
…e been processed (Chao Sun, reviewed by Xuefu Zhang)
…ao Li reviewed by Vaibhav Gumashta)
…oifman, reviewed by Wei Zheng)
…, reviewed by Sergey Shelukhin)
…iong, reviewed by Ashutosh Chauhan)
…ia Pengcheng Xiong)
… transactional and non-transactional listeners. (Sergio Pena, reviewed by Mohit Sabharwal, Alexander Kolbasov)
…khin, reviewed by Prasanth Jayachandran)
…ukhin, reviewed by Prasanth Jayachandran)
… in use (Daniel Dai, reviewed by Laszlo Pinter, Thejas Nair) Signed-off-by: Thejas M Nair <thejas@hortonworks.com>
… in use (Daniel Dai, reviewed by Laszlo Pinter, Thejas Nair) Signed-off-by: Thejas M Nair <thejas@hortonworks.com>
… Dai, reviewed by Thejas Nair)
(Prasanth Jayachandran reviewed by Sergey Shelukhin) Added additional test case from HIVE-19638. Signed-off-by: Owen O'Malley <omalley@apache.org>
Fixes apache#590 Signed-off-by: Owen O'Malley <omalley@apache.org>
…Piotr Findeisen via Alan Gates)
…on JDK10 or newer (Ana Jalba, via Peter Vary)
| String dateString = new String(inV.vector[i], inV.start[i], inV.length[i], StandardCharsets.UTF_8); | ||
| if (dateParser.parseDate(dateString, sqlDate)) { | ||
| try { | ||
| Date utilDate = Date.valueOf(dateString); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is this vectorized expression generated for GenericUDFDate? It seems that UDF still relies on DateParser in this branch:
| if (dateParser.parseDate(dateString, date)) { |
Since the change may have an effect on parsing of other dates, it may be good to have a test run. It seems we have a jenkins active for branch-2 patches: http://130.211.9.232/job/hive-precommit/job/branch-2/ . I am wondering whether a PR against branch-2 will trigger it or whether we can trigger it manually. Could you verify?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes this vectorized expression is generated for GenericUDFDate. I don't see any way to trigger precommit job manually for branch-2. @kgyrtkirk Do you know how can I trigger ptest for branch-2?
NOTICE
Please create an issue in ASF JIRA before opening a pull request,
and you need to set the title of the pull request which starts with
the corresponding JIRA issue number. (e.g. HIVE-XXXXX: Fix a typo in YYY)
For more details, please see https://cwiki.apache.org/confluence/display/Hive/HowToContribute