New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
HPCC-19743 Allow disk read to directly deserialize a row without calling a transform #11456
Conversation
https://track.hpccsystems.com/browse/HPCC-19743 |
@jakesmith can you foresee this causing any problems? I've tested as best as I can, and it seems to work with Thor as it stands. It will allow more efficient dynamic spilling (and some remote reads). |
I will look at the failures - I hadn't run a full regression suite locally. |
The failures were linked with dictionaries being serialized to disk as datasets. |
@richardkchapman please can you review the translator changes. |
Translator changes look ok. Back to @shamser to review coedgen |
new PR added extra test variants to sqfilt.ecl to cover cases I was slightly concerned about. |
…ing a transform Currently only implemented for Thor, since this is the engine that will gain the main benefit when spill files are dynamically spilled. Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Automated Smoketest: ✅ Unit tests result:
Regression test result:
HPCC Stop: OK
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@richardkchapman Code Reviewed. Looks good.
Currently only implemented for Thor, since this is the engine that will
gain the main benefit when spill files are dynamically spilled.
Signed-off-by: Gavin Halliday gavin.halliday@lexisnexis.com
Type of change:
Checklist:
Testing: