Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[YSQL] [PERF] Optimize the execution pipeline when expression evaluation is not needed in Postgres layer #2173

Open
nocaway opened this issue Aug 27, 2019 · 1 comment
Labels
area/ysql Yugabyte SQL (YSQL) kind/enhancement This is an enhancement of an existing feature priority/medium Medium priority issue
Projects

Comments

@nocaway
Copy link
Contributor

nocaway commented Aug 27, 2019

Jira Link: DB-4837
#2178 is prerequisite for this work.
Currently our pipeline serializes and deserializes data twice before sending it to users / clients.

1- Load column data from disk.
2- Evaluate YugaByte-supported expressions of columns.
3- Serialize the result from step 2 and send the buffer to proxy server.
4- Deserialize the buffer from step 3 back into individual values (Postgres::Datum).
5- Evaluate expressions of datums using Postgres code.
6- Serialize the result from step 5 back into a buffer.
7- Send the buffer from step 6 to client side.

For the scenarios where YugaByte can evaluate all expressions, we should not need steps 4, 5, and 6. In these cases, DocDB should serialize data in a proper format, and the content of the resulted buffer should be sent to client without any extra processing.

@nocaway nocaway added the kind/enhancement This is an enhancement of an existing feature label Aug 27, 2019
@nocaway nocaway self-assigned this Aug 27, 2019
@nocaway nocaway added this to To do in YSQL via automation Aug 27, 2019
@nocaway nocaway changed the title [YSQL] Optimize the execution pipeline when expression evaluation is not needed in Postgres layer [YSQL] [PERF] Optimize the execution pipeline when expression evaluation is not needed in Postgres layer Aug 28, 2019
@nocaway
Copy link
Contributor Author

nocaway commented Aug 28, 2019

'cc @mbautin @m-iancu @ndeodhar

@ndeodhar ndeodhar moved this from To do to Backlog in YSQL Aug 5, 2020
@rthallamko3 rthallamko3 added the area/ysql Yugabyte SQL (YSQL) label Jan 3, 2023
@yugabyte-ci yugabyte-ci added the priority/medium Medium priority issue label Jan 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/ysql Yugabyte SQL (YSQL) kind/enhancement This is an enhancement of an existing feature priority/medium Medium priority issue
Projects
Status: No status
YSQL
  
Backlog
Development

No branches or pull requests

3 participants