Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implements batch executor handler #4242

Merged
merged 72 commits into from Mar 1, 2019
Merged
Changes from 1 commit
Commits
Show all changes
72 commits
Select commit Hold shift + click to select a range
6c92004
Extract batch column changes
breeswish Feb 14, 2019
efcc5c3
Rename BatchColumn to VectorValue
breeswish Feb 14, 2019
5e53940
Extract clone_vec_with_capacity into util
breeswish Feb 14, 2019
4048a3c
Extract LazyBatchColumn
breeswish Feb 14, 2019
c104c0f
Rename BatchRows to LazyBatchColumnVec
breeswish Feb 14, 2019
5695a5e
- Remove error from LazyBatchColumnVec
breeswish Feb 14, 2019
ae56bca
Merge branch '___batch_extract/batch_column_4' into ___batch_extract/…
breeswish Feb 14, 2019
a167c66
2018 -> 2019
breeswish Feb 14, 2019
bdfe742
Implement encode functions for VectorValue and LazyBatchColumn(Vec)
breeswish Feb 14, 2019
a52d9d5
Merge remote-tracking branch 'origin/master' into ___batch_extract/ba…
breeswish Feb 15, 2019
ccc7410
Merge branch '___batch_extract/batch_column_1' into ___batch_extract/…
breeswish Feb 15, 2019
272088d
Merge branch '___batch_extract/batch_column_2' into ___batch_extract/…
breeswish Feb 15, 2019
fd5c639
Merge branch '___batch_extract/batch_column_3' into ___batch_extract/…
breeswish Feb 15, 2019
68a06a9
Merge branch '___batch_extract/batch_column_4' into ___batch_extract/…
breeswish Feb 15, 2019
79e0713
Merge branch '___batch_extract/batch_column_5' into ___batch_extract/…
breeswish Feb 15, 2019
58ac02f
Address comments in former PRs
breeswish Feb 15, 2019
f6af534
Merge remote-tracking branch 'origin/master' into ___batch_extract/ba…
breeswish Feb 17, 2019
d54dca6
Merge branch '___batch_extract/batch_column_3' into ___batch_extract/…
breeswish Feb 17, 2019
10871f5
Merge branch '___batch_extract/batch_column_4' into ___batch_extract/…
breeswish Feb 17, 2019
0d72d90
Merge branch '___batch_extract/batch_column_5' into ___batch_extract/…
breeswish Feb 17, 2019
f235470
Fix typo
breeswish Feb 18, 2019
463092f
Merge remote-tracking branch 'origin/master' into ___batch_extract/ba…
breeswish Feb 18, 2019
ec5cbb8
Merge remote-tracking branch 'origin/master' into ___batch_extract/ba…
breeswish Feb 19, 2019
13dee0d
Merge branch '___batch_extract/batch_column_4' into ___batch_extract/…
breeswish Feb 19, 2019
b0f5340
Merge branch '___batch_extract/batch_column_5' into ___batch_extract/…
breeswish Feb 19, 2019
db52fee
Merge commit '55eff8a5fb3a7b447cf987120edf2b80a9ad8e7f' into ___batch…
breeswish Feb 19, 2019
ba12228
Merge branch '___batch_extract/batch_column_5' into ___batch_extract/…
breeswish Feb 19, 2019
d91b410
Address comments about some typos and grammar
breeswish Feb 20, 2019
e6e3222
Merge branch 'master' into ___batch_extract/batch_column_6
breeswish Feb 20, 2019
fb4671d
Provide ScalarValue
breeswish Feb 20, 2019
5d63d39
Introduce batch executor interfaces
breeswish Feb 20, 2019
13768be
Introduce batch handler
breeswish Feb 20, 2019
494bb35
wrap debug_assert functions with debug_assertions
breeswish Feb 20, 2019
c8da030
Include typo fixes from #4215
breeswish Feb 20, 2019
50bcc8b
Merge branch '___batch_extract/batch_column_5' into ___batch_extract/…
breeswish Feb 20, 2019
401d187
Merge branch '___batch_extract/batch_column_6' into ___batch_extract/…
breeswish Feb 20, 2019
dfd5070
Merge branch '___batch_extract/batch_column_t2/1' into ___batch_extra…
breeswish Feb 20, 2019
0d078c3
Merge branch '___batch_extract/batch_column_t2/2' into ___batch_extra…
breeswish Feb 20, 2019
4e55c52
Merge remote-tracking branch 'origin/master' into ___batch_extract/ba…
breeswish Feb 21, 2019
5d83415
Merge branch '___batch_extract/batch_column_6' into ___batch_extract/…
breeswish Feb 21, 2019
a1d3280
Merge branch '___batch_extract/batch_column_t2/1' into ___batch_extra…
breeswish Feb 21, 2019
5c0c5fa
Merge branch '___batch_extract/batch_column_t2/2' into ___batch_extra…
breeswish Feb 21, 2019
1edd230
Merge branch 'master' into ___batch_extract/batch_column_6
breeswish Feb 21, 2019
b2cb081
Encode unsigned int separately
breeswish Feb 24, 2019
3a95816
Merge branch '___batch_extract/batch_column_6' into ___batch_extract/…
breeswish Feb 24, 2019
f5dffe6
Merge branch '___batch_extract/batch_column_t2/1' into ___batch_extra…
breeswish Feb 24, 2019
9e38905
Merge branch '___batch_extract/batch_column_t2/2' into ___batch_extra…
breeswish Feb 24, 2019
1efadc3
Fix format
breeswish Feb 24, 2019
67a083b
Fix format
breeswish Feb 24, 2019
1fdf609
Fix format
breeswish Feb 24, 2019
49cd859
Fix format
breeswish Feb 24, 2019
18280a4
Reset storage change
breeswish Feb 25, 2019
63d3785
Merge branch '___batch_extract/batch_column_6' into ___batch_extract/…
breeswish Feb 25, 2019
b5ca80a
Merge remote-tracking branch 'origin/master' into ___batch_extract/ba…
breeswish Feb 25, 2019
3a0b937
Merge branch '___batch_extract/batch_column_t2/1' into ___batch_extra…
breeswish Feb 25, 2019
3ce53fb
Merge branch '___batch_extract/batch_column_t2/2' into ___batch_extra…
breeswish Feb 25, 2019
ad35f3b
Merge branch 'master' into ___batch_extract/batch_column_t2/2
AndreMouche Feb 26, 2019
ed7ade0
Merge remote-tracking branch 'origin/master' into ___batch_extract/ba…
breeswish Feb 26, 2019
460624f
Add comments for `pub` fields and structures
breeswish Feb 26, 2019
f027ddd
Merge branch '___batch_extract/batch_column_t2/2' into ___batch_extra…
breeswish Feb 26, 2019
b828c9c
Merge branch 'master' into ___batch_extract/batch_column_t2/3
breeswish Feb 27, 2019
db6a981
Merge branch 'master' into ___batch_extract/batch_column_t2/2
breeswish Feb 27, 2019
f8ecdbf
Merge branch 'master' into ___batch_extract/batch_column_t2/2
breeswish Feb 28, 2019
7425a51
Add TODOs for two major concerns during review, so that we can continue.
breeswish Feb 28, 2019
cd6fe54
Merge branch '___batch_extract/batch_column_t2/2' into ___batch_extra…
breeswish Feb 28, 2019
9b7603b
Fix dyn
breeswish Feb 28, 2019
b919dc5
Merge commit 'e2e9625a396cee537f7f9e83631452361e6f3caa' into ___batch…
breeswish Feb 28, 2019
029e061
Add deadline and more comments
breeswish Mar 1, 2019
e514a29
Adds several TODOs for these possible tuning works
breeswish Mar 1, 2019
e5808e1
Merge branch 'master' into ___batch_extract/batch_column_t2/3
breeswish Mar 1, 2019
acbbd33
Merge branch 'master' into ___batch_extract/batch_column_t2/3
breeswish Mar 1, 2019
1cc50fa
Merge branch 'master' into ___batch_extract/batch_column_t2/3
breeswish Mar 1, 2019
File filter...
Filter file types
Jump to…
Jump to file or symbol
Failed to load files and symbols.

Always

Just for now

Rename BatchRows to LazyBatchColumnVec

Signed-off-by: Breezewish <breezewish@pingcap.com>
  • Loading branch information...
breeswish committed Feb 14, 2019
commit c104c0f0b34a23025119724cf12afb314464dde0
@@ -20,7 +20,7 @@ use super::{LazyBatchColumn, VectorValue};
use crate::coprocessor::codec::mysql::Tz;
use crate::coprocessor::codec::Result;

pub struct BatchRows<E> {
pub struct LazyBatchColumnVec<E> {
/// Multiple interested columns. Each column is either decoded, or not decoded.
///
/// For decoded columns, they may be in different types. If the column is in
@@ -32,7 +32,7 @@ pub struct BatchRows<E> {
some_error: Option<E>,
}

impl<E: Clone> Clone for BatchRows<E> {
impl<E: Clone> Clone for LazyBatchColumnVec<E> {
#[inline]
fn clone(&self) -> Self {
Self {
@@ -42,8 +42,8 @@ impl<E: Clone> Clone for BatchRows<E> {
}
}

impl<E> BatchRows<E> {
/// Creates a new `BatchRows`, which contains `columns_count` number of raw columns
impl<E> LazyBatchColumnVec<E> {
/// Creates a new `LazyBatchColumnVec`, which contains `columns_count` number of raw columns
/// and each of them reserves capacity according to `rows_capacity`.
pub fn raw(columns_count: usize, rows_capacity: usize) -> Self {
let mut columns = Vec::with_capacity(columns_count);
@@ -230,8 +230,8 @@ mod tests {
vec![Some(Datum::U64(4)), None, Some(Datum::Null)],
];

// Empty BatchRows
let mut rows = BatchRows::<()>::raw(3, 1);
// Empty LazyBatchColumnVec
let mut rows = LazyBatchColumnVec::<()>::raw(3, 1);
assert_eq!(rows.rows_len(), 0);
assert_eq!(rows.columns_len(), 3);

@@ -317,7 +317,7 @@ mod tests {
},
];

let mut rows = BatchRows::<()>::raw(2, 3);
let mut rows = LazyBatchColumnVec::<()>::raw(2, 3);
assert_eq!(rows.rows_len(), 0);
assert_eq!(rows.columns_len(), 2);
assert_eq!(rows.rows_capacity(), 3);
@@ -12,9 +12,9 @@
// limitations under the License.

mod lazy_column;
mod rows;
mod lazy_column_vec;
mod vector;

pub use self::lazy_column::LazyBatchColumn;
pub use self::rows::BatchRows;
pub use self::lazy_column_vec::LazyBatchColumnVec;
pub use self::vector::VectorValue;
ProTip! Use n and p to navigate between commits in a pull request.
You can’t perform that action at this time.