Repository navigation
cuplyr 0.1.0
Lazy evaluation
-
tbl_gpu()gains alazyargument to enable deferred execution. Operations build an AST (Abstract Syntax Tree) that is optimized and executed only whencollect()orcompute()is called. Set globally withoptions(cuplyr.exec_mode = "lazy")orCUPLYR_EXEC_MODE=lazyenvironment variable. -
Added an AST optimizer that applies multiple optimization passes before execution:
- Projection pruning: push column selection close to data sources
- Mutate fusion: combine consecutive mutate operations
- Dead column pruning: remove unused intermediate columns
- Filter pushdown: move filters earlier in the pipeline, including across joins
- Filter reordering: execute cheaper filters first
- Filter fusion: combine multiple filters into single GPU kernel
-
compute()executes pending lazy operations and keeps the result on GPU. -
collapse()inserts an optimization barrier without executing. -
as_lazy()andas_eager()switch execution modes mid-pipeline. -
is_lazy()andhas_pending_ops()check the current execution state. -
show_query()displays the pending operation tree for debugging.
Join operations
- Added
inner_join(),left_join(),right_join(), andfull_join()for combining GPU tables (#2). Joins support automatic key detection (natural join), named vectors inbyfor different key names,suffixfor column name conflicts,keepfor retaining join keys, andcopyto auto-transfer data frames to GPU.
Bind operations
- Added
bind_rows()for vertically combining GPU tables with automatic schema unification and type promotion. - Added
bind_cols()for horizontally combining GPU tables with.name_repairfor duplicate column handling. - Both bind functions automatically materialize lazy tables before binding.