across() does not work for formula interface

[lorenzwalthert]

Similar to #518, but specifically related to the formula interface. With the devel version of dbplyr and the CRAN version of dplyr.

library(dplyr)
#> Warning: package 'dplyr' was built under R version 4.0.2
#> 
#> Attaching package: 'dplyr'
#> The following objects are masked from 'package:stats':
#> 
#>     filter, lag
#> The following objects are masked from 'package:base':
#> 
#>     intersect, setdiff, setequal, union
# works
iris %>% 
  dbplyr::memdb_frame() %>%
  mutate(across(matches("Sepal"), log)) %>%
  invisible()

# does not work
iris %>% 
  dbplyr::memdb_frame() %>%
  mutate(across(matches("Sepal"), ~log(.x)))
#> Error: Unsupported `.fns` for dbplyr::across()

iris %>% 
  dbplyr::memdb_frame() %>%
  mutate(across(matches("Sepal"), ~log(.)))
#> Error: Unsupported `.fns` for dbplyr::across()


# these all work in-memory 
iris %>% 
  # dbplyr::memdb_frame() %>%
  mutate(across(matches("Sepal"), ~log(.))) %>%
  invisible()

iris %>% 
  # dbplyr::memdb_frame() %>%
  mutate(across(matches("Sepal"), ~log(.x))) %>%
  invisible()

^{Created on 2020-10-21 by the reprex package (v0.3.0)}

Session info

devtools::session_info()
#> ─ Session info ───────────────────────────────────────────────────────────────
#>  setting  value                       
#>  version  R version 4.0.0 (2020-04-24)
#>  os       macOS Catalina 10.15.6      
#>  system   x86_64, darwin17.0          
#>  ui       X11                         
#>  language (EN)                        
#>  collate  en_US.UTF-8                 
#>  ctype    en_US.UTF-8                 
#>  tz       Europe/Zurich               
#>  date     2020-10-21                  
#> 
#> ─ Packages ───────────────────────────────────────────────────────────────────
#>  package     * version     date       lib source                             
#>  assertthat    0.2.1       2019-03-21 [1] CRAN (R 4.0.0)                     
#>  backports     1.1.10      2020-09-15 [1] CRAN (R 4.0.2)                     
#>  bit           1.1-15.2    2020-02-10 [1] CRAN (R 4.0.0)                     
#>  bit64         0.9-7       2017-05-08 [1] CRAN (R 4.0.0)                     
#>  blob          1.2.1       2020-01-20 [1] CRAN (R 4.0.0)                     
#>  callr         3.5.0       2020-10-08 [1] CRAN (R 4.0.0)                     
#>  cli           2.1.0       2020-10-12 [1] CRAN (R 4.0.2)                     
#>  crayon        1.3.4       2017-09-16 [1] CRAN (R 4.0.0)                     
#>  DBI           1.1.0       2019-12-15 [1] CRAN (R 4.0.0)                     
#>  dbplyr        1.99.0.9000 2020-10-21 [1] Github (tidyverse/dbplyr@8e63f33)  
#>  desc          1.2.0       2018-05-01 [1] CRAN (R 4.0.0)                     
#>  devtools      2.3.2       2020-09-18 [1] CRAN (R 4.0.2)                     
#>  digest        0.6.25      2020-02-23 [1] CRAN (R 4.0.2)                     
#>  dplyr       * 1.0.2       2020-08-18 [1] CRAN (R 4.0.2)                     
#>  ellipsis      0.3.1       2020-05-15 [1] CRAN (R 4.0.0)                     
#>  evaluate      0.14        2019-05-28 [1] CRAN (R 4.0.0)                     
#>  fansi         0.4.1       2020-01-08 [1] CRAN (R 4.0.0)                     
#>  fs            1.5.0       2020-07-31 [1] CRAN (R 4.0.2)                     
#>  generics      0.0.2       2018-11-29 [1] CRAN (R 4.0.0)                     
#>  glue          1.4.2       2020-08-27 [1] CRAN (R 4.0.2)                     
#>  highr         0.8         2019-03-20 [1] CRAN (R 4.0.0)                     
#>  htmltools     0.5.0       2020-06-16 [1] CRAN (R 4.0.0)                     
#>  knitr         1.30        2020-09-22 [1] CRAN (R 4.0.2)                     
#>  lifecycle     0.2.0       2020-03-06 [1] CRAN (R 4.0.0)                     
#>  magrittr    * 1.5.0.9000  2020-09-28 [1] Github (tidyverse/magrittr@0221e18)
#>  memoise       1.1.0       2017-04-21 [1] CRAN (R 4.0.0)                     
#>  pillar        1.4.6       2020-07-10 [1] CRAN (R 4.0.0)                     
#>  pkgbuild      1.1.0       2020-07-13 [1] CRAN (R 4.0.2)                     
#>  pkgconfig     2.0.3       2019-09-22 [1] CRAN (R 4.0.0)                     
#>  pkgload       1.1.0       2020-05-29 [1] CRAN (R 4.0.0)                     
#>  prettyunits   1.1.1       2020-01-24 [1] CRAN (R 4.0.0)                     
#>  processx      3.4.4       2020-09-03 [1] CRAN (R 4.0.2)                     
#>  ps            1.4.0       2020-10-07 [1] CRAN (R 4.0.2)                     
#>  purrr         0.3.4       2020-04-17 [1] CRAN (R 4.0.0)                     
#>  R6            2.4.1       2019-11-12 [1] CRAN (R 4.0.0)                     
#>  Rcpp          1.0.5       2020-07-06 [1] CRAN (R 4.0.0)                     
#>  remotes       2.2.0       2020-07-21 [1] CRAN (R 4.0.2)                     
#>  rlang         0.4.8       2020-10-08 [1] CRAN (R 4.0.2)                     
#>  rmarkdown     2.3         2020-06-18 [1] CRAN (R 4.0.2)                     
#>  rprojroot     1.3.2.9000  2020-10-18 [1] local                              
#>  RSQLite       2.2.0       2020-01-07 [1] CRAN (R 4.0.0)                     
#>  sessioninfo   1.1.1       2018-11-05 [1] CRAN (R 4.0.0)                     
#>  stringi       1.5.3       2020-09-09 [1] CRAN (R 4.0.2)                     
#>  stringr       1.4.0       2019-02-10 [1] CRAN (R 4.0.0)                     
#>  testthat      2.3.2       2020-03-02 [1] CRAN (R 4.0.0)                     
#>  tibble        3.0.4       2020-10-12 [1] CRAN (R 4.0.2)                     
#>  tidyselect    1.1.0       2020-05-11 [1] CRAN (R 4.0.0)                     
#>  usethis     * 1.6.3       2020-09-17 [1] CRAN (R 4.0.2)                     
#>  vctrs         0.3.4       2020-08-29 [1] CRAN (R 4.0.2)                     
#>  withr         2.3.0       2020-09-22 [1] CRAN (R 4.0.2)                     
#>  xfun          0.18        2020-09-29 [1] CRAN (R 4.0.2)                     
#>  yaml          2.2.1       2020-02-01 [1] CRAN (R 4.0.0)                     
#> 
#> [1] /Library/Frameworks/R.framework/Versions/4.0/Resources/library

[nviets]

Are the following examples related? All work locally, but not with a spark connection:

mtcars_c <- copy_to(cn, mtcars, "mtcars", overwrite = T)

mtcars_c %>% 
  summarise(across(c(mpg, cyl), min))
# # Source: spark<?> [?? x 2]
#     mpg   cyl
#   <dbl> <dbl>
# 1  10.4     4

mtcars_c %>% 
  summarise(across(where(is.numeric), ~min(.x, na.rm = TRUE)))
# Error: Can't rename variables in this context.
# Run `rlang::last_error()` to see where the error occurred.

min_max <- list(
  add1 = ~.x+1, 
  add2 = ~.x+2
)

mtcars_c %>% 
  summarise(across(c(mpg, cyl), min_max))
# Error: Result 1 must be a single string, not NULL of length 0
# Run `rlang::last_error()` to see where the error occurred.

mtcars_c %>% 
  summarise(across(c(mpg, cyl), list(
  add1 = ~.x+1, 
  add2 = ~.x+2
)))
# Error: Result 1 must be a single string, not NULL of length 0
# Run `rlang::last_error()` to see where the error occurred.

Here's the session info:

> sessionInfo()
R version 3.5.3 (2019-03-11)
Platform: x86_64-pc-linux-gnu (64-bit)
Running under: Red Hat Enterprise Linux

Matrix products: default
BLAS: /opt/revr/ropen/3.5.3/lib64/R/lib/libRblas.so
LAPACK: /opt/revr/ropen/3.5.3/lib64/R/lib/libRlapack.so

locale:
 [1] LC_CTYPE=en_US.UTF-8       LC_NUMERIC=C               LC_TIME=en_US.UTF-8        LC_COLLATE=en_US.UTF-8    
 [5] LC_MONETARY=en_US.UTF-8    LC_MESSAGES=en_US.UTF-8    LC_PAPER=en_US.UTF-8       LC_NAME=C                 
 [9] LC_ADDRESS=C               LC_TELEPHONE=C             LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C       

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
 [1] DBI_1.1.0            sparklyr_1.5.2       forcats_0.5.0        stringr_1.4.0        dplyr_1.0.2         
 [6] purrr_0.3.4          readr_1.4.0          tidyr_1.1.2          tibble_3.0.4         ggplot2_3.3.2       
[11] tidyverse_1.3.0      dbplyr_2.0.0         RevoUtilsMath_11.0.0

loaded via a namespace (and not attached):
 [1] Rcpp_1.0.5        lubridate_1.7.9.2 forge_0.2.0       utf8_1.1.4        assertthat_0.2.1  rprojroot_2.0.2  
 [7] digest_0.6.27     R6_2.5.0          cellranger_1.1.0  backports_1.2.1   reprex_0.3.0      evaluate_0.14    
[13] httr_1.4.2        pillar_1.4.7      rlang_0.4.8       readxl_1.3.1      rstudioapi_0.13   blob_1.2.1       
[19] rmarkdown_2.5     config_0.3        RevoUtils_11.0.3  r2d3_0.2.3        htmlwidgets_1.5.3 munsell_0.5.0    
[25] broom_0.7.2       compiler_3.5.3    modelr_0.1.8      xfun_0.19         askpass_1.1       pkgconfig_2.0.3  
[31] base64enc_0.1-3   htmltools_0.5.0   openssl_1.4.3     downlit_0.2.1     tidyselect_1.1.0  fansi_0.4.1      
[37] crayon_1.3.4      withr_2.3.0       later_1.1.0.1     grid_3.5.3        jsonlite_1.7.2    gtable_0.3.0     
[43] lifecycle_0.2.0   magrittr_2.0.1    scales_1.1.1      cli_2.2.0         stringi_1.5.3     fs_1.5.0         
[49] xml2_1.3.2        ellipsis_0.3.1    generics_0.1.0    vctrs_0.3.5       distill_1.0       tools_3.5.3      
[55] glue_1.4.2        hms_0.5.3         parallel_3.5.3    yaml_2.2.1        colorspace_2.0-0  rvest_0.3.6      
[61] knitr_1.30        haven_2.3.1 

[hadley]

@nviets please file spark related issues in https://github.com/sparklyr/sparklyr

[hadley]

Somewhat more minimal reprex:

library(dbplyr)
library(dplyr, warn.conflicts = FALSE)

db <- memdb_frame(x = 1:5, y = 1:5)
db %>% mutate(across(everything(), ~log(.x)))
#> Error: Unsupported `.fns` for dbplyr::across()

^{Created on 2021-01-21 by the reprex package (v0.3.0.9001)}

[nviets]

I have the same issue with dbplyr:

tibble(x = 1:5, y = 1:5) %>% 
  summarise(across(where(is.numeric), ~min(.x, na.rm = TRUE)))
# A tibble: 1 x 2
#       x     y
#   <int> <int>
#  1     1     1

db <- memdb_frame(x = 1:5, y = 1:5)
db %>% summarise(across(where(is.numeric), ~min(.x, na.rm = TRUE)))
# Error: Can't rename variables in this context.
# Run `rlang::last_error()` to see where the error occurred.