Sparklyr rename fails with dev version of dplyr

[MZLABS]

Rename fails in Sparklyr, think it depends on verison of dplyr. Definitely seeing it in the dev version of dplyr as of 5-14-2017.

# devtools::install_github("tidyverse/dplyr")
# devtools::install_github('tidyverse/dbplyr')
suppressPackageStartupMessages(library('dplyr'))
packageVersion("dplyr")

## [1] '0.5.0.9004'

library('sparklyr')
packageVersion("sparklyr")

## [1] '0.5.4'

if(requireNamespace("dbplyr", quietly = TRUE)) {
  packageVersion("dbplyr")
}

## [1] '0.0.0.9001'

R.Version()$version.string

## [1] "R version 3.4.0 (2017-04-21)"

dLocal <- data.frame(x = 1:2,
                     origCol = c('a', 'b'),
                     stringsAsFactors = FALSE)

sc <- sparklyr::spark_connect(version='2.0.2', 
   master = "local")

d <- copy_to(sc, dLocal, 'd')

# works
rename(dLocal, x2 = x, origCol2 = origCol)

##   x2 origCol2
## 1  1        a
## 2  2        b

# throws
rename(d, x2 = x, origCol2 = origCol)

## Source:     lazy query [?? x 2]
## Database:   spark_connection

## Error in names(select)[match(old_vars, vars)] <- new_vars: NAs are not allowed in subscripted assignments

spark_disconnect(sc)
rm(list=ls())
gc(verbose = FALSE)

[hadley]

Please just file as a sparklyr issue.

[JohnMount]

Filed as sparklyr issue 678. Issue remains with 0.7.0 dplyr plus current (2017-06-09) dev sparklyr. (dbplyr changes depending which of sparklyr or dplyr is installed last.) Had file here to try and help package to package coordination.

suppressPackageStartupMessages(library('dplyr'))
packageVersion("dplyr")
#> [1] '0.7.0'
library('sparklyr')
packageVersion("sparklyr")
#> [1] '0.5.5.9002'
if(requireNamespace("dbplyr", quietly = TRUE)) {
  packageVersion("dbplyr")
}
#> [1] '0.0.0.9001'
R.Version()$version.string
#> [1] "R version 3.4.0 (2017-04-21)"

dLocal <- data.frame(x = 1:2,
                     origCol = c('a', 'b'),
                     stringsAsFactors = FALSE)

sc <- sparklyr::spark_connect(version='2.0.2', 
                              master = "local")

d <- copy_to(sc, dLocal, 'd')

# works
rename(dLocal, x2 = x, origCol2 = origCol)
#>   x2 origCol2
#> 1  1        a
#> 2  2        b

# throws
rename(d, x2 = x, origCol2 = origCol)
#> Error in names(select)[match(old_vars, vars)] <- new_vars: NAs are not allowed in subscripted assignments

[JohnMount]

Looks related to dplyr 2860.