SAV import fails to import umlauts in labels

[sjPlot]

When having ä, ö or ü in variable labels, these are not imported correctly.

[hadley]

Could you please attach a minimal example

[sjPlot]

Here's an example:

library(haven)

# umlaut-test
mydf <- read_sav("umlauts.sav")
str(mydf)

# > str(mydf)
# Classes ‘tbl_df’, ‘tbl’ and 'data.frame': 4 obs. of  1 variable:
#   $ var1:Class 'labelled'  atomic [1:4] 1 2 1 3
# .. ..- attr(*, "label")= chr "This is an ä-umlaut"
# .. ..- attr(*, "labels")= Named int [1:3] 1 2 3
# .. .. ..- attr(*, "names")= chr [1:3] "the ä umlaut" "the ü umlaut" "the ö umlaut"

library(sjPlot)
# my read_spss function is a wrapper for read.spss
# of the foreign-package. read_spss only available
# in current development snaphot at github.com/sjPlot/devel
mydf <- read_spss("umlauts.sav")
str(mydf)

# > str(mydf)
# 'data.frame': 4 obs. of  1 variable:
#   $ var1: atomic  1 2 1 3
# ..- attr(*, "value.labels")= Named num  3 2 1
# .. ..- attr(*, "names")= chr  "the ö umlaut" "the ü umlaut" "the ä umlaut"
# - attr(*, "variable.labels")= Named chr "This is an ä-umlaut"
# ..- attr(*, "names")= chr "var1"
# - attr(*, "codepage")= int 65001

# changing the encoding helps
mydf <- read_spss("umlauts.sav", enc = "UTF-8")
str(mydf)

# > str(mydf)
# 'data.frame': 4 obs. of  1 variable:
#   $ var1: atomic  1 2 1 3
# ..- attr(*, "value.labels")= Named chr  "3" "2" "1"
# .. ..- attr(*, "names")= chr  "the ö umlaut" "the ü umlaut" "the ä umlaut"
# - attr(*, "variable.labels")= Named chr "This is an ä-umlaut"
# ..- attr(*, "names")= chr "var1"
# - attr(*, "codepage")= int 65001

[evanmiller]

Can you attach the umlauts.sav file itself?

[hadley]

@evanmiller it's possible this is a bug on my end - can I assume readstat_string_value() is always UTF-8?

[evanmiller]

Yes, it should always return UTF-8.

[hadley]

@sjPlot can you please try again with the latest version? I pushed a possible fix

[hadley]

Oh hmm, I only fixed it in one place (variable values) - I'll need to think a bit more to fix the labels.

[sjPlot]

I don't know how to attach sav-files, but I just sent them to Hadley.