encoding px_save .R - bug or feature?

[larpSTATGL]

I have this saved query, when saved to .R the nordic chars have been killed. the query returns a px file in ansi

x <- px("https://bank.stat.gl:443/sq/a0884286-8ce5-464e-8ccc-8f975ee6c151.px")

px_save(x,file.path("px","bedsta.R"))

[larpSTATGL]

it looks like px_save writes to ANSI

[larpSTATGL]

And my RStudio is default set to read and write .R as utf-8

[larpSTATGL]

wonder if there should be an encoding option to px_save? - change to feature request

[johan-ejstrud]

@larpSTATGL it's very clear what error you are experiencing.

I assume that

the nordic chars have been killed.

means that you end up with a PX-file that doesn't display æ, ø and å properly.

I cannot replicate this.

When I create and run the R script:

library(dplyr)
library(pxmake)

path <- 'test.R'
url <- "https://bank.stat.gl:443/sq/a0884286-8ce5-464e-8ccc-8f975ee6c151.px"

url %>% 
  px() %>% 
  px_save(path)

x <- source(path)$value

I get a px object which has Nordic characters:

> px_title(x)
# A tibble: 3 × 2
  language value                                                                      
  <chr>    <chr>                                                                      
1 en       Population January 1st by time, place of birth and gender                  
2 da       Befolkningen 1. januar efter tid, fødested og køn                          
3 kl       1. Januaarimi innuttaasut kingorna piffissaq, inunngorfik aamma suiaassuseq

Please let me know if you get something different.

Encoding

I'll try to explain a couple of things about the encoding to clear this up a bit.

You write:

wonder if there should be an encoding option to px_save? - change to feature request

There already is. 😁 Here are details from ?px_save:

and ?px_codepage:

In your example CODEPAGE is:

> px_codepage(x)
[1] "Windows-1252"

so if you save this px object as a PX-file it will be written in Windows-1252 encoding.

However, notice that this is the encoding of the PX-file not the encoding of the R-script.

When saving a px object as an R-script px_save uses the function writeLines, which writes the file in whatever encoding you system is set to. You can check this by running:

> Sys.getlocale("LC_CTYPE")
[1] "Danish_Denmark.utf8"

px_saves dokumentation should probably be updated to mention this.

[larpSTATGL]

The .R written with px_save creates an ANSI encoded text file

in RStudio my default text encoding is:

so when I load the .R into RStudio to edit - the nordic chars are gone

[johan-ejstrud]

@larpSTATGL thanks for the pictures. This is weird. Then I don't know what's going on. 🤔 I think I have to debug this "by hand". I'll send you a meeting invite.