Re: [Rd] more powerful iconv

2010-06-20 Thread Matt Shotwell
Couple more thoughts about iconv, (1) The 'embedded nul' error is thrown by mkCharLenCE, after the real conversion is complete. The converted string exists in memory, though not in a form that R can currently represent as a STRSXP. Hence the error when passed to mkCharLenCE. (2) The patch I subm

[Rd] more powerful iconv

2010-06-19 Thread Matt Shotwell
R community, As you may know, R's iconv doesn't work well converting to and from encodings that allow embedded nulls. For example > iconv("foo", to="UTF-16") Error in iconv("foo", to = "UTF-16") : embedded nul in string: '\xff\xfef\0o\0o\0' However, I don't believe embedded nulls are at issue