Re: [Rd] R-4.3 version list.files function could not work correctly in chinese
Dear Yihui,
Thanks a lot for your help!
Unfortunately, I was not able to reproduce this. I've tried creating
files with Chinese characters in their names and populating them
with valid UTF-8 and valid non-UTF-8 text, but R seems to be able to
list them all in my case.
I'm running a US English evaluation ISO image of a slightly newer build
of Windows 10, and I also compiled R-4.3.1 from source, anticipating
having to single-step through the list.files() implementation:
sessionInfo()
# R version 4.3.1 (2023-06-16 ucrt)
# Platform: x86_64-w64-mingw32/x64 (64-bit)
# Running under: Windows 10 x64 (build 19045)
#
# Matrix products: default
#
#
# locale:
# [1] LC_COLLATE=English_United States.utf8 LC_CTYPE=English_United
# States.utf8
# [3] LC_MONETARY=English_United States.utf8 LC_NUMERIC=C
# [5] LC_TIME=English_United States.utf8
#
# time zone: America/Los_Angeles
# tzcode source: internal
#
# attached base packages:
# [1] stats graphics grDevices utils datasets methods base
#
# loaded via a namespace (and not attached):
# [1] compiler_4.3.1
dir("测试文件")
# [1] "测试中文-non-utf8-Ъ.txt" "测试中文-utf-8.txt"
system('cmd /c dir /s *.txt')
# Volume in drive C has no label.
# Volume Serial Number is A85A-AA74
#
# Directory of C:\R\R-4.3.1\bin\x64\
#
# 08/12/2023 07:57 AM22 -non-utf8-?.txt
# 08/12/2023 07:56 AM18 -utf-8.txt
#2 File(s) 40 bytes
#
# Total Files Listed:
#2 File(s) 40 bytes
#0 Dir(s) 29,538,418,688 bytes free
# [1] 0
(The OEM codepage cannot represent the characters I used in the file
names, but all the files are present in both lists.)
In order to find out what's wrong, it will be needed to download the R
source code and compile it [*], install gdb using pacman (part of
Rtools), then set a breakpoint on the list_files function from
src/main/platform.c and step through it [**], paying attention to the
R_readdir calls. Do the missing file names not even come out from
FindNextFile()? Are they somehow skipped around the time of regex match?
(I could help with the details of this, maybe off-list, if there's
interest.)
Unless Tomas Kalibera is able to deduce the root cause from the
observed symptoms, someone who can reproduce the problem will have to
investigate further.
--
Best regards,
Ivan
[*] https://cran.r-project.org/bin/windows/base/howto-R-devel.html
[**] https://beej.us/guide/bggdb/
__
R-devel@r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-devel
[Rd] a quick and dirty way to compile R on win arm64 using clangarm64
hello everyone: On this boring weekend, I tried compile R-trunk on windows 11 arm64 using clangarm64+msys2 on macbook m1 , it surprisingly easy to compiled and run. more investigation and test and code modify need to be done ,but IMO this is a good beginning !! to compile R on windows 11 arm64 just need : 1 svn checkout R-trunk and add USE_LLVM=YES in MKRules.dist or Mkrules.local 2 install msys2 and clangarm64 package mingw-w64-clang-aarch64-brotli 1.0.9-6 mingw-w64-clang-aarch64-bzip2 1.0.8-2 mingw-w64-clang-aarch64-c-ares 1.19.1-1 mingw-w64-clang-aarch64-ca-certificates 20230311-1 mingw-w64-clang-aarch64-clang 16.0.5-3 mingw-w64-clang-aarch64-compiler-rt 16.0.5-3 mingw-w64-clang-aarch64-crt-git 11.0.0.r107.gd367cc9d7-1 mingw-w64-clang-aarch64-curl 8.2.1-1 mingw-w64-clang-aarch64-expat 2.5.0-1 mingw-w64-clang-aarch64-flang 16.0.5-1 mingw-w64-clang-aarch64-gettext 0.21.1-2 mingw-w64-clang-aarch64-giflib 5.2.1-3 mingw-w64-clang-aarch64-gmp 6.3.0-1 mingw-w64-clang-aarch64-gnutls 3.8.0-1 mingw-w64-clang-aarch64-headers-git 11.0.0.r107.gd367cc9d7-1 mingw-w64-clang-aarch64-icu 73.2-1 mingw-w64-clang-aarch64-jbigkit 2.1-4 mingw-w64-clang-aarch64-lerc 4.0.0-1 mingw-w64-clang-aarch64-libc++ 16.0.5-1 mingw-w64-clang-aarch64-libdeflate 1.18-1 mingw-w64-clang-aarch64-libffi 3.4.4-1 mingw-w64-clang-aarch64-libgcrypt 1.10.2-1 mingw-w64-clang-aarch64-libgpg-error 1.47-2 mingw-w64-clang-aarch64-libiconv 1.17-3 mingw-w64-clang-aarch64-libidn2 2.3.4-1 mingw-w64-clang-aarch64-libjpeg-turbo 3.0.0-1 mingw-w64-clang-aarch64-libpng 1.6.40-1 mingw-w64-clang-aarch64-libpsl 0.21.2-4 mingw-w64-clang-aarch64-libssh2 1.11.0-1 mingw-w64-clang-aarch64-libtasn1 4.19.0-1 mingw-w64-clang-aarch64-libtiff 4.5.1-2 mingw-w64-clang-aarch64-libunistring 1.1-1 mingw-w64-clang-aarch64-libunwind 16.0.5-1 mingw-w64-clang-aarch64-libwebp 1.3.1-1 mingw-w64-clang-aarch64-libwinpthread-git 11.0.0.r107.gd367cc9d7-1 mingw-w64-clang-aarch64-libxml2 2.11.4-2 mingw-w64-clang-aarch64-lld 16.0.5-3 mingw-w64-clang-aarch64-llvm 16.0.5-3 mingw-w64-clang-aarch64-llvm-libs 16.0.5-3 mingw-w64-clang-aarch64-make 4.4-2 mingw-w64-clang-aarch64-mlir 16.0.5-1 mingw-w64-clang-aarch64-nettle 3.9.1-1 mingw-w64-clang-aarch64-nghttp2 1.55.1-1 mingw-w64-clang-aarch64-openblas 0.3.23-1 mingw-w64-clang-aarch64-openmp 16.0.5-1 mingw-w64-clang-aarch64-openssl 3.1.2-1 mingw-w64-clang-aarch64-p11-kit 0.25.0-1 mingw-w64-clang-aarch64-pcre2 10.42-1 mingw-w64-clang-aarch64-readline 8.2.001-6 mingw-w64-clang-aarch64-rtmpdump 2.4.r99.f1b83c1-1 mingw-w64-clang-aarch64-tcl 8.6.12-2 mingw-w64-clang-aarch64-termcap 1.3.1-6 mingw-w64-clang-aarch64-tk 8.6.12-2 mingw-w64-clang-aarch64-wineditline 2.206-1 mingw-w64-clang-aarch64-winpthreads-git 11.0.0.r107.gd367cc9d7-1 mingw-w64-clang-aarch64-xz 5.4.4-1 mingw-w64-clang-aarch64-zlib 1.2.13-3 mingw-w64-clang-aarch64-zstd 1.5.5-1 3 cd r/src/gnuwin32 make In next week, will try more mod for win11 arm64 Yu Gong [[alternative HTML version deleted]] __ R-devel@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-devel
Re: [Rd] a quick and dirty way to compile R on win arm64 using clangarm64
sorry forgot dynamic link ICU 1 svn checkout R-trunk and add USE_LLVM=YES and ICU_LIBS ?= -licuin -licuuc -licudt -lstdc++ in MKRules.dist or Mkrules.local From: R-devel on behalf of yu gong Sent: Sunday, August 13, 2023 11:14 To: r-devel@r-project.org Subject: [Rd] a quick and dirty way to compile R on win arm64 using clangarm64 hello everyone: On this boring weekend, I tried compile R-trunk on windows 11 arm64 using clangarm64+msys2 on macbook m1 , it surprisingly easy to compiled and run. more investigation and test and code modify need to be done ,but IMO this is a good beginning !! to compile R on windows 11 arm64 just need : 1 svn checkout R-trunk and add USE_LLVM=YES in MKRules.dist or Mkrules.local 2 install msys2 and clangarm64 package mingw-w64-clang-aarch64-brotli 1.0.9-6 mingw-w64-clang-aarch64-bzip2 1.0.8-2 mingw-w64-clang-aarch64-c-ares 1.19.1-1 mingw-w64-clang-aarch64-ca-certificates 20230311-1 mingw-w64-clang-aarch64-clang 16.0.5-3 mingw-w64-clang-aarch64-compiler-rt 16.0.5-3 mingw-w64-clang-aarch64-crt-git 11.0.0.r107.gd367cc9d7-1 mingw-w64-clang-aarch64-curl 8.2.1-1 mingw-w64-clang-aarch64-expat 2.5.0-1 mingw-w64-clang-aarch64-flang 16.0.5-1 mingw-w64-clang-aarch64-gettext 0.21.1-2 mingw-w64-clang-aarch64-giflib 5.2.1-3 mingw-w64-clang-aarch64-gmp 6.3.0-1 mingw-w64-clang-aarch64-gnutls 3.8.0-1 mingw-w64-clang-aarch64-headers-git 11.0.0.r107.gd367cc9d7-1 mingw-w64-clang-aarch64-icu 73.2-1 mingw-w64-clang-aarch64-jbigkit 2.1-4 mingw-w64-clang-aarch64-lerc 4.0.0-1 mingw-w64-clang-aarch64-libc++ 16.0.5-1 mingw-w64-clang-aarch64-libdeflate 1.18-1 mingw-w64-clang-aarch64-libffi 3.4.4-1 mingw-w64-clang-aarch64-libgcrypt 1.10.2-1 mingw-w64-clang-aarch64-libgpg-error 1.47-2 mingw-w64-clang-aarch64-libiconv 1.17-3 mingw-w64-clang-aarch64-libidn2 2.3.4-1 mingw-w64-clang-aarch64-libjpeg-turbo 3.0.0-1 mingw-w64-clang-aarch64-libpng 1.6.40-1 mingw-w64-clang-aarch64-libpsl 0.21.2-4 mingw-w64-clang-aarch64-libssh2 1.11.0-1 mingw-w64-clang-aarch64-libtasn1 4.19.0-1 mingw-w64-clang-aarch64-libtiff 4.5.1-2 mingw-w64-clang-aarch64-libunistring 1.1-1 mingw-w64-clang-aarch64-libunwind 16.0.5-1 mingw-w64-clang-aarch64-libwebp 1.3.1-1 mingw-w64-clang-aarch64-libwinpthread-git 11.0.0.r107.gd367cc9d7-1 mingw-w64-clang-aarch64-libxml2 2.11.4-2 mingw-w64-clang-aarch64-lld 16.0.5-3 mingw-w64-clang-aarch64-llvm 16.0.5-3 mingw-w64-clang-aarch64-llvm-libs 16.0.5-3 mingw-w64-clang-aarch64-make 4.4-2 mingw-w64-clang-aarch64-mlir 16.0.5-1 mingw-w64-clang-aarch64-nettle 3.9.1-1 mingw-w64-clang-aarch64-nghttp2 1.55.1-1 mingw-w64-clang-aarch64-openblas 0.3.23-1 mingw-w64-clang-aarch64-openmp 16.0.5-1 mingw-w64-clang-aarch64-openssl 3.1.2-1 mingw-w64-clang-aarch64-p11-kit 0.25.0-1 mingw-w64-clang-aarch64-pcre2 10.42-1 mingw-w64-clang-aarch64-readline 8.2.001-6 mingw-w64-clang-aarch64-rtmpdump 2.4.r99.f1b83c1-1 mingw-w64-clang-aarch64-tcl 8.6.12-2 mingw-w64-clang-aarch64-termcap 1.3.1-6 mingw-w64-clang-aarch64-tk 8.6.12-2 mingw-w64-clang-aarch64-wineditline 2.206-1 mingw-w64-clang-aarch64-winpthreads-git 11.0.0.r107.gd367cc9d7-1 mingw-w64-clang-aarch64-xz 5.4.4-1 mingw-w64-clang-aarch64-zlib 1.2.13-3 mingw-w64-clang-aarch64-zstd 1.5.5-1 3 cd r/src/gnuwin32 make In next week, will try more mod for win11 arm64 Yu Gong [[alternative HTML version deleted]] __ R-devel@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-devel [[alternative HTML version deleted]] __ R-devel@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-devel
