Re: [R-pkg-devel] How to decrease time to import files in xlsx format?

2022-10-04 Thread Jeff Newmiller
It looks like you are reading directly from URLs? How do you know the delay is not network I/O delay? Parallel computation is not a panacea. It allows tasks _that are CPU-bound_ to get through the CPU-intensive work faster. You need to be certain that your tasks actually can benefit from parall

Re: [R-pkg-devel] Guidance on splitting up an R package?

2022-10-04 Thread William Revelle
In 2019, I split psych into psych and psychTools to meet the 5MB space restriction. I moved several of vignettes, data sets, and a few helper functions over to psychTools. This mainly allowed for more vignettes but also allows me to add new data sets to psychTools without needing to recompile

Re: [R-pkg-devel] How to decrease time to import files in xlsx format?

2022-10-04 Thread Ivan Krylov
On Tue, 4 Oct 2022 15:29:54 -0300 Igor L wrote: > The problem is that importing files in xlsx format is time consuming. Do the openxlsx or XLConnect packages fare any better? > plan(strategy = future::multicore(workers = 4)) As far as I understand the documentation, multicore only works on POS

[R-pkg-devel] How to decrease time to import files in xlsx format?

2022-10-04 Thread Igor L
Hello all, I'm developing an R package that basically downloads, imports, cleans and merges nine files in xlsx format updated monthly from a public institution. The problem is that importing files in xlsx format is time consuming. My initial idea was to parallelize the execution of the read_xlsx

Re: [R-pkg-devel] Guidance on splitting up an R package?

2022-10-04 Thread Thierry Onkelinx
Dear Vincent, Have a look at the spatstat package which was split into several smaller packages (https://github.com/spatstat/spatstat). Maybe the maintainers of that package can share some insights. Best regards, ir. Thierry Onkelinx Statisticus / Statistician Vlaamse Overheid / Government of F

[R-pkg-devel] Guidance on splitting up an R package?

2022-10-04 Thread Vincent van Hees
Dear all, I am looking for guidance (blog posts / books / people with expertise) on how to split up an R package that has grown a lot in complexity and size. To make it worthwhile, the split needs to ease the maintenance and ongoing development. Here are my quick reflections on it: 1. Where possi

Re: [R-pkg-devel] NOTE checking for detritus in the temp directory on windows

2022-10-04 Thread etienne . come
Hi, Thanks a lot Henrik for your detailed response, the problem was the one you suspected a "plan(mutlisession)" that was not correctly closed. And following your advice I was able to reproduce it on winbuilder. So thanks again for your help! Best regards, Etienne Etienne Côme, @comeetie C