Re: [R] readBin fails to read large files

2011-09-01 Thread Matt Shotwell
On Thu, 2011-09-01 at 17:36 +0100, Prof Brian Ripley wrote: > readBin is intended to read a few items at a time, not 10^9. You are > probably getting 32-bit integer overflow inside your OS, since the > number of bytes you are trying to read in one go exceeds 2GB. > > Don't do that: read say a m

Re: [R] readBin fails to read large files

2011-09-01 Thread Prof Brian Ripley
On Thu, 1 Sep 2011, Prof Brian Ripley wrote: readBin is intended to read a few items at a time, not 10^9. You are probably getting 32-bit integer overflow inside your OS, since the number of bytes you are trying to read in one go exceeds 2GB. Don't do that: read say a million at time. And B

Re: [R] readBin fails to read large files

2011-09-01 Thread Prof Brian Ripley
readBin is intended to read a few items at a time, not 10^9. You are probably getting 32-bit integer overflow inside your OS, since the number of bytes you are trying to read in one go exceeds 2GB. Don't do that: read say a million at time. And BTW, if these really are unsigned ints you will

Re: [R] readBin fails to read large files

2011-09-01 Thread Geier, Florian
Hi Jim, yes - it definitely is 64 bit. I call it with r64 and .Platform$r_arch [1] "x86_64" It is on a apple snow leopard (10.6.8) with 16 GB of Ram - not windows Florian On 1 Sep 2011, at 16:22, jim holtman wrote: > Are you running a 64-bit version of R? It sounds like your operating > sy

Re: [R] readBin fails to read large files

2011-09-01 Thread Geier, Florian
it's me, Florian (just subscribed to R list, but my messages are still held for approval ) fail means: It executes without an error, allocates the specified length (n=) as zeroes, but does not actually read any data in. florian On 1 Sep 2011, at 16:30, Duncan Murdoch wrote: On 01/09/2011 11:

Re: [R] readBin fails to read large files

2011-09-01 Thread Duncan Murdoch
On 01/09/2011 11:13 AM, Benton, Paul wrote: Posting for a friend What does "fails" mean, i.e. what is the error message? (You might want to get Florian online here.) Duncan Murdoch Begin forwarded message: From: "Geier, Florian"mailto:florian.geie...@imperial.ac.uk>> Subject: Fwd: read

Re: [R] readBin fails to read large files

2011-09-01 Thread jim holtman
Are you running a 64-bit version of R? It sounds like your operating system is not giving you enough memory. It looks like this is not under Windows in a native mode. On Thu, Sep 1, 2011 at 11:13 AM, Benton, Paul wrote: > Posting for a friend > > Begin forwarded message: > > From: "Geier, Flori

[R] readBin fails to read large files

2011-09-01 Thread Benton, Paul
Posting for a friend Begin forwarded message: From: "Geier, Florian" mailto:florian.geie...@imperial.ac.uk>> Subject: Fwd: readBin fails to read large files Date: September 1, 2011 4:10:53 PM GMT+01:00 To: Begin forwarded message: Date: 1 September 2011 16:01:45 GMT+01:00 Subject: readBin fa