Re: 'out of memory' errors

2006-05-01 Thread tom arnall
On Monday 01 May 2006 06:13 am, Linas ?virblis wrote: > tom arnall wrote: > >> What about streams then? > > > > please tell me how that would work? i'm not familiar with the mechanism. > > You could open a file as a stream (or a buffer, it is the same thing), > read it in chunks of reasonable lengt

Re: 'out of memory' errors

2006-05-01 Thread Linas Žvirblis
tom arnall wrote: >> What about streams then? > > please tell me how that would work? i'm not familiar with the mechanism. You could open a file as a stream (or a buffer, it is the same thing), read it in chunks of reasonable length (maximum length you expect the longest regex match would span),

Re: 'out of memory' errors

2006-04-30 Thread tom arnall
On Sunday 30 April 2006 04:41 pm, Linas ?virblis wrote: > tom arnall wrote: > > Understood, but I am doing a regex on text units which span more than one > > line. Trying to process this text w' line-by-line io would be possible > > but, as far as I can see, very awkward. > > What about streams the

Re: 'out of memory' errors

2006-04-30 Thread Linas Žvirblis
tom arnall wrote: > Understood, but I am doing a regex on text units which span more than one > line. Trying to process this text w' line-by-line io would be possible but, > as far as I can see, very awkward. What about streams then? > Looking at 'top' and the 'MEM%' column, it seems to me tha

Re: 'out of memory' errors

2006-04-30 Thread tom arnall
On Saturday 29 April 2006 04:22 pm, Linas ?virblis wrote: > tom arnall wrote: > > I am trying to us a perl application that handles large files (.5GB) in > > scalar variables. When I try to 'slurp' one of these files into a > > variable (e.g., '$_ = `cat filename`) I get an out of memory error. >

Re: 'out of memory' errors

2006-04-29 Thread Linas Žvirblis
tom arnall wrote: > i am trying to us a perl application that handles large files (.5GB) in > scalar > variables. when i try to 'slurp' one of these files into a variable > (e.g., '$_ = `cat filename`) i get an out of memory error. You should consider alternative solutions, like processing f

'out of memory' errors

2006-04-29 Thread tom arnall
as 768000 now, tho' i get 'out of memory' errors. is there not some way to get linux to use swap space when physical memory is exceeded? thanks, tom arnall north spit, ca -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]