Re: cannot allocate memory for snapshooter

2009-01-07 Thread Mark Miller
Brian Whitman wrote: On Sun, Jan 4, 2009 at 9:47 PM, Mark Miller wrote: Hey Brian, I didn't catch what OS you are using on EC2 by the way. I thought most UNIX OS's were using memory overcommit - A quick search brings up Linux, AIX, and HP-UX, and maybe even OSX? What are you running over t

Re: cannot allocate memory for snapshooter

2009-01-05 Thread Brian Whitman
On Sun, Jan 4, 2009 at 9:47 PM, Mark Miller wrote: > Hey Brian, I didn't catch what OS you are using on EC2 by the way. I > thought most UNIX OS's were using memory overcommit - A quick search brings > up Linux, AIX, and HP-UX, and maybe even OSX? > > What are you running over there? EC2, so Linu

Re: cannot allocate memory for snapshooter

2009-01-04 Thread Mark Miller
Hey Brian, I didn't catch what OS you are using on EC2 by the way. I thought most UNIX OS's were using memory overcommit - A quick search brings up Linux, AIX, and HP-UX, and maybe even OSX? What are you running over there? EC2, so Linux I assume? Yonik: I take it, now that Linux uses copy on

Re: cannot allocate memory for snapshooter

2009-01-04 Thread Mark Miller
Yonik Seeley wrote: On Sun, Jan 4, 2009 at 8:07 PM, Mark Miller wrote: Forking for a small script on something that can have such a large memory footprint is just a huge waste of resources. Ideally you might have a tiny program running, listening on a socket or something, and it can be alert

Re: cannot allocate memory for snapshooter

2009-01-04 Thread Yonik Seeley
On Sun, Jan 4, 2009 at 8:07 PM, Mark Miller wrote: > Forking for a small script on something that can have such a large memory > footprint is just a huge waste of resources. Ideally you might have a tiny > program running, listening on a socket or something, and it can be alerted > and do the actu

Re: cannot allocate memory for snapshooter

2009-01-04 Thread Mark Miller
Your right, its nasty, but its how Fork works. I would say its something that should be fixed, its so nasty, but with the new all Java replication, its probably a moot point. Forking for a small script on something that can have such a large memory footprint is just a huge waste of resources.

Re: cannot allocate memory for snapshooter

2009-01-02 Thread Otis Gospodnetic
gt; Subject: Re: cannot allocate memory for snapshooter > > Thanks for the pointer. (It seems really weird to alloc 5GB of swap just > because the JVM needs to run a shell script.. but I get hoss's explanation > in the following post) > > On Fri, Jan 2, 2009 at 2:37

Re: cannot allocate memory for snapshooter

2009-01-02 Thread Brian Whitman
Thanks for the pointer. (It seems really weird to alloc 5GB of swap just because the JVM needs to run a shell script.. but I get hoss's explanation in the following post) On Fri, Jan 2, 2009 at 2:37 PM, Bill Au wrote: > add more swap space: > http://www.nabble.com/Not-enough-space-to11423199.htm

Re: cannot allocate memory for snapshooter

2009-01-02 Thread Otis Gospodnetic
: solr-user@lucene.apache.org > Sent: Friday, January 2, 2009 10:52:59 AM > Subject: cannot allocate memory for snapshooter > > I have an indexing machine on a test server (a mid-level EC2 instance, 8GB > of RAM) and I run jetty like: > > java -server -Xms5g -

Re: cannot allocate memory for snapshooter

2009-01-02 Thread Bill Au
add more swap space: http://www.nabble.com/Not-enough-space-to11423199.html#a11424938 Bill On Fri, Jan 2, 2009 at 10:52 AM, Brian Whitman wrote: > I have an indexing machine on a test server (a mid-level EC2 instance, 8GB > of RAM) and I run jetty like: > > java -server -Xms5g -Xmx5g -XX:MaxPer

cannot allocate memory for snapshooter

2009-01-02 Thread Brian Whitman
I have an indexing machine on a test server (a mid-level EC2 instance, 8GB of RAM) and I run jetty like: java -server -Xms5g -Xmx5g -XX:MaxPermSize=128m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/heap -Dsolr.solr.home=/vol/solr -Djava.awt.headless=true -jar start.jar The indexing maste