Re: solr slave configuration help

2008-06-03 Thread Gaku Mak
). It also seems like using the serialGC makes the server more responsive during the time of replication (registering new searcher) unless I'm missing something in the GC configuration. Thanks! -Gaku Yonik Seeley wrote: > > On Sun, Jun 1, 2008 at 5:20 AM, Gaku Mak <[EMAIL PRO

Lots of javax.xml.stream.XMLStreamException: ParseError errors before solr stopped responding

2008-06-01 Thread Gaku Mak
Hi all, I have 2 solr masters that are only doing indexing and no querying (index replicated to slave for searching). I noticed that the masters would occasionally give the "javax.xml.stream.XMLStreamException: ParseError" error and continued to work, until they started to give a lot of these and

solr slave configuration help

2008-06-01 Thread Gaku Mak
Hi solr devs/users, I'm setting up solr slave test server now (duo core with 2GB ram), and I'm running into some issues with replication. The index being replication is in the size of about 10G now, and the snappuller and snapinstaller are scheduled to run every 30 mins using crontab. Upon runn

Re: Solr indexing configuration help

2008-06-01 Thread Gaku Mak
ly need it, or change it to be > less agressive: autocommitting every 50 docs is bad if you are > rapidly adding documents. > - set maxWarmingSearchers to 1 to prevent the buildup of searchers > > -Yonik > > On Fri, May 30, 2008 at 3:39 PM, Gaku Mak <[EMAIL PROTECTED]> wrote: &

Re: Solr indexing configuration help

2008-05-30 Thread Gaku Mak
I started running the test on 2 other machines with similar specs but more RAM (4G). One of them now has about 60k docs and still running fine. On the other machine, solr died at about 43k docs. A short while before solr died, I saw that there were 5 searchers at the same time. Do any of you know

Re: Solr indexing configuration help

2008-05-29 Thread Gaku Mak
If you have another box around, try that. > > -Yonik > > On Thu, May 29, 2008 at 9:51 PM, Gaku Mak <[EMAIL PROTECTED]> wrote: >> >> Hi Yonik and others, >> >> I'm getting this java error after switching to JVM 1.6.0_3. This error >> occurs after t

Re: Solr indexing configuration help

2008-05-29 Thread Gaku Mak
# If you would like to submit a bug report, please visit: # http://java.sun.com/webapps/bugreport/crash.jsp # -Gaku Yonik Seeley wrote: > > On Wed, May 28, 2008 at 10:30 PM, Gaku Mak <[EMAIL PROTECTED]> wrote: >> I used the admin GUI to get the java info. >> java.

Re: Solr indexing configuration help

2008-05-28 Thread Gaku Mak
That's good to know, I will get the 1.6.0_3 version of JDK and try it out. Do you guys have any comments on my other questions? Any help is greatly appreciated!! Thanks! -Gaku Yonik Seeley wrote: > > On Wed, May 28, 2008 at 10:30 PM, Gaku Mak <[EMAIL PROTECTED]> wrote: &g

Re: Solr indexing configuration help

2008-05-28 Thread Gaku Mak
I used the admin GUI to get the java info. java.vm.specification.vendor = Sun Microsystems Inc. Any suggestion? Thanks a lot for your help!! -Gaku Yonik Seeley wrote: > > Not sure why you would be getting an OOM from just indexing, and with > the 1.5G heap you've given the JVM. > Have you tr