Re: solr blocking on commit

Are you using solr 4.0? We had some problems similar to this (not in a master/slave setup, though), where the resolution was to disable the transaction log, i.e. remove in the section - we don't need NRT get, so this isn't important to us. Cheers, /Martin Koch On Thu, Nov 1, 2012 at 1:25 AM, db

Re: solr blocking on commit

I second the original poster- all selects are blocked during commits. I have Master replicating to Slave. Indexing happens to Master, few docs/about every 30 secs Selects are run against Slave. This is the pattern from the Slave log: Oct 30, 2012 12:33:23 AM org.apache.solr.core.SolrDeletionPolic

Re: solr blocking on commit

Wait, wait, wait What about near-real-time? See: http://issues.apache.org/jira/browse/SOLR-1606 (Integrate near real time) I don't think this is production-ready yet, or if you're willing to run patched code, but it sure seems like you want to

Re: solr blocking on commit

Otis Gospodnetic wrote on 01/22/2010 12:20:45 AM: > I'm missing the bigger context of this thread here, but from the > snippet below - sure, commits cause in-memory index to get written > to disk, that causes some IO, and that *could* affect search *if* > queries are running on the same box. Wh

Re: solr blocking on commit

cally puts indexing and searching on different servers. Otis -- Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch - Original Message > From: Steve Conover > To: solr-user@lucene.apache.org > Sent: Thu, January 21, 2010 1:00:05 AM > Subject: Re: solr blocking on

Re: solr blocking on commit

> How solr organized so that search can continue when a commit has closed the > index? > Also, looking at lucene docs, commit causes a system fsync().  Won't search > also > get blocked by the IO traffic generated? ...I'll run iostat too and see if there's anything interesting to report

Re: solr blocking on commit

ysee...@gmail.com wrote on 01/20/2010 02:24:04 PM: > On Wed, Jan 20, 2010 at 2:18 PM, Jerome L Quinn wrote: > > This is essentially the same problem I'm fighting with.  Once in a while, > > commit > > causes everything to freeze, causing add commands to timeout. > > This could be a bit different.

Re: solr blocking on commit

ysee...@gmail.com wrote on 01/20/2010 02:24:04 PM: > On Wed, Jan 20, 2010 at 2:18 PM, Jerome L Quinn wrote: > > This is essentially the same problem I'm fighting with.  Once in a while, > > commit > > causes everything to freeze, causing add commands to timeout. > > This could be a bit different.

Re: solr blocking on commit

On Wed, Jan 20, 2010 at 2:18 PM, Jerome L Quinn wrote: > This is essentially the same problem I'm fighting with.  Once in a while, > commit > causes everything to freeze, causing add commands to timeout. This could be a bit different. Commits do currently block other update operations such as ad

Re: solr blocking on commit

ysee...@gmail.com wrote on 01/19/2010 06:05:45 PM: > On Tue, Jan 19, 2010 at 5:57 PM, Steve Conover wrote: > > I'm using latest solr 1.4 with java 1.6 on linux.  I have a 3M > > document index that's 10+GB.  We currently give solr 12GB of ram to > > play in and our machine has 32GB total. > > > >

Re: solr blocking on commit

A couple of follow up questions: - What type of garbage collector is in use? - How often are you optimizing the index? - In solrconfig.xml what is the setting for ? - Right before and after you see this pause, check the output of http://:/solr/admin/system, specifically the output of and send thi

Re: solr blocking on commit

I'll play with the GC settings and watch memory usage (I've done a little bit of this already), but I have a sense that this isn't the problem. I should also note that in order to create the really long pauses I need to post xml files full of documents that haven't been added in a long time / ever

Re: solr blocking on commit

On Tue, Jan 19, 2010 at 5:57 PM, Steve Conover wrote: > I'm using latest solr 1.4 with java 1.6 on linux.  I have a 3M > document index that's 10+GB.  We currently give solr 12GB of ram to > play in and our machine has 32GB total. > > We're seeing a problem where solr blocks during commit - it won