Re: Auto commit Error - Solr Cloud 6.6.0 with HDFS

2017-07-14 Thread Joe Obernberger
Hi Shawn - had a shard go down (appears to have just dropped out of the cluster) with a similar error: 2017-07-14 20:43:04.238 ERROR (commitScheduler-65-thread-1) [c:UNCLASS s:shard87 r:core_node132 x:UNCLASS_shard87_replica1] o.a.s.u.CommitTracker auto commit error

Re: Auto commit Error - Solr Cloud 6.6.0 with HDFS

2017-07-12 Thread Joe Obernberger
Thank you Shawn - we have some WARN messages like : DFSClient Slow waitForAckedSeqno took 31066ms (threshold=3ms) and DFSClient Slow ReadProcessor read fields took 30737ms (threshold=3ms); ack: seqno: 1 reply: SUCCESS reply: SUCCESS reply: SUCCESS downstreamAckTimeNanos: 30735948057,​

Re: Auto commit Error - Solr Cloud 6.6.0 with HDFS

2017-07-12 Thread Shawn Heisey
On 7/12/2017 7:14 AM, Joe Obernberger wrote: > Started up a 6.6.0 solr cloud instance running on 45 machines > yesterday using HDFS (managed schema in zookeeper) and began > indexing. This error occurred on several of the nodes: > Caused by: org.apache.solr.common.SolrException: openNewSearcher >

Auto commit Error - Solr Cloud 6.6.0 with HDFS

2017-07-12 Thread Joe Obernberger
Started up a 6.6.0 solr cloud instance running on 45 machines yesterday using HDFS (managed schema in zookeeper) and began indexing. This error occurred on several of the nodes: auto commit error...:org.apache.solr.common.SolrException: Error opening new searcher at

Re: Commit Error

2015-10-28 Thread Rallavagu
On 10/28/15 5:41 PM, Shawn Heisey wrote: On 10/28/2015 5:11 PM, Rallavagu wrote: Seeing very high CPU during this time and very high warmup times. During this time, there were plenty of these errors logged. So, trying to find out possible causes for this to occur. Could it be disk I/O issues o

Re: Commit Error

2015-10-28 Thread Shawn Heisey
On 10/28/2015 5:11 PM, Rallavagu wrote: > Seeing very high CPU during this time and very high warmup times. During > this time, there were plenty of these errors logged. So, trying to find > out possible causes for this to occur. Could it be disk I/O issues or > something else as it is related to c

Re: Commit Error

2015-10-28 Thread Rallavagu
org.apache.solr.update.CommitTracker – auto commit error...:java.lang.IllegalStateException: this writer hit an OutOfMemoryError; cannot commit at org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2807) at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2984) at

Re: Commit Error

2015-10-28 Thread Rallavagu
(writing to disk). On 10/28/15 3:57 PM, Shawn Heisey wrote: On 10/28/2015 2:06 PM, Rallavagu wrote: Solr 4.6.1, cloud Seeing following commit errors. [commitScheduler-19-thread-1] ERROR org.apache.solr.update.CommitTracker – auto commit error...:java.lang.IllegalStateException: this writer hit an

Re: Commit Error

2015-10-28 Thread Shawn Heisey
On 10/28/2015 2:06 PM, Rallavagu wrote: > Solr 4.6.1, cloud > > Seeing following commit errors. > > [commitScheduler-19-thread-1] ERROR > org.apache.solr.update.CommitTracker – auto commit > error...:java.lang.IllegalStateException: this writer hit an > OutOfMemor

Commit Error

2015-10-28 Thread Rallavagu
Solr 4.6.1, cloud Seeing following commit errors. [commitScheduler-19-thread-1] ERROR org.apache.solr.update.CommitTracker – auto commit error...:java.lang.IllegalStateException: this writer hit an OutOfMemoryError; cannot commit at org.apache.lucene.index.IndexWriter.prepareCommitInternal

ERROR CommitTracker auto commit error...:org.apache.solr.common.SolrException: Error opening new searcher

2014-10-10 Thread Mou
I am using Solr cloud 4.10.0 and I have been seeing this for a while now. Does anyone has similar experience or clue what's happening ? auto commit error...:org.apache.solr.common.SolrException: Error opening new searcher at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java

auto commit error...:java.lang.ArrayIndexOutOfBoundsException

2013-09-26 Thread Tor Egil
,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 2013-09-26T06:47:09 ERROR (o.a.solr.update.CommitTracker:119) - auto commit error...:java.lang.ArrayIndexOutOfBoundsException: -20463 at org.apache.lucene.index.ByteSliceReader.init(ByteSliceReader.java:54

Re: ERROR org.apache.solr.update.CommitTracker – auto commit error...:org.apache.solr.common.SolrException: Error opening new searcher

2013-08-27 Thread zhaoxin
Thanks, Shawn ! it's ok now -- View this message in context: http://lucene.472066.n3.nabble.com/ERROR-org-apache-solr-update-CommitTracker-auto-commit-error-org-apache-solr-common-SolrException-Err-tp4086576p4086763.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: ERROR org.apache.solr.update.CommitTracker – auto commit error...:org.apache.solr.common.SolrException: Error opening new searcher

2013-08-26 Thread Shawn Heisey
On 8/26/2013 1:54 AM, zhaoxin wrote: > Caused by: java.lang.ClassCastException Generally when you get this kind of error with Solr, it means you have a mix of old and new jars. This might be from an upgrade, where either the old war expansion doesn't get removed, or from unnecessarily including j

ERROR org.apache.solr.update.CommitTracker – auto commit error...:org.apache.solr.common.SolrException: Error opening new searcher

2013-08-26 Thread zhaoxin
470665 [commitScheduler-14-thread-1] ERROR org.apache.solr.update.CommitTracker – auto commit error...:org.apache.solr.common.SolrException: Error opening new searcher at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1522) at org.apache.solr.core.SolrCore.getSearcher

Re: Commit error

2009-11-11 Thread Licinio Fernández Maurelo
Thanks Israel, i've done a sucesfull import using optimize=false 2009/11/11 Israel Ekpo > 2009/11/11 Licinio Fernández Maurelo > > > Hi folks, > > > > i'm getting this error while committing after a dataimport of only 12 > docs > > !!! > > > > Exception while solr commit. > > java.io.IOExceptio

Re: Commit error

2009-11-11 Thread Israel Ekpo
2009/11/11 Licinio Fernández Maurelo > Hi folks, > > i'm getting this error while committing after a dataimport of only 12 docs > !!! > > Exception while solr commit. > java.io.IOException: background merge hit exception: _3kta:C2329239 > _3ktb:c11->_3ktb into _3ktc [optimize] [mergeDocStores] >

Commit error

2009-11-11 Thread Licinio Fernández Maurelo
Hi folks, i'm getting this error while committing after a dataimport of only 12 docs !!! Exception while solr commit. java.io.IOException: background merge hit exception: _3kta:C2329239 _3ktb:c11->_3ktb into _3ktc [optimize] [mergeDocStores] at org.apache.lucene.index.IndexWriter.optimize(IndexWr

Re: commit error which kill my dataimport.properties file

2009-02-13 Thread sunnyfr
apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:151) > at > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:874) > at > org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665) > at > org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528) > at > org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81) > at > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689) > at java.lang.Thread.run(Thread.java:619) ) that prevented it from > fulfilling this request.Apache > Tomcat/5.5 > > > -- View this message in context: http://www.nabble.com/commit-error--which-kill-my-dataimport.properties-file-tp21992642p21992774.html Sent from the Solr - User mailing list archive at Nabble.com.

commit error which kill my dataimport.properties file

2009-02-13 Thread sunnyfr
erThread.java:81) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689) at java.lang.Thread.run(Thread.java:619) ) that prevented it from fulfilling this request.Apache Tomcat/5.5 -- View this message in context: http://www.nabble.com/commit-erro

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-29 Thread Chris Hostetter
: I get these NullPointException records every once and a while, always : from SolrCore and SolrDispatchFilter. Don't get a stack trace, and no : nearby errors seem to clarify what might have happened. that's really strange ... i'm not sure what's causing those, or why you aren't seeing a stack

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-28 Thread Chris Harris
Well I've done two or three more runs with Sun java build 1.6.0_10-rc-b28, with and without the infoStream change, and I can't reproduce the problem. So maybe everything was indeed the fault of the release version of Sun hotspot. Not too confident about that. Maybe instead I let the disk get too fu

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-21 Thread Michael McCandless
OK indeed that revision of Lucene is before the workaround for that nasty JRE bug was committed. Can you test one of those JRE versions (known not to have this particular JRE bug) and see if you can get the original "massive deletion" problem to happen. I guess first try it without the

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-21 Thread Chris Harris
I'll see about using a newer/older JVM. In the meantime, according to the Solr admin page, which seems to get its info like so LucenePackage.class.getPackage().getImplementationVersion() what I've been testing is Lucene r652650. The Solr version is r654965, now modified of course to do some

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-21 Thread Michael McCandless
va.lang.NullPointerException Curiously there is no stack trace. The next relevant error: 2008-08-20T16:42:52 1219275772073 590946 org.apache.solr.update.UpdateHandler SEVERE org.apache.solr.update.DirectUpdateHandler2$CommitTrackerclass> run 16 auto commit error... Then there&#x

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-21 Thread Chris Harris
is no stack trace. The next relevant error: 2008-08-20T16:42:52 1219275772073 590946 org.apache.solr.update.UpdateHandler SEVERE org.apache.solr.update.DirectUpdateHandler2$CommitTracker run 16 auto commit error... Then there's another NullPointerException, now from

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-20 Thread Michael McCandless
Did the same FileNotFoundException / massive deletion of files occur? Actually if you could zip them all up and post them, I'll dig through them to see if they give any clues... Mike Chris Harris wrote: Ok, I did what you suggested, giving each SolrIndexWriter its own "infoStream" log fil

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-20 Thread Chris Harris
Ok, I did what you suggested, giving each SolrIndexWriter its own "infoStream" log file, created in the init() method. The thing is, I now have like 3400 infostream log files, I guess reflecting how solr created like 3400 SolrIndexWriters over the course of the run. (Hopefully this is plausible.) C

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-18 Thread Yonik Seeley
On Mon, Aug 18, 2008 at 6:05 AM, Michael McCandless <[EMAIL PROTECTED]> wrote: > The output from CheckIndex shows quite a few missing files! Is there any > possibility that two instances of Solr were somehow sharing the same index > directory? To eliminate that possibility, the lock factory shoul

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-18 Thread Yonik Seeley
On Mon, Aug 18, 2008 at 1:12 PM, Michael McCandless <[EMAIL PROTECTED]> wrote: > > Alas, I think this won't actually turn on IndexWriter's infoStream. > > I think you may need to modify the SolrIndexWriter.java sources, in the init > method, to add a call to setInfoStream(...). > > Can any Solr dev

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-18 Thread Fuad Efendi
Lucene v.2.1 has a bug with autocommit...

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-18 Thread Michael McCandless
Alas, I think this won't actually turn on IndexWriter's infoStream. I think you may need to modify the SolrIndexWriter.java sources, in the init method, to add a call to setInfoStream(...). Can any Solr developers confirm this? Mike Chris Harris wrote: I'm assuming that one way to do thi

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-18 Thread Chris Harris
I'm assuming that one way to do this would be to set the logging level to "FINEST" in the "logging" page in the solr admin tool, and then to make sure my logging.properties file is also set to record the FINEST logging level. Let me know if that won't enable to sort of debugging info you are talkin

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-18 Thread Michael McCandless
The output from CheckIndex shows quite a few missing files! Is there any possibility that two instances of Solr were somehow sharing the same index directory? It looks like you are using the 2.3 version of the Lucene jar (not the trunk version). Which version of Solr are you using? Si

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-16 Thread Walter Underwood
gt;>at org.apache.solr.core.SolrCore.execute(SolrCore.java:965) >>>at >>> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:3 >>> 39) >>>at >>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDi

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-16 Thread Otis Gospodnetic
- Original Message > From: Chris Harris <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Friday, August 15, 2008 1:35:20 PM > Subject: "Auto commit error" and java.io.FileNotFoundException > > I have an index (different from the ones mentioned yeste

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-16 Thread Otis Gospodnetic
TED]> > To: solr-user@lucene.apache.org > Sent: Friday, August 15, 2008 4:30:07 PM > Subject: Re: "Auto commit error" and java.io.FileNotFoundException > > I've done some more sniffing on the Lucene list, and noticed that Otis > made the following comment about a FileNotFoun

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-16 Thread Chris Harris
On Sat, Aug 16, 2008 at 4:33 AM, Grant Ingersoll <[EMAIL PROTECTED]> wrote: > Can you try Lucene's CheckIndex tool on it and report what it says? > > On Aug 15, 2008, at 1:35 PM, Chris Harris wrote: > >> I have an index (different from the ones mentioned yesterday) that was >> working fine with 3M

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-16 Thread Chris Harris
>> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:211) >>at >> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) >>at >> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:139) &

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-16 Thread Grant Ingersoll
ache.solr.update.UpdateHandler SEVERE org.apache.solr.update.DirectUpdateHandler2$CommitTrackerclass> run 15 auto commit error... There may have been SEVERE errors before this, but my log doesn't go back to the very beginning. It's interesting that while adding documents seems to be u

Re: "Auto commit error" and java.io.FileNotFoundException

2008-08-15 Thread Chris Harris
I've done some more sniffing on the Lucene list, and noticed that Otis made the following comment about a FileNotFoundException problem in late 2005: Are you using Windows and a compound index format (look at your index dir - does it have .cfs file(s))? This may be a bad combination,

"Auto commit error" and java.io.FileNotFoundException

2008-08-15 Thread Chris Harris
the files that Solr is complaining about are indeed not in the index directory. The earliest indication of trouble I found in my log was an error like this: 2008-08-15T09:47:48 1218818868528 6525387 org.apache.solr.update.UpdateHandler SEVERE org.apache.solr.update.DirectUpdateHandler