Re: maxwarmingSearchers and memory leak

2017-03-05 Thread SOLR4189
7;t know if this related to problem, but all our SOLR servers are virtual servers. -- View this message in context: http://lucene.472066.n3.nabble.com/maxwarmingSearchers-and-memory-leak-tp4321937p4323509.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: maxwarmingSearchers and memory leak

2017-03-01 Thread Shawn Heisey
On 2/26/2017 6:40 AM, SOLR4189 wrote: > Shawn, you are right. > * OS vendor and version > CentosOS 6.5 > > * Java vendor and version > OpenJDK version 1.8.0_20 > OpenJDK 64-bit Server VM (build 25.20-b23) > > * Servlet container used to start Solr. > Catalina(tomcat7) > > * Total amount of memory

Re: maxwarmingSearchers and memory leak

2017-02-26 Thread SOLR4189
ttp://lucene.472066.n3.nabble.com/file/n4322362/20170226_102812.jpg> * A screenshot showing total system memory allocations <http://lucene.472066.n3.nabble.com/file/n4322362/20170226_102007.jpg> -- View this message in context: http://lucene.472066.n3.nabble.com/maxwarmingSearchers-and

Re: maxwarmingSearchers and memory leak

2017-02-24 Thread Shawn Heisey
On 2/23/2017 1:51 AM, SOLR4189 wrote: > We have maxwarmingSearchers set to 2 and field value cache set to > initial size of 64. We saw that by taking a heap dump that our caches > consume 70% of the heap size, by looking into the dump we saw that > fieldValueCache has 6 o

maxwarmingSearchers and memory leak

2017-02-23 Thread SOLR4189
We have maxwarmingSearchers set to 2 and field value cache set to initial size of 64. We saw that by taking a heap dump that our caches consume 70% of the heap size, by looking into the dump we saw that fieldValueCache has 6 occurences of org.apache.solr.util.concurrentCache. When we have

Re: Error enquiry- exceeded limit of maxWarmingSearchers=2

2014-05-30 Thread Jason Hellman
I just realized I failed my own reading comprehension :) You have maxDocs, not maxTime for hard commit. Please disregard. On May 30, 2014, at 1:46 PM, Jason Hellman wrote: > I’m also not sure I understand the practical purpose of your hard/soft auto > commit settings. You are stating the fo

Re: Error enquiry- exceeded limit of maxWarmingSearchers=2

2014-05-30 Thread Jason Hellman
I’m also not sure I understand the practical purpose of your hard/soft auto commit settings. You are stating the following: Every 10 seconds I want data written to disk, but not be searchable. Every 15 seconds I want data to be written into memory and searchable. I would consider whether your s

Re: Error enquiry- exceeded limit of maxWarmingSearchers=2

2014-05-30 Thread Shawn Heisey
On 5/29/2014 9:55 PM, M, Arjun (NSN - IN/Bangalore) wrote: > Thanks a lot for your nice explanation.. Now I understood the > difference between autoCommit and autoSoftCommit.. Now my config looks like > below. > > >1 >false > > > >15000 > > >

RE: Error enquiry- exceeded limit of maxWarmingSearchers=2

2014-05-29 Thread M, Arjun (NSN - IN/Bangalore)
hawn Heisey [mailto:s...@elyograg.org] Sent: Thursday, May 29, 2014 10:14 PM To: solr-user@lucene.apache.org Subject: Re: Error enquiry- exceeded limit of maxWarmingSearchers=2 On 5/29/2014 7:52 AM, M, Arjun (NSN - IN/Bangalore) wrote: > Thanks Shawn... Just one more question.. > > Can bo

Re: Error enquiry- exceeded limit of maxWarmingSearchers=2

2014-05-29 Thread Shawn Heisey
On 5/29/2014 7:52 AM, M, Arjun (NSN - IN/Bangalore) wrote: > Thanks Shawn... Just one more question.. > > Can both autoCommit and autoSoftCommit be enabled? If both are enabled, which > one takes precedence? Yes, and it's a very common configuration. If you do enable both, you want openSearcher

RE: Error enquiry- exceeded limit of maxWarmingSearchers=2

2014-05-29 Thread M, Arjun (NSN - IN/Bangalore)
M To: solr-user@lucene.apache.org Subject: Re: Error enquiry- exceeded limit of maxWarmingSearchers=2 On 5/29/2014 4:18 AM, M, Arjun (NSN - IN/Bangalore) wrote: > Thanks for your valuable inputs... Find below my code and config in > solrconfig.xml. Index update is successful but I am n

Re: Error enquiry- exceeded limit of maxWarmingSearchers=2

2014-05-29 Thread Shawn Heisey
On 5/29/2014 4:18 AM, M, Arjun (NSN - IN/Bangalore) wrote: > Thanks for your valuable inputs... Find below my code and config in > solrconfig.xml. Index update is successful but I am not able to see any data > from solr admin console. What could be the issue? Any help here is highly > appr

RE: Error enquiry- exceeded limit of maxWarmingSearchers=2

2014-05-29 Thread M, Arjun (NSN - IN/Bangalore)
he.org Subject: Re: Error enquiry- exceeded limit of maxWarmingSearchers=2 On 5/28/2014 3:45 AM, M, Arjun (NSN - IN/Bangalore) wrote: > Also is there a way to check if autowarming completed (or) how to make > the next commit wait till previous commit finishes? With Solr, probably no

Re: Error enquiry- exceeded limit of maxWarmingSearchers=2

2014-05-28 Thread Shawn Heisey
On 5/28/2014 3:45 AM, M, Arjun (NSN - IN/Bangalore) wrote: > Also is there a way to check if autowarming completed (or) how to make > the next commit wait till previous commit finishes? With Solr, probably not. There might be a statistic available from an admin handler that I don't know ab

RE: Error enquiry- exceeded limit of maxWarmingSearchers=2

2014-05-28 Thread M, Arjun (NSN - IN/Bangalore)
M To: solr-user@lucene.apache.org Subject: Re: Error enquiry- exceeded limit of maxWarmingSearchers=2 > Hi, > > I am getting the below error. > > org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: > Error opening new searcher. exceeded limit of > m

Re: Error enquiry- exceeded limit of maxWarmingSearchers=2

2014-05-27 Thread Shawn Heisey
> Hi, > > I am getting the below error. > > org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: > Error opening new searcher. exceeded limit of > maxWarmingSearchers=2, try again later. This error is usually a symptom of a problem, not the ac

Error enquiry- exceeded limit of maxWarmingSearchers=2

2014-05-27 Thread M, Arjun (NSN - IN/Bangalore)
Hi, I am getting the below error. org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error opening new searcher. exceeded limit of maxWarmingSearchers=2, try again later. Can you please help?

Re: exceeded limit of maxWarmingSearchers ERROR

2013-11-18 Thread Erick Erickson
gt; > > > > Can you help me why Iam getting this error. > > PFA of the same error log and the solr-spring.xml files. > > Regards, > Lokanadham Ganta > > ----- Original Message - > From: "Erick Erickson [via Lucene]" < > ml-node+s472066n4101220.

Re: exceeded limit of maxWarmingSearchers ERROR

2013-11-17 Thread Loka
kanadham Ganta - Original Message - From: "Erick Erickson [via Lucene]" To: "Loka" Sent: Friday, November 15, 2013 7:14:26 PM Subject: Re: exceeded limit of maxWarmingSearchers ERROR That's a fine place to start. This form: ${solr.autoCommit.maxTime:15000} j

Re: exceeded limit of maxWarmingSearchers ERROR

2013-11-15 Thread Erick Erickson
ot;Erick Erickson [via Lucene]" < > ml-node+s472066n4101203...@n3.nabble.com> > Sent: Friday, November 15, 2013 6:33:20 PM > Subject: Re: exceeded limit of maxWarmingSearchers ERROR > > Erickson, > > Thanks for your reply, before your reply, I have googled and found t

Re: exceeded limit of maxWarmingSearchers ERROR

2013-11-15 Thread Loka
false Is the above one fine? Regards, Lokanadham Ganta - Original Message - From: "Lokanadham Ganta" To: "Erick Erickson [via Lucene]" Sent: Friday, November 15, 2013 6:33:20 PM Subject: Re: exceeded limit of maxWarmingSearchers ERROR Erickson, T

Re: exceeded limit of maxWarmingSearchers ERROR

2013-11-15 Thread Loka
: ${solr.autoCommit.maxTime:15000} false ${solr.autoSoftCommit.maxTime:1} Please confirm me. But how can I check how much autowarming that Iam doing, as of now I have set the maxWarmingSearchers as 2, should I increase the value? Regards, Lokanadham Ganta

Re: exceeded limit of maxWarmingSearchers ERROR

2013-11-15 Thread Erick Erickson
ing wrong. > > Regards, > Lokanadham Ganta > > > > > > > > > > > - Original Message - > From: "Erick Erickson [via Lucene]" < > ml-node+s472066n4100924...@n3.nabble.com> > To: "Loka" > Sent: Thursday, November 14, 2013

Re: exceeded limit of maxWarmingSearchers ERROR

2013-11-14 Thread Loka
Erick Erickson [via Lucene]" To: "Loka" Sent: Thursday, November 14, 2013 8:38:17 PM Subject: Re: exceeded limit of maxWarmingSearchers ERROR CommitWithin is either configured in solrconfig.xml for the or tags as the maxTime tag. I recommend you do use this. The other way you ca

Re: exceeded limit of maxWarmingSearchers ERROR

2013-11-14 Thread Erick Erickson
you help me how to use commitWithin Tag. can you give > me the example > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100864.html > Sent from the Solr - User mailing list archive at Nabble.com. >

Re: exceeded limit of maxWarmingSearchers ERROR

2013-11-14 Thread Loka
Hi Naveen, Iam also getting the similar problem where I do not know how to use the commitWithin Tag, can you help me how to use commitWithin Tag. can you give me the example -- View this message in context: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR

Re: exceeded limit of maxWarmingSearchers

2013-09-13 Thread gfbj
I ended up having to do a mathematical increase of the delay because the indexing eventually would outstrip the static value I set and crash the maxWarmingSearchers. -- View this message in context: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-tp489803p4089699

Re: exceeded limit of maxWarmingSearchers

2013-09-12 Thread Erick Erickson
ause the indexing eventually would outstrip the static value I set and > crash the maxWarmingSearchers. > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-tp489803p4089699.html > Sent from the Solr - User mailing list archive at Nabble.com. >

Re: exceeded limit of maxWarmingSearchers=4

2013-09-10 Thread gfbj
*sleep 1.5 seconds* command per file ...FWIW I found in trying to cfindex 35K documents that if I did a cfdirectory list and added a delay per file indexed (and a cfsetting with a REALLY long timeout), CPU use dropped from 58% to ~19% and I got much farther without the dread maxWarmingSearchers=4

Re: maxWarmingSearchers in Solr 4.

2013-04-08 Thread Dotan Cohen
ou are > committing less often than that, or you'll quickly reach your > maxWarmingSearchers config value. If the commits are happening VARY > quickly, you may need to set autowarmCount to 0, and possibly disable caches > entirely. > I see. This seems to be the opposite of the a

Re: maxWarmingSearchers in Solr 4.

2013-04-04 Thread Shawn Heisey
On 4/4/2013 12:34 AM, Dotan Cohen wrote: In the case of maxWarmingSearchers, I would hope that you have your system set up so that you would never need more than 1 warming searcher at a time. If you do a commit while a previous commit is still warming, Solr will try to create a second warming

Re: maxWarmingSearchers in Solr 4.

2013-04-03 Thread Dotan Cohen
default changing in new versions. > Thanks. This makes sense. I take it, then, that you update (or at least review) solrconfig for each new Solr version. As I become more familiar with that file I will begin doing the same. > In the case of maxWarmingSearchers, I would hope that you have

Re: maxWarmingSearchers in Solr 4.

2013-04-03 Thread Shawn Heisey
y because many of the examples have > been removed? > > In particular, I notice that there is no mention of > maxWarmingSearchers in the Solr 4.1 solrconfig.xml. I assume that I > can simply add it in, are there any other critical config options that > are missing that I should

maxWarmingSearchers in Solr 4.

2013-04-03 Thread Dotan Cohen
cular, I notice that there is no mention of maxWarmingSearchers in the Solr 4.1 solrconfig.xml. I assume that I can simply add it in, are there any other critical config options that are missing that I should be looking into as well? Would I be better off using the old Solr 3.x solrconfig.xml in Sol

Re: optimal maxWarmingSearchers in solr cloud

2013-03-10 Thread Timothy Potter
13 at 12:54 PM, jimtronic wrote: > The notes for maxWarmingSearchers in solrconfig.xml state: > > "Recommend values of 1-2 for read-only slaves, higher for masters w/o cache > warming." > > Since solr cloud nodes could be both a leader and non-leader depending on >

optimal maxWarmingSearchers in solr cloud

2013-03-10 Thread jimtronic
The notes for maxWarmingSearchers in solrconfig.xml state: "Recommend values of 1-2 for read-only slaves, higher for masters w/o cache warming." Since solr cloud nodes could be both a leader and non-leader depending on the current state of the cloud, what would be the optimal se

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-17 Thread Naveen Gupta
Hi Nagendra, Thanks a lot .. i will start working on NRT today.. meanwhile old settings (increased warmSearcher in Master) have not given me trouble till now .. but NRT will be more suitable to us ... Will work on that one and will analyze the performance and share with you. Thanks Naveen 2011/

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-16 Thread Nagendra Nagarajayya
Naveen: See below: *NRT with Apache Solr 3.3 and RankingAlgorithm does need a commit for a document to become searchable*. Any document that you add through update becomes immediately searchable. So no need to commit from within your update client code. Since there is no commit, the cache does

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-15 Thread Naveen Gupta
Nagendra You wrote, Naveen: *NRT with Apache Solr 3.3 and RankingAlgorithm does need a commit for a document to become searchable*. Any document that you add through update becomes immediately searchable. So no need to commit from within your update client code. Since there is no commit, the c

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-14 Thread Nagendra Nagarajayya
Bill: I did look at Marks performance tests. Looks very interesting. Here is the Apacle Solr 3.3 with RankingAlgorithm NRT performance: http://solr-ra.tgels.com/wiki/en/Near_Real_Time_Search_ver_3.x Regards - Nagendra Nagarajayya http://solr-ra.tgels.org http://rankingalgorithm.tgels.org On

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-14 Thread Bill Bell
I understand. Have you looked at Mark's patch? From his performance tests, it looks pretty good. When would RA work better? Bill On 8/14/11 8:40 PM, "Nagendra Nagarajayya" wrote: >Bill: > >The technical details of the NRT implementation in Apache Solr with >RankingAlgorithm (SOLR-RA) is avai

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-14 Thread Nagendra Nagarajayya
Bill: The technical details of the NRT implementation in Apache Solr with RankingAlgorithm (SOLR-RA) is available here: http://solr-ra.tgels.com/papers/NRT_Solr_RankingAlgorithm.pdf (Some changes for Solr 3.x, but for most it is as above) Regarding support for 4.0 trunk, should happen someti

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-14 Thread Bill Bell
OK, I'll ask the elephant in the roomŠ. What is the difference between the new UpdateHandler from Mark and the SOLR-RA? The UpdateHandler works with 4.0 does SOLR-RA work with 4.0 trunk? Pros/Cons? On 8/14/11 8:10 PM, "Nagendra Nagarajayya" wrote: >Naveen: > >NRT with Apache Solr 3.3 and Ra

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-14 Thread Nagendra Nagarajayya
Naveen: NRT with Apache Solr 3.3 and RankingAlgorithm does need a commit for a document to become searchable. Any document that you add through update becomes immediately searchable. So no need to commit from within your update client code. Since there is no commit, the cache does not have

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-14 Thread Peter Sturge
what is the solution for our problem? > > We are using CURL to post the data and commit > > Also till now we are using default solrconfig. > > Aug 14, 2011 12:12:04 AM org.apache.solr.common.SolrException log > SEVERE: org.apache.solr.common.SolrException: Error opening new searche

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-14 Thread Mark Miller
It's somewhat confusing - I'll straighten it out though. I left the issue open to keep me from taking forever to doc it - hasn't helped much yet - but maybe later today... On Aug 14, 2011, at 12:12 PM, Erick Erickson wrote: > Ah, thanks, Mark... I must have been looking at the wrong JIRAs. > >

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-14 Thread Naveen Gupta
Hi Mark/Erick/Nagendra, I was not very confident about NRT at that point of time, when we started project almost 1 year ago, definitely i would try NRT and see the performance. The current requirement was working fine till we were using commitWithin 10 millisecs in the XMLDocument which we were p

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-14 Thread Erick Erickson
Ah, thanks, Mark... I must have been looking at the wrong JIRAs. Erick On Sun, Aug 14, 2011 at 10:02 AM, Mark Miller wrote: > > On Aug 14, 2011, at 9:03 AM, Erick Erickson wrote: > >> You either have to go to near real time (NRT), which is under >> development, but not committed to trunk yet > >

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-14 Thread Nagendra Nagarajayya
till now we are using default solrconfig. Aug 14, 2011 12:12:04 AM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: Error opening new searcher. exceeded limit of maxWarmingSearchers=2, try again later. at org.apache.solr.core.SolrCore.getSearcher

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-14 Thread Mark Miller
On Aug 14, 2011, at 9:03 AM, Erick Erickson wrote: > You either have to go to near real time (NRT), which is under > development, but not committed to trunk yet NRT support is committed to trunk. - Mark Miller lucidimagination.com

Re: exceeded limit of maxWarmingSearchers ERROR

2011-08-14 Thread Erick Erickson
> SEVERE: org.apache.solr.common.SolrException: Error opening new searcher. > exceeded limit of maxWarmingSearchers=2, try again later. >        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1052) >        at > org.apache.solr.update.DirectUpdateHandler2.commit(

exceeded limit of maxWarmingSearchers ERROR

2011-08-13 Thread Naveen Gupta
using CURL to post the data and commit Also till now we are using default solrconfig. Aug 14, 2011 12:12:04 AM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: Error opening new searcher. exceeded limit of maxWarmingSearchers=2, try again later. at

Re: exceeded limit of maxWarmingSearchers = 4 =(

2011-04-12 Thread stockii
r1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-4-tp2810380p2810572.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: exceeded limit of maxWarmingSearchers = 4 =(

2011-04-12 Thread stockii
-of-maxWarmingSearchers-4-tp2810380p2810561.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: exceeded limit of maxWarmingSearchers = 4 =(

2011-04-12 Thread stockii
.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-4-tp2810380p2810458.html Sent from the Solr - User mailing list archive at Nabble.com.

exceeded limit of maxWarmingSearchers = 4 =(

2011-04-12 Thread stockii
stances, 7 Cores, 1 Core with 31 Million Documents other Cores < 100.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx - Solr2 for Update-Request - delta every Minute - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearch

Re: Config Relationship between MaxWarmingSearchers and StreamingUpdateSolrServer

2009-11-16 Thread Otis Gospodnetic
Hi Erik, I didn't look at the source code, and I think the javadoc for SUSS doesn't mention it, but I am under the impression that the number of threads to use should roughly match the number of CPU cores on the master. The maxWarmingSearchers should only be relevant to slaves, n

Config Relationship between MaxWarmingSearchers and StreamingUpdateSolrServer

2009-11-16 Thread Erik Earle
My application updates the master index frequently, sometimes very frequently. Is there a good rule of thumb for configuring: 1) maxWarmingSearchers in the master 2) the SUSS thread pool size (and perhaps queue length) to match the server settings?

Re: "exceeded limit of maxWarmingSearchers=2" when posting data

2009-10-23 Thread Yonik Seeley
gt; Solr didn't complian when the number of test threads is 1, 2, 3 or 4. > > But when I increased the thnumber of test threads to 8, I saw this error > on the console: > > SEVERE: org.apache.solr.common.SolrException: Error opening new searcher. > exceeded limit of maxWarmin

"exceeded limit of maxWarmingSearchers=2" when posting data

2009-10-23 Thread Teruhiko Kurosaka
s 1, 2, 3 or 4. But when I increased the thnumber of test threads to 8, I saw this error on the console: SEVERE: org.apache.solr.common.SolrException: Error opening new searcher. exceeded limit of maxWarmingSearchers=2, try again later. What does this mean? Why Solr tries to make warm u

Re: exceeded limit of maxWarmingSearchers

2009-02-23 Thread mahendra mahendra
Hi Shalin,   Which auto-warming I have to remove to make commits faster. The below configuration have in solrconfig.xml. Also, what is maxWarmingSearchers value.                  Thanks for your help!! Thanks & Regards, Mahendra --- On Mon, 2/23/09, Shalin Shekhar Mangar wrote:

Re: exceeded limit of maxWarmingSearchers

2009-02-22 Thread Shalin Shekhar Mangar
econd instance start. This is causing the below error. > > org.apache.solr.common.SolrException: Error opening new searcher. exceeded > limit of maxWarmingSearchers=2, try again later. > Error opening new searcher. exceeded limit of maxWarmingSearchers=2, try > again later. &g

exceeded limit of maxWarmingSearchers

2009-02-22 Thread mahendra mahendra
rcher. exceeded limit of maxWarmingSearchers=2, try again later. Error opening new searcher. exceeded limit of maxWarmingSearchers=2, try again later.   Is there any configuration parameter to increase maxWarmingSearchers. Any help would appriciate !! Thanks & Regards, Mahendra

Re: exceeded limit of maxWarmingSearchers

2009-02-09 Thread Jon Drukman
Otis Gospodnetic wrote: I'd say: "Make sure you don't commit more frequently than the time it takes for your searcher to warm up", or else you risk searcher overlap and pile-up. cool. i found a place in our code where we were committing the same thing twice in very rapid succession. fingers

Re: exceeded limit of maxWarmingSearchers

2009-02-06 Thread Otis Gospodnetic
ukman To: solr-user@lucene.apache.org Sent: Thursday, February 5, 2009 11:36:13 AM Subject: Re: exceeded limit of maxWarmingSearchers Otis Gospodnetic wrote: > Jon, > > If you can, don't commit on every update and that should help or fully solve > your problem. is there any sort of

Re: exceeded limit of maxWarmingSearchers

2009-02-05 Thread Jon Drukman
Otis Gospodnetic wrote: Jon, If you can, don't commit on every update and that should help or fully solve your problem. is there any sort of heuristic or formula i can apply that can tell me when to commit? put it in a cron job and fire it once per hour? there are certain updates that are

Re: exceeded limit of maxWarmingSearchers

2009-02-04 Thread Otis Gospodnetic
009 1:09:00 PM > Subject: Re: exceeded limit of maxWarmingSearchers > > Otis Gospodnetic wrote: > > That should be fine (but apparently isn't), as long as you don't have some > very slow machine or if your caches are are large and configured to copy a > lot >

Re: exceeded limit of maxWarmingSearchers

2009-02-04 Thread Jon Drukman
Otis Gospodnetic wrote: That should be fine (but apparently isn't), as long as you don't have some very slow machine or if your caches are are large and configured to copy a lot of data on commit. this is becoming more and more problematic. we have periods where we get 10 of these exceptio

Re: exceeded limit of maxWarmingSearchers

2009-01-30 Thread Otis Gospodnetic
: Jon Drukman > To: solr-user@lucene.apache.org > Sent: Friday, January 30, 2009 4:54:06 PM > Subject: Re: exceeded limit of maxWarmingSearchers > > Yonik Seeley wrote: > > I'd advise setting it to a very low limit (like 2) and committing less > > often. Once you ge

Re: exceeded limit of maxWarmingSearchers

2009-01-30 Thread Jon Drukman
Yonik Seeley wrote: I'd advise setting it to a very low limit (like 2) and committing less often. Once you get too many overlapping searchers, things will slow to a crawl and that will just cause more to pile up. The root cause is simply too many commits in conjunction with warming too long. I

Re: exceeded limit of maxWarmingSearchers

2009-01-30 Thread Yonik Seeley
t; > SEVERE: org.apache.solr.common.SolrException: Error opening new searcher. > exceeded limit of maxWarmingSearchers=16, try again later. > > I keep bumping up maxWarmingSearchers. It's at 32 now. Is there any way to > figure out what the "right" value is besides t

exceeded limit of maxWarmingSearchers

2009-01-30 Thread Jon Drukman
I am getting hit by a storm of these once a day or so: SEVERE: org.apache.solr.common.SolrException: Error opening new searcher. exceeded limit of maxWarmingSearchers=16, try again later. I keep bumping up maxWarmingSearchers. It's at 32 now. Is there any way to figure out what the &

RE: exceeded limit of maxWarmingSearchers=4

2008-12-11 Thread Lance Norskog
commited; there is no actual commit operation. -Original Message- From: Walter Underwood [mailto:wunderw...@netflix.com] Sent: Thursday, December 11, 2008 11:45 AM To: solr-user@lucene.apache.org Subject: Re: exceeded limit of maxWarmingSearchers=4 It sounds like you need real-time search

Re: exceeded limit of maxWarmingSearchers=4

2008-12-11 Thread Mark Miller
oad, we see the following error... ERROR [IndexSubscription] error committing changes to solr java.lang.RuntimeException: org.apache.solr.common.SolrException: Error opening new searcher. exceeded limit of maxWarmingSearchers=4, try again later. My understanding of Solr¹s caches and warming searches

Re: exceeded limit of maxWarmingSearchers=4

2008-12-11 Thread Walter Underwood
ee the following error... > > ERROR [IndexSubscription] error committing changes to solr > java.lang.RuntimeException: org.apache.solr.common.SolrException: Error > opening new searcher. exceeded limit of maxWarmingSearchers=4, try again > later. > > My understanding of Solr¹s cac

RE: exceeded limit of maxWarmingSearchers=4

2008-12-11 Thread chip correra
will not be part of the query results. > Date: Thu, 11 Dec 2008 14:09:47 -0500 > From: markrmil...@gmail.com > To: solr-user@lucene.apache.org > Subject: Re: exceeded limit of maxWarmingSearchers=4 > > chip correra wrote: > > We’re using Solr as a backend indexe

Re: exceeded limit of maxWarmingSearchers=4

2008-12-11 Thread Mark Miller
update the user’s interface. Occasionally, usually under load, we see the following error... ERROR [IndexSubscription] error committing changes to solr java.lang.RuntimeException: org.apache.solr.common.SolrException: Error opening new searcher. exceeded limit of maxWarmingSearchers=4, try

exceeded limit of maxWarmingSearchers=4

2008-12-11 Thread chip correra
interface. Occasionally, usually under load, we see the following error... ERROR [IndexSubscription] error committing changes to solr java.lang.RuntimeException: org.apache.solr.common.SolrException: Error opening new searcher. exceeded limit of maxWarmingSearchers=4, try again later. My

Re: maxWarmingSearchers

2008-12-09 Thread Otis Gospodnetic
er 1, 2008 4:23:47 PM > Subject: RE: maxWarmingSearchers > > > Hi ToddFeak, > > thanks for your response... > > solr version is 1.3. Roughly about every 4 minutes there are indexing/updaing > of > 4 to 10 documents that is from multiple clients to one master

RE: maxWarmingSearchers

2008-12-01 Thread dudes dudes
thanks for your explanation and time :) > Subject: RE: maxWarmingSearchers > Date: Mon, 1 Dec 2008 13:57:59 -0800 > From: [EMAIL PROTECTED] > To: solr-user@lucene.apache.org > > The commit after each one may be hurting you. > > I believe that a new searcher is c

RE: maxWarmingSearchers

2008-12-01 Thread Feak, Todd
iming information on how long it took for the searcher and caches to warm up. -Todd Feak -Original Message- From: dudes dudes [mailto:[EMAIL PROTECTED] Sent: Monday, December 01, 2008 1:46 PM To: solr-user@lucene.apache.org Subject: RE: maxWarmingSearchers > Subject: RE: maxWarmingS

RE: maxWarmingSearchers

2008-12-01 Thread dudes dudes
> Subject: RE: maxWarmingSearchers > Date: Mon, 1 Dec 2008 13:35:53 -0800 > From: [EMAIL PROTECTED] > To: solr-user@lucene.apache.org > > Ok sounds reasonable. When you index/update those 4-10 documents, are > you doing a single commit? OR are you doing a commit after eac

RE: maxWarmingSearchers

2008-12-01 Thread Feak, Todd
] Sent: Monday, December 01, 2008 1:24 PM To: solr-user@lucene.apache.org Subject: RE: maxWarmingSearchers Hi ToddFeak, thanks for your response... solr version is 1.3. Roughly about every 4 minutes there are indexing/updaing of 4 to 10 documents that is from multiple clients to one master

RE: maxWarmingSearchers

2008-12-01 Thread dudes dudes
uncommented under solrconfig ... QueryCache and FilterCache settings are left as default thanks ak > Subject: RE: maxWarmingSearchers > Date: Mon, 1 Dec 2008 13:13:15 -0800 > From: [EMAIL PROTECTED] > To: solr-user@lucene.apache.org > > Probably going to need a bi

RE: maxWarmingSearchers

2008-12-01 Thread Feak, Todd
searchers probably won't fix the issue, just delay it. -ToddFeak -Original Message- From: dudes dudes [mailto:[EMAIL PROTECTED] Sent: Monday, December 01, 2008 12:13 PM To: solr-user@lucene.apache.org Subject: maxWarmingSearchers Hello all, I'm having this issue and I hope I get

maxWarmingSearchers

2008-12-01 Thread dudes dudes
Hello all, I'm having this issue and I hope I get some help.. :) This following happens quite often ... even though searching and indexing are on a safe side... SolrException: HTTP code=503, reason=Error opening new searcher. exceeded limit of maxWarmingSearchers=4, try again late

Re: exceeded limit of maxWarmingSearchers

2008-11-06 Thread Chris Hostetter
: SEVERE: org.apache.solr.common.SolrException: Error opening new searcher. : exceeded limit of maxWarmingSearchers=8, try again later. : Our server is not even in public use yet, it's serving maybe one query every : second, or less. I don't understand what could be causing this. th

Re: exceeded limit of maxWarmingSearchers

2008-10-29 Thread Shalin Shekhar Mangar
On Thu, Oct 30, 2008 at 2:46 AM, Jon Drukman <[EMAIL PROTECTED]> wrote: > > Most of them say warmupTime=0. It ranges from 0 to 37. I hope that is > msec and not seconds!! > Correct, that is in milliseconds. -- Regards, Shalin Shekhar Mangar.

Re: exceeded limit of maxWarmingSearchers

2008-10-29 Thread Jon Drukman
Feak, Todd wrote: Have you looked at how long your warm up is taking? If it's taking longer to warm up a searcher then it does for you to do an update, you will be behind the curve and eventually run into this no matter how big that number. Most of them say warmupTime=0. It ranges from 0 to

RE: exceeded limit of maxWarmingSearchers

2008-10-29 Thread Feak, Todd
D] On Behalf Of Jon Drukman Sent: Wednesday, October 29, 2008 11:56 AM To: solr-user@lucene.apache.org Subject: exceeded limit of maxWarmingSearchers I am getting this error quite frequently on my Solr installation: SEVERE: org.apache.solr.common.SolrException: Error opening new searcher. exceeded lim

exceeded limit of maxWarmingSearchers

2008-10-29 Thread Jon Drukman
I am getting this error quite frequently on my Solr installation: SEVERE: org.apache.solr.common.SolrException: Error opening new searcher. exceeded limit of maxWarmingSearchers=8, try again later. I've done some googling but the common explanation of it being related to autocommit do

Re: exceeded limit of maxWarmingSearchers

2008-05-19 Thread Chris Hostetter
: and I though a true master-slave setup would be overkill. Is it really : problematic to run queries on instances that aren't auto-warmed? Sounds like it really depends on your usecases and what you consider "problematic" ... there's no inherent problem in having queries hit an unwarmed index, i

Re: exceeded limit of maxWarmingSearchers

2008-05-12 Thread Sasha Voynow
Thanks for the advice. Unfortunately, my plan was to two have two instances both running as "masters" although one would only be a warm-standby for querying purposes. I just wanted a little bit of redundancy for the moment and I though a true master-slave setup would be overkill. Is it really probl

Re: exceeded limit of maxWarmingSearchers

2008-05-10 Thread Chris Hostetter
: On a solr instance where I am in the process of indexing moderately large : number of documents (300K+). There is no querying of the index taking place : at all. : I don't understand what operations are causing new searchers to warm, or how : to stop them from doing so. I'd be happy to provide

Re: exceeded limit of maxWarmingSearchers

2008-05-09 Thread Ryan McKinley
On May 9, 2008, at 7:33 PM, Sasha Voynow wrote: Is it generally better to handle batching your commits programmatically on the "client" side rather than relying on auto-commit? the time based auto-commit is useful if you are indexing from multiple clients to a single server. Rather then

Re: exceeded limit of maxWarmingSearchers

2008-05-09 Thread Sasha Voynow
r - Nutch > > > > - Original Message > > From: Sasha Voynow <[EMAIL PROTECTED]> > > To: solr-user@lucene.apache.org > > Sent: Friday, May 9, 2008 6:59:00 PM > > Subject: exceeded limit of maxWarmingSearchers > > > > Hi: > > > > I&#

Re: exceeded limit of maxWarmingSearchers

2008-05-09 Thread Otis Gospodnetic
t; From: Otis Gospodnetic <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Friday, May 9, 2008 7:18:03 PM > Subject: Re: exceeded limit of maxWarmingSearchers > > Sasha, > > Do you have postCommit or postOptimize hooks enabled? Are you sending > commits &

Re: exceeded limit of maxWarmingSearchers

2008-05-09 Thread Otis Gospodnetic
t; Sent: Friday, May 9, 2008 6:59:00 PM > Subject: exceeded limit of maxWarmingSearchers > > Hi: > > I'm getting flurries of these error messages: > > > > WARNING: Error opening new searcher. exceeded limit of > maxWarmingSearchers=4, try again later. > >

exceeded limit of maxWarmingSearchers

2008-05-09 Thread Sasha Voynow
Hi: I'm getting flurries of these error messages: WARNING: Error opening new searcher. exceeded limit of maxWarmingSearchers=4, try again later. SEVERE: org.apache.solr.common.SolrException: Error opening new searcher. exceeded limit of maxWarmingSearchers=4, try again later. On a