firstSearcher and newSearcher loading external files

2015-10-28 Thread Summer Shire
Hi All, I use value source parser to load external file that contains popularity values. The way I use it is by passing a "signals" param in the query now I want to warm up this external cache in solr before the actual traffic starts coming in. What is happening is that the cache does not get

Re: Too many Soft commits and opening searchers realtime

2015-07-08 Thread Summer Shire
er > a realtime searcher to open on every 8 minutes along with the hard > commit. > > -Yonik > > >> On Tue, Jul 7, 2015 at 5:29 PM, Summer Shire wrote: >> HI All, >> >> Can someone help me understand the following behavior. >> I ha

Re: Tlog replay

2015-07-08 Thread Summer Shire
atic int IGNORE_AUTOCOMMIT = 0x0008; // this update > should not count toward triggering of autocommits. > public static int CLEAR_CACHES = 0x0010; // clear caches > associated with the update log. used when applying reordered DBQ > updates when doing an add. > > So th

Tlog replay

2015-07-07 Thread Summer Shire
Hi, When I restart my solr core the log replay starts and just before it finishes I see the following commit start commit{flags=2,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} what does the “flags=2” param do ? when I try to sen

Re: Too many Soft commits and opening searchers realtime

2015-07-07 Thread Summer Shire
No the client lets solr handle it. > On Jul 7, 2015, at 2:38 PM, Mike Drob wrote: > > Are the clients that are posting updates requesting commits? > >> On Tue, Jul 7, 2015 at 4:29 PM, Summer Shire wrote: >> >> HI All, >> >> Can someone help me un

Too many Soft commits and opening searchers realtime

2015-07-07 Thread Summer Shire
HI All, Can someone help me understand the following behavior. I have the following maxTimes on hard and soft commits yet I see a lot of Opening Searchers in the log org.apache.solr.search.SolrIndexSearcher- Opening Searcher@1656a258[main] realtime also I see a soft commit happening almost e

Re: optimize status

2015-07-02 Thread Summer Shire
at 2:07 AM, Upayavira wrote: >> We need to work out why your performance is bad without optimise. What >> version of Solr are you using? Can you confirm that your config is using >> the TieredMergePolicy? >> >> Upayavira >> >> Oe, Jun 30, 2015, at 04:48 AM, Summer

Re: optimize status

2015-06-29 Thread Summer Shire
t; >>> Optimisation is very badly named. What it does is squashes all segments >>> in your index into one segment, removing all deleted documents. It is >>> good to get rid of deletes - in that sense the index is "optimized". >>> However, future merges be

Re: optimize status

2015-06-29 Thread Summer Shire
> Upayavira > >> On Sun, Jun 28, 2015, at 09:37 PM, Summer Shire wrote: >> Hi All, >> >> I have two indexers (Independent processes ) writing to a common solr >> core. >> If One indexer process issued an optimize on the core >> I want the s

optimize status

2015-06-28 Thread Summer Shire
Hi All, I have two indexers (Independent processes ) writing to a common solr core. If One indexer process issued an optimize on the core I want the second indexer to wait adding docs until the optimize has finished. Are there ways I can do this programmatically? pinging the core when the optimi

optimize status

2015-06-28 Thread Summer Shire
Hi All, I have two indexers (Independent processes ) writing to a common solr core. If One indexer process issued an optimize on the core I want the second indexer to wait adding docs until the optimize has finished. Are there ways I can do this programmatically? pinging the core when the optimi

Re: invalid index version and generation

2015-06-15 Thread Summer Shire
Anyone have any suggestions on things I could try ? Does it seem like a solr bug ? > On Jun 14, 2015, at 9:40 PM, Summer Shire wrote: > > Hi all, > > Every time I optimize my index with maxSegment=2 after some time the > replication fails to get filelist for a given gene

invalid index version and generation

2015-06-14 Thread Summer Shire
Hi all, Every time I optimize my index with maxSegment=2 after some time the replication fails to get filelist for a given generation. Looks like the index version and generation count gets messed up. (If the maxSegment=1 this never happens. I am able to successfully reproduce this by optimizin

Re: Java 7/8 OOM exception when adding documents to httpSolrServer

2015-04-11 Thread Summer Shire
ote: > > On 4/9/2015 9:51 PM, Summer Shire wrote: >> I was adding 1000 docs at a time but later I changed it to 10 and I am still >> getting the exception. >> >> The reason I added the integer.max_value code was because I googled for what >> could be causing the OOM &

Re: solr 4.7.2 mergeFactor/ Merge policy issue

2015-03-13 Thread Summer Shire
Hi All, Did anyone get a chance to look at my config and the InfoStream File ? I am very curious to see what you think thanks, Summer > On Mar 6, 2015, at 5:20 PM, Summer Shire wrote: > > Hi All, > > Here’s more update on where I am at with this. > I enabled infoStream l

Re: solr 4.7.2 mergeFactor/ Merge policy issue

2015-03-06 Thread Summer Shire
Hi All, Here’s more update on where I am at with this. I enabled infoStream logging and quickly figured that I need to get rid of maxBufferedDocs. So Erick you were absolutely right on that. I increased my ramBufferSize to 100MB and reduced maxMergeAtOnce to 3 and segmentsPerTier to 3 as well. M

Re: solr 4.7.2 mergeFactor/ Merge policy issue

2015-03-04 Thread Summer Shire
on't know for sure, that the merging stuff doesn't get > triggered until you commit, it doesn't "just happen". > > Shot in the dark... > > Erick > > On Wed, Mar 4, 2015 at 1:15 PM, Summer Shire > wrote: > > Hi All, > > > > I am us

solr 4.7.2 mergeFactor/ Merge policy issue

2015-03-04 Thread Summer Shire
Hi All, I am using solr 4.7.2 is there a bug wrt merging the segments down ? I recently added the following to my solrConfig.xml false 100 1000 5 But I do not see any merging of the segments happening. I saw some other people have the same issue but there wasn’t much info

Solr 4.7.2 mergeFactor

2015-03-03 Thread Summer Shire
Hi All, I am using solr 4.7.2 is there a bug wrt merging the segments down ? I recently added the following to my solrConfig.xml false 100 1000 5 But I do not see any merging of the segments happening. I saw some other people have the same issue but there wasn’t much i

Weird Solr Replication Slave out of sync

2015-02-16 Thread Summer Shire
Hi All, My master and slave index version and generation is the same yet the index is not in sync because when I execute the same query on both master and slave I see old docs on slave which should not be there. I also tried to fetch a specific indexversion on slave using command=fetchindex&ind

FirstSearcher and NewSearcher only on slaves

2015-02-01 Thread Summer Shire
HI Guys, Is there way to specify the newSearchers and firstSearchers different for master vs slave ?

Re: Solr admin Url issues

2015-01-26 Thread Summer Shire
gt; in front? > > On Mon, Jan 26, 2015 at 11:02 PM, Summer Shire > wrote: > >> Hi All, >> >> Running solr (4.7.2) locally and hitting the admin page like this works >> just fine http://localhost:8983/solr/ <http://localhost:8983/solr/#># < >> h

Solr admin Url issues

2015-01-26 Thread Summer Shire
Hi All, Running solr (4.7.2) locally and hitting the admin page like this works just fine http://localhost:8983/solr/ # But on my deployment server my path is http://example.org/jetty/MyApp/1/solr/#

Re: Any way to view lucene files

2014-06-07 Thread Summer Shire
Did u try luke 47 > On Jun 6, 2014, at 11:59 PM, Aman Tandon wrote: > > I also tried with solr 4.2 and with luke version Luke 4.0.0-ALPHA > > but got this error: > java.lang.IllegalArgumentException: A SPI class of type > org.apache.lucene.codecs.Codec with name 'Lucene42' does not exist. Y

Re: Solr 4.7.2 ValueSourceParser classCast exception

2014-06-03 Thread Summer Shire
so that > the class signature (extends, implements, and constructors) matches the > Solr 4.7.2 jars? I mean, Java is simply complaining that your class is not > a valid value source class of the specified type. > > -- Jack Krupansky > > -Original Message- From: Summer Shire

Solr 4.7.2 ValueSourceParser classCast exception

2014-05-23 Thread Summer Shire
Hi All, I have my own popularity value source class and I let solr know about it via solrconfig.xml But then I get the following class cast exception I have tried to make sure there are no old Solr jar files in the classpath. Why would this be happening ? I even tried to use the lib tag

ValueSourceParser classCast exception solr 4.7.2

2014-05-22 Thread Summer Shire
Hi All, I have my own popularity value source class and I let solr know about it via solrconfig.xml But then I get the following class cast exception I have tried to make sure there are no old Solr jar files in the classpath. Why would this be happening ? org.apache.solr.common.SolrExcept

solr scoring

2014-01-28 Thread Summer Shire
Hi All, I have a scenario where for example my document titles are 1. battle of the zords 2. joes battle 3. who was in that crazy battle. and if the search term is [battle] I want to penalize the second and third document score because battle was matched further down than in the first documents

Re: Overriding DefaultSimilarity Cast Exception 4.5.1

2014-01-27 Thread Summer Shire
Hi Shawn and Chris, your inputs Helped I figured it out from all these links and also what Chris mentioned. Thanks, Summer On Jan 27, 2014, at 5:54 PM, Shawn Heisey wrote: > On 1/27/2014 5:41 PM, Summer Shire wrote: >> Caused by: java.lang.ClassCastException: .PayloadSimilarity >

Re: Overriding DefaultSimilarity Cast Exception 4.5.1

2014-01-27 Thread Summer Shire
Thanks Chris for a quick response. But I verified that I only have the following jars lucene-analyzers-common-4.5.1 lucene-core-4.5.1 lucene-queries-4.5.1 lucene-spatial-4.5.1 solr-solrj-4.5.1 they are all the same version. Also how can I verify the classpath ? Since I do not have other lucen

Overriding DefaultSimilarity Cast Exception 4.5.1

2014-01-27 Thread Summer Shire
Hi all, I am using Solr and Lucene 4.5.1 and I have a Payload Similarity that extends DefaultSimilarity my schema.xml specifies the default Similarity tag /** my similarity class**/ public class PayloadSimilarity extends DefaultSimilarity { public PayloadSimilarity(){ } @Override