RE: Question on Reverse Indexing

2012-01-21 Thread Michael Ryan
> Can this be the reason why it is working automatically although there are no > reversed tokens being stored and even without the > ReversedWildcardFilterFactory being set, solr automatically is allowing > leading wild card search? Yes, that's correct. See https://issues.apache.org/jira/browse

RE: Question on Reverse Indexing

2012-01-20 Thread Shyam Bhaskaran
ubject: Re: Question on Reverse Indexing Shyam, The thing is that in order to use the leading wildcard, you don't necessarily need to use ReversedWildcardFilterFactory, there is another way to do this, which was turned off by default due to its inefficiency for the case of big term dictionaries. N

Re: Question on Reverse Indexing

2012-01-20 Thread Dmitry Kan
nt: Thursday, January 19, 2012 5:57 PM > To: solr-user@lucene.apache.org > Subject: Re: Question on Reverse Indexing > > A quick immediate observation: > > first in the analysis and query chains you have some customer tokenizer > factory. Could it, by some chance, affect on the

RE: Question on Reverse Indexing

2012-01-19 Thread Shyam Bhaskaran
inal Message- From: Dmitry Kan [mailto:dmitry@gmail.com] Sent: Thursday, January 19, 2012 5:57 PM To: solr-user@lucene.apache.org Subject: Re: Question on Reverse Indexing A quick immediate observation: first in the analysis and query chains you have some customer tokenizer factory. Could it

Re: Question on Reverse Indexing

2012-01-19 Thread Dmitry Kan
>stored="true" multiValued="true" termVectors="true" termPositions="true" > termOffsets="true" /> >multiValued="false" /> > stored="true" multiValued="true" /> > > > > Excerpt

RE: Question on Reverse Indexing

2012-01-19 Thread Shyam Bhaskaran
title^15.0 indexed_content^1.0 attachment_titles^5.0 attachment_bodies^1.0 -Shyam -Original Message- From: Dmitry Kan [mailto:dmitry@gmail.com] Sent: Thursday, January 19, 2012 4:20 PM To: solr-user@lucene.apache.org Subject: Re: Question on Reverse Indexing

Re: Question on Reverse Indexing

2012-01-19 Thread Dmitry Kan
C:\solr\home\data\docs_index\index\ > > We are using Solr 4.0 > > -Shyam > > -Original Message- > From: Shyam Bhaskaran [mailto:shyam.bhaska...@synopsys.com] > Sent: Thursday, January 19, 2012 11:49 AM > To: solr-user@lucene.apache.org > Subject: RE: Quest

RE: Question on Reverse Indexing

2012-01-18 Thread Shyam Bhaskaran
C:\lukeall-3.5.0.jar org.getopt.luke.Luke -index C:\solr\home\data\docs_index\index\ We are using Solr 4.0 -Shyam -Original Message- From: Shyam Bhaskaran [mailto:shyam.bhaska...@synopsys.com] Sent: Thursday, January 19, 2012 11:49 AM To: solr-user@lucene.apache.org Subject: RE: Question on Rever

RE: Question on Reverse Indexing

2012-01-18 Thread Shyam Bhaskaran
6:29 AM To: solr-user@lucene.apache.org Subject: RE: Question on Reverse Indexing Dimitry, Completed a clean index and I still see the same behavior. Did not use Luke but from the search page we use leading wild card search is working. -Shyam -Original Message- From: Dmitry Kan

RE: Question on Reverse Indexing

2012-01-18 Thread Shyam Bhaskaran
@lucene.apache.org Subject: Re: Question on Reverse Indexing Shyam, You still didn't say if you have started re-indexing from the clean index, i.e. if you have removed all the data prior to re-indexing. You can use the luke (http://code.google.com/p/luke/) to check the contents of your text

Re: Question on Reverse Indexing

2012-01-18 Thread Dmitry Kan
>maxPosAsterisk="3" maxPosQuestion="2" > maxFractionAsterisk="0.33"/> > and the whole collection was re-indexed. > > But even after removing the ReversedWildcardFilterFactory leading wild > card search like *lock is working. > > -S

RE: Question on Reverse Indexing

2012-01-18 Thread Shyam Bhaskaran
January 18, 2012 4:26 PM To: solr-user@lucene.apache.org Subject: Re: Question on Reverse Indexing OK. Not sure what is your system architecture there, but could your queries stay cached in some server caches even after you have re-indexed your data? The way the index level leading wildcard works (re

Re: Question on Reverse Indexing

2012-01-18 Thread Dmitry Kan
[mailto:dmitry@gmail.com] > Sent: Wednesday, January 18, 2012 2:26 PM > To: solr-user@lucene.apache.org > Subject: Re: Question on Reverse Indexing > > Just to play safe here, can you double check that the reversing is not any > more the case by issuing a query through the admin anal

RE: Question on Reverse Indexing

2012-01-18 Thread Shyam Bhaskaran
: Wednesday, January 18, 2012 2:26 PM To: solr-user@lucene.apache.org Subject: Re: Question on Reverse Indexing Just to play safe here, can you double check that the reversing is not any more the case by issuing a query through the admin analysis page? Dmitry On Wed, Jan 18, 2012 at 4:23 AM, Shyam

Re: Question on Reverse Indexing

2012-01-18 Thread Dmitry Kan
day, January 18, 2012 7:49 AM > To: solr-user@lucene.apache.org > Subject: Re: Question on Reverse Indexing > > Using ReversedWildcardFilterFactory will double the size of your > dictionary (more or less), maybe the drop in performance that you are > seeing is a result of th

RE: Question on Reverse Indexing

2012-01-17 Thread Shyam Bhaskaran
To: solr-user@lucene.apache.org Subject: Re: Question on Reverse Indexing Using ReversedWildcardFilterFactory will double the size of your dictionary (more or less), maybe the drop in performance that you are seeing is a result of that? François On Jan 17, 2012, at 9:01 PM, Shyam Bhaskaran

Re: Question on Reverse Indexing

2012-01-17 Thread François Schiettecatte
Using ReversedWildcardFilterFactory will double the size of your dictionary (more or less), maybe the drop in performance that you are seeing is a result of that? François On Jan 17, 2012, at 9:01 PM, Shyam Bhaskaran wrote: > Hi, > > For reverse indexing we are using the ReversedWildcardFilte

Question on Reverse Indexing

2012-01-17 Thread Shyam Bhaskaran
Hi, For reverse indexing we are using the ReversedWildcardFilterFactory on Solr 4.0 ReversedWildcardFilterFactory was helping us to perform leading wild card searches like *lock. But it was observed that the performance of the searches was not good after introducing ReversedWildcardFilterF