Re: Using multiple language stop words in Solr Core

2021-02-11 Thread Markus Jelsma
Hell Abhay, Do not enable stopwords unless you absolutely know what you are doing. In general, it is a bad practice that somehow still lingers on. But to answer the question, you must have one field and fieldType for each language, so language specific filters go there. Also, using edismax and mu

Using multiple language stop words in Solr Core

2021-02-11 Thread Abhay Kumar
Hello Team, Solr provides some data type out of box in managed schema for different languages such as english, french, japanies etc. We are using common data type "text_general" for fields declaration and using stopwards.txt for stopword filtering.

Re: Is it possible to have different Stop words depending on the value of a field?

2019-12-04 Thread Emir Arnautović
keywords such as apartment number or the city. >> >> I am not sure if this is the right way to search for unstructured >> addresses so we are open for suggestions. >> >> Thank you >> >> -Original Message- >> From: Dave >> Sent: Monday, D

Re: Is it possible to have different Stop words depending on the value of a field?

2019-12-03 Thread Paras Lehana
ower > than keywords such as apartment number or the city. > > I am not sure if this is the right way to search for unstructured > addresses so we are open for suggestions. > > Thank you > > -Original Message- > From: Dave > Sent: Monday, December 2, 2019 7:50

RE: Is it possible to have different Stop words depending on the value of a field?

2019-12-02 Thread email
er 2, 2019 7:50 PM To: solr-user@lucene.apache.org Cc: wun...@wunderwood.org; jornfra...@gmail.com Subject: Re: Is it possible to have different Stop words depending on the value of a field? I’ll add to that since I’m up. Stopwords are in a practical sense useless and serve no purpose. It’s an

Re: Is it possible to have different Stop words depending on the value of a field?

2019-12-02 Thread Dave
something a bit more on the experimental side. If you can explain *why you think you need stop words that would be helpful in perhaps guiding you to an alternative > On Dec 2, 2019, at 7:45 PM, wrote: > > That makes sense, thank you for the clarification! > > @wun...@wunderwood

RE: Is it possible to have different Stop words depending on the value of a field?

2019-12-02 Thread email
it possible to have different Stop words depending on the value of a field? It clarifies yes. You need new fields. In this case something like Address_us Address_uk And index and search them accordingly with different stopword files used in different field types, hence the copy field from

Re: Is it possible to have different Stop words depending on the value of a field?

2019-12-02 Thread Dave
ote: > > To clarify, a document would look like this : > > { > address: "123 main Street", > country : "US" > } > > What I'd like to do when I configure my index is to apply a set of different > stop words to the address field depending o

RE: Is it possible to have different Stop words depending on the value of a field?

2019-12-02 Thread email
To clarify, a document would look like this : { address: "123 main Street", country : "US" } What I'd like to do when I configure my index is to apply a set of different stop words to the address field depending on the value of the country. For example, something

Re: Is it possible to have different Stop words depending on the value of a field?

2019-12-02 Thread Walter Underwood
The best approach is to not use stop words at all. That gives better relevance with less configuration, so it is a total win. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Dec 2, 2019, at 12:24 PM, Jörn Franke wrote: > > You can have

Re: Is it possible to have different Stop words depending on the value of a field?

2019-12-02 Thread Jörn Franke
You can have different fields by country. I am not sure about your stop words but if they are not occurring in the other languages then you have not a problem. On the other hand: it you need more than stop words (eg lemmatizing, specialized way of tokenization etc) then you need a different

Is it possible to have different Stop words depending on the value of a field?

2019-12-02 Thread yeikel valdes
Hi, I have an index that stores addresses from different countries. As every country has different stop words, I was wondering if it is possible to apply a different set of stop words depending on the value of a field.  Or do I need different indexes/do itnat the ETL step to accomplish this?

Re: shingles + stop words

2018-12-10 Thread Emir Arnautović
times " > nonstopword" > with the space being defined as the filter token. I was hoping that the > ManagedStopFilterFactory would have removed the stop words completely > before going to the shingle factory, and would have returned "nonstopword1 > nonstopword2" w

shingles + stop words

2018-12-07 Thread David Hastings
Hey there, I have a field type defined as such: but whats happening is the shingles being returned are often times " nonstopword" with the space being defined as the filter token. I was hoping that the ManagedStopFilterFactory would have removed the

Re: How to exclude stop words in spellcheck collations

2017-07-17 Thread Susheel Kumar
The field which you are using for spellcheck suggestions can utilise stopword filter factory. Thanks, Susheel On Sun, Jul 16, 2017 at 12:47 PM, Naveen Pajjuri wrote: > Hi, > Is there any way i can exclude stop words from the collations and > sugesstions from spell check component ? &g

How to exclude stop words in spellcheck collations

2017-07-16 Thread Naveen Pajjuri
Hi, Is there any way i can exclude stop words from the collations and sugesstions from spell check component ? Regards, Naveen Pajjuri.

Re: how can we use multi term search along with stop words

2016-05-27 Thread Erick Erickson
earch. >> >> >> Thanks and Regards, >> Preeti Bhat >> >> -Original Message- >> From: Ahmet Arslan [mailto:iori...@yahoo.com.INVALID] >> Sent: Thursday, May 26, 2016 10:11 PM >> To: solr-user@lucene.apache.org; sandhus...@gmail.com >> Subj

Re: how can we use multi term search along with stop words

2016-05-27 Thread Walter Underwood
ds, > Preeti Bhat > > -Original Message- > From: Ahmet Arslan [mailto:iori...@yahoo.com.INVALID] > Sent: Thursday, May 26, 2016 10:11 PM > To: solr-user@lucene.apache.org; sandhus...@gmail.com > Subject: Re: how can we use multi term search along with stop words >

Recall: how can we use multi term search along with stop words

2016-05-27 Thread Preeti Bhat
Preeti Bhat would like to recall the message, "how can we use multi term search along with stop words". NOTICE TO RECIPIENTS: This communication may contain confidential and/or privileged information. If you are not the intended recipient (or have received this communication in err

RE: how can we use multi term search along with stop words

2016-05-27 Thread Preeti Bhat
Message- From: Ahmet Arslan [mailto:iori...@yahoo.com.INVALID] Sent: Thursday, May 26, 2016 10:11 PM To: solr-user@lucene.apache.org; sandhus...@gmail.com Subject: Re: how can we use multi term search along with stop words Hi, Are you firing both trailing and leading wildcard query? Or you just put

RE: how can we use multi term search along with stop words

2016-05-27 Thread Preeti Bhat
, May 26, 2016 10:11 PM To: solr-user@lucene.apache.org; sandhus...@gmail.com Subject: Re: how can we use multi term search along with stop words Hi, Are you firing both trailing and leading wildcard query? Or you just put stars for emphasizing purposes? Please consider using normal queries, since

Re: how can we use multi term search along with stop words

2016-05-26 Thread Ahmet Arslan
iginal Message- From: Siddhartha Singh Sandhu [mailto:sandhus...@gmail.com] Sent: Thursday, May 26, 2016 6:54 PM To: solr-user@lucene.apache.org; Ahmet Arslan Subject: Re: how can we use multi term search along with stop words Hi Preeti, You can use the analysis tool in the Solr console to see how yo

RE: how can we use multi term search along with stop words

2016-05-26 Thread Preeti Bhat
sage- From: Siddhartha Singh Sandhu [mailto:sandhus...@gmail.com] Sent: Thursday, May 26, 2016 6:54 PM To: solr-user@lucene.apache.org; Ahmet Arslan Subject: Re: how can we use multi term search along with stop words Hi Preeti, You can use the analysis tool in the Solr console to see how

Re: how can we use multi term search along with stop words

2016-05-26 Thread Siddhartha Singh Sandhu
his. > > > Thanks and Regards, > Preeti Bhat > > > From: Preeti Bhat > Sent: Wednesday, May 25, 2016 2:22 PM > To: solr-user@lucene.apache.org > Subject: how can we use multi term search along with stop words > > HI, > > I am trying to search the field n

Re: how can we use multi term search along with stop words

2016-05-26 Thread Ahmet Arslan
. Thanks and Regards, Preeti Bhat From: Preeti Bhat Sent: Wednesday, May 25, 2016 2:22 PM To: solr-user@lucene.apache.org Subject: how can we use multi term search along with stop words HI, I am trying to search the field named company_nm with value "Google llc". We have the stopwo

RE: how can we use multi term search along with stop words

2016-05-26 Thread Preeti Bhat
HI All, Sorry for asking the same question again, but could someone please advise me on this. Thanks and Regards, Preeti Bhat From: Preeti Bhat Sent: Wednesday, May 25, 2016 2:22 PM To: solr-user@lucene.apache.org Subject: how can we use multi term search along with stop words HI, I am

how can we use multi term search along with stop words

2016-05-25 Thread Preeti Bhat
HI, I am trying to search the field named company_nm with value "Google llc". We have the stopword on "llc", so when I try to search it returns 0 results. Could anyone please guide me through the process of using stopwords in multi term search. Please note I am using solr 6.0.0 and using stand

Re: stop words as blacklist

2016-03-19 Thread Binoy Dalal
ocument in the indexing process? > > Or, you want to index that document, but you don't want to retrieve it if > it is queried with stop words? > > There is a KeepWordFilterFactory to detect if a document contains a > black-list word. > > To skip a certain document

Re: stop words as blacklist

2016-03-19 Thread Ahmet Arslan
Hi John, Do you want to skip that document in the indexing process? Or, you want to index that document, but you don't want to retrieve it if it is queried with stop words? There is a KeepWordFilterFactory to detect if a document contains a black-list word. To skip a certain document

stop words as blacklist

2016-03-18 Thread John Blythe
hey all, is there any out of the box way to use your stop words to completely skip a document? if something has X in its description when being indexed i just want to ignore it altogether / when something is searched with X then go ahead and automatically return 0 results. quick context: using

Re: Reloading synonyms and stop words

2013-08-23 Thread Bruno René Santos
req.getCore().getCoreDescriptor().getCoreContainer().reload(req.getCore().getName()); works like a charm :) thanx a lot Bruno On Fri, Aug 23, 2013 at 2:48 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > Actually I was suggesting that you execute the CoreAdminHandler from > within

Re: Reloading synonyms and stop words

2013-08-23 Thread Shalin Shekhar Mangar
Actually I was suggesting that you execute the CoreAdminHandler from within your handler or you can try calling CoreContainer.reload directly. On Fri, Aug 23, 2013 at 6:13 PM, Bruno René Santos wrote: > Hi again, > > Thanx for the help :) > > I have this handler: > > public class SynonymsHandler

Re: Reloading synonyms and stop words

2013-08-23 Thread Bruno René Santos
Hi again, Thanx for the help :) I have this handler: public class SynonymsHandler extends RequestHandlerBase implements SolrCoreAware { public SynonymsHandler() {} private static Logger log = LoggerFactory.getLogger(SynonymsHandler.class); @Override public void handleRequestBody(SolrQueryRequ

Re: Reloading synonyms and stop words

2013-08-23 Thread Shalin Shekhar Mangar
I don't think that should be a problem. Your custom RequestHandler must call "reload". Note that a new instance of your request handler will be created and inform will be called on it once reload happens i.e. you won't be able to keep any state in the request handler across core reloads. You can a

Re: Reloading synonyms and stop words

2013-08-23 Thread Bruno René Santos
Great! What about inside a RequestHandler source code in Java? I want to create a requestHandler that receives new synonyms, insert them on the synonyms file and reload the core. Regards Bruno On Fri, Aug 23, 2013 at 9:28 AM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > Yes, you can

Re: Reloading synonyms and stop words

2013-08-23 Thread Shalin Shekhar Mangar
Yes, you can use the Core RELOAD command: https://cwiki.apache.org/confluence/display/solr/CoreAdminHandler+Parameters+and+Usage#CoreAdminHandlerParametersandUsage-%7B%7BRELOAD%7D%7D On Fri, Aug 23, 2013 at 1:51 PM, Bruno René Santos wrote: > Hello, > > Is it possible to reload the synonyms and

Reloading synonyms and stop words

2013-08-23 Thread Bruno René Santos
Hello, Is it possible to reload the synonyms and stopwords files without rebooting solr? Regards Bruno Santos -- Bruno René Santos Lisboa - Portugal

Re: Searching for Solr Stop Words

2013-01-06 Thread Erick Erickson
Changing the schema has nothing to do with replication, replication only deals with documents that have been added/updated/deleted. So changing the schema to remove the stopword filter should be fine as you've indicated that you're OK with the old data still giving the old behavior. Best Erick O

Searching for Solr Stop Words

2013-01-05 Thread Cool Techi
On of my solr fields is configured in the following manned, This works in cases where i don't want stemming, but now there is another use case which is causing a problem, people are beginning to seach for the following combinations, T

Re: Stop Words in SpellCheckComponent

2012-06-02 Thread Matthias Müller
> Also, generally, you should have a separate field and field type for the > spellcheck field **so that normal text fields can use stop words.** Now I've found a solution, although I'm not sure, if it's that what you've meant: Now I'm using a special fiel

Re: Stop Words in SpellCheckComponent

2012-06-01 Thread Jack Krupansky
being indexed or not. Also, generally, you should have a separate field and field type for the spellcheck field so that normal text fields can use stop words. -- Jack Krupansky -Original Message- From: Matthias Müller Sent: Friday, June 01, 2012 4:51 AM To: solr-user@lucene.apache.o

Re: Stop Words in SpellCheckComponent

2012-06-01 Thread Matthias Müller
> But your most recent email referred to "stopword.txt". > > So, either add "the" to german_stop_long.txt, or change the "words" option > of your stopfilter to refer to "stopwords.txt". Sorry for that confusion: The stopfilter refers to the stopwords.txt Now I'm just talking about the solr exampl

Re: Stop Words in SpellCheckComponent

2012-05-31 Thread Jack Krupansky
riday, June 01, 2012 1:44 AM To: solr-user@lucene.apache.org Subject: Re: Stop Words in SpellCheckComponent spellcheck_de That should reference a field, not a field type. Thanks for your help. But I did that, too. Here I'll show that even the solr example webapp makes suggestions for

Re: Stop Words in SpellCheckComponent

2012-05-31 Thread Matthias Müller
> spellcheck_de > > That should reference a field, not a field type. Thanks for your help. But I did that, too. Here I'll show that even the solr example webapp makes suggestions for stopwords: I've ... 1. added "the" to the stopwords.txt 2. added "thex" to an example document (field name) 3. st

Re: Stop Words in SpellCheckComponent

2012-05-31 Thread Jack Krupansky
-user@lucene.apache.org Subject: Re: Stop Words in SpellCheckComponent is it possible to configure a stopword list to the SpellCheckComponent? Add a stopwordfilter to your spellcheck field. Hmm, I did. Could it be another mistake? This is the schema definition

Re: Stop Words in SpellCheckComponent

2012-05-31 Thread Matthias Müller
>> is it possible to configure a stopword list to the SpellCheckComponent? > Add a stopwordfilter to your spellcheck field. Hmm, I did. Could it be another mistake? This is the schema definition: This is the solrconfig:

RE: Stop Words in SpellCheckComponent

2012-05-31 Thread Markus Jelsma
Add a stopwordfilter to your spellcheck field. -Original message- > From:Matthias Müller > Sent: Thu 31-May-2012 18:39 > To: solr-user@lucene.apache.org > Subject: Stop Words in SpellCheckComponent > > Hi, > > is it possible to configure a stopword list to

Stop Words in SpellCheckComponent

2012-05-31 Thread Matthias Müller
Hi, is it possible to configure a stopword list to the SpellCheckComponent? For example: When searching for "the indexs" "the" is filtered, because it is a stopword. The SpellCheckComponent gives me a false suggestion for "the". But the SpellCheckComponent should only give a suggestion for "index

Highlighting to include stop words

2011-12-08 Thread Robert Brown
I have a text field, using stopwords... Index and query analysers setup as follows: SynonymFilterFactory StopFilterFactory WordDelimiterFilterFactory LowerCaseFilterFactory SnowballPorterFilterFactory Searching for "front of house" brings back perfect matches, but doesn't highlight the "of".

Re: Problem using stop words

2011-08-25 Thread Erick Erickson
op2.txt" >                enablePositionIncrements="true" >                /> >         generateWordParts="1" generateNumberParts="1" catenateWords="0" > catenateNumbers="0" catenateAll="0" splitOnCaseChange="0"/> >         >         >   > > The solrconfig.xml file: > >   >     >      true >     >     >      terms >     >   > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Problem-using-stop-words-tp3274598p3280291.html > Sent from the Solr - User mailing list archive at Nabble.com. >

Re: Problem using stop words

2011-08-24 Thread Lance Norskog
g file. > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Problem-using-stop-words-tp3274598p3280319.html > Sent from the Solr - User mailing list archive at Nabble.com. > -- Lance Norskog goks...@gmail.com

Re: Problem using stop words

2011-08-24 Thread _snake_
I forgot to say that my stopwords file is in the same location as the schema file and the solrconfig file. -- View this message in context: http://lucene.472066.n3.nabble.com/Problem-using-stop-words-tp3274598p3280319.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Problem using stop words

2011-08-24 Thread _snake_
s -- View this message in context: http://lucene.472066.n3.nabble.com/Problem-using-stop-words-tp3274598p3280291.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Problem using stop words

2011-08-22 Thread Alexei Martchenko
of it. The stopwords file format is usually just one > >>> word per line..... > >>> > >>> I'm assuming your name of "string" for the field type is just a > >>> placeholder &g

Re: Problem using stop words

2011-08-22 Thread Erick Erickson
t is usually just one >>> word per line. >>> >>> I'm assuming your name of "string" for the field type is just a >>> placeholder >>> or you've replaced the example "string" fieldType, right? >>> >>> >>> Bes

Re: Problem using stop words

2011-08-22 Thread Alexei Martchenko
uot;string" fieldType, right? >> >> >> Best >> Erick >> >> On Mon, Aug 22, 2011 at 6:24 AM, Lucas Miguez >> wrote: >> > Hi, >> > >> > I am trying to use spanish stop words, but the stop words are not >> working: &

Re: Problem using stop words

2011-08-22 Thread Alexei Martchenko
ur name of "string" for the field type is just a placeholder > or you've replaced the example "string" fieldType, right? > > > Best > Erick > > On Mon, Aug 22, 2011 at 6:24 AM, Lucas Miguez > wrote: > > Hi, > > > > I am trying

Re: Problem using stop words

2011-08-22 Thread Erick Erickson
s just a placeholder or you've replaced the example "string" fieldType, right? Best Erick On Mon, Aug 22, 2011 at 6:24 AM, Lucas Miguez wrote: > Hi, > > I am trying to use spanish stop words, but the stop words are not working: > > Part of the schema.xml file: > &g

Problem using stop words

2011-08-22 Thread Lucas Miguez
Hi, I am trying to use spanish stop words, but the stop words are not working: Part of the schema.xml file

Re: Any way to get back search query with parsed out stop words

2011-02-15 Thread Tanner Postert
ok, I will look at using that filter factory on my content. But I was also looking at the stop filter number so I could adjust my mm parameter based on the number of non-stopwords in the search parameter so I don't run into the dismax stopword issue. any way around that other than using a very low

Re: Any way to get back search query with parsed out stop words

2011-02-15 Thread Ahmet Arslan
> I am trying to only get back the natural searched terms so > I can highlight > them in the returned search results. I know that solr has > built in > highlighting capability, but I can't use it because some of > the fields > contain HTML themselves and I need to strip it all out when > I display

Any way to get back search query with parsed out stop words

2011-02-15 Thread Tanner Postert
I am trying to see if there is a way to get back the resulting search'd query to solr excluding the stopwords. Right now when I search for: "the year in review" i can see in the debug that the parsed query contains: text:"? year ? review" but that information is mixed in with all the parsed boosti

Re: Consulting in Solr tuning, stop words, dictionary, etc

2010-10-31 Thread Dennis Gearon
g=nl.e036' EARTH has a Right To Life, otherwise we all die. --- On Sat, 10/30/10, Erick Erickson wrote: > From: Erick Erickson > Subject: Re: Consulting in Solr tuning, stop words, dictionary, etc > To: solr-user@lucene.apache.org > Date: Saturday, October 30, 2010, 6:59 PM &

Re: Consulting in Solr tuning, stop words, dictionary, etc

2010-10-30 Thread Erick Erickson
Well, that all depends on what you want. Here's a list of Solr consultants. http://wiki.apache.org/solr/Support HTH Erick On Thu, Oct 28, 2010 at 4:21 PM, Dennis Gearon wrote: > Speaking of jobs on this list . . . . > > How much does a good consultant fo

Consulting in Solr tuning, stop words, dictionary, etc

2010-10-28 Thread Dennis Gearon
Speaking of jobs on this list . . . . How much does a good consultant for Solr work cost? I am interested first in English, but then in other languages around the world. Just need budgetary amounts for a business plan. 1-6mos, or till BIG DOLLARS, whichever comes first ;-) Dennis Gearon Sig

Re: dynamic "stop" words?

2010-10-13 Thread Matt Mitchell
Great, thanks Hoss. I'll try dismax out today and see what happens with this. Matt On Tue, Oct 12, 2010 at 7:35 PM, Chris Hostetter wrote: > > : Is it possible to have certain query terms not effect score, if that > : same query term is present in a field? For example, I have an index of > > tha

Re: dynamic "stop" words?

2010-10-12 Thread Chris Hostetter
: Is it possible to have certain query terms not effect score, if that : same query term is present in a field? For example, I have an index of that use case is precisely what the DisjunctionMaxQuery (generated by the dismax parser) does for you if you set the "tie" param to "0" when one of the

Re: dynamic "stop" words?

2010-10-12 Thread Matt Mitchell
; Doc 2 > name => "Holiday Inn,  Denver" > name_search => "Holiday Inn" > city => "Denver" > > Jonathan > > > From: Matt Mitchell [goodie...@gmail.com] > Sent: Tuesday, October 12, 2010 9:24 AM > To:

RE: dynamic "stop" words?

2010-10-12 Thread Jonathan Rochkind
om: Matt Mitchell [goodie...@gmail.com] Sent: Tuesday, October 12, 2010 9:24 AM To: solr-user@lucene.apache.org Subject: Re: dynamic "stop" words? Thanks for the feedback. I thought about stop words but since I have a lot of documents spanning lots of different countries, I won't know all of t

Re: dynamic "stop" words?

2010-10-12 Thread Matt Mitchell
Thanks for the feedback. I thought about stop words but since I have a lot of documents spanning lots of different countries, I won't know all of the possible cities so stop-words could get hard to manage. Also, the city name is in the same field. I think I might try creating a new field c

Re: dynamic "stop" words?

2010-10-09 Thread Geert-Jan Brits
is > > Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch > Lucene ecosystem search :: http://search-lucene.com/ > > > > - Original Message > > From: Matt Mitchell > > To: solr-user@lucene.apache.org > > Sent: Fri, October 8, 2010 11:22:36 AM > >

Re: dynamic "stop" words?

2010-10-08 Thread Otis Gospodnetic
Message > From: Matt Mitchell > To: solr-user@lucene.apache.org > Sent: Fri, October 8, 2010 11:22:36 AM > Subject: dynamic "stop" words? > > Is it possible to have certain query terms not effect score, if that > same query term is present in a field?

dynamic "stop" words?

2010-10-08 Thread Matt Mitchell
#x27;t want Doc2 to have a higher score, just because it has all of the query terms. Is this possible without using stop words? I hope this makes sense! Thanks, Matt

Re: Stop words

2010-03-20 Thread Ahmet Arslan
> if i hide the class="solr.StopFilterFactory"  ignoreCase="true" > words="stopwords.txt" enablePositionIncrements="true"/> > it will work. then > how can i get the "this is it" with out hide > solr.StopFilterFactory ... any > solution One solution can be using CommonGramsFilterFactory [1] inste

Stop words

2010-03-20 Thread Suram
Hi all, My index file field name="this is it", but am trying search,it would not found if i hide the it will work. then how can i get the "this is it" with out hide solr.StopFilterFactory ... any solution -- View this message in context: http://old.n

Re: stop words make dismax fail

2010-02-24 Thread Ahmet Arslan
> The problem is that when a user enters a query like 'meet > the president', zero results are returned. I imagine it has > something to do with 'the' being stripped out, then only 2 > of the 3 terms matching. As a temporary workaround I set > minshouldmatch to 1 so I do get results. That causes ot

stop words make dismax fail

2010-02-24 Thread Nagelberg, Kallin
I'm having a problem when users enter stopwords in their query. I'm using a dismax request handler against a field setup like:

Re: Applying Stop words for Field Type String

2008-09-30 Thread Chris Hostetter
an then use the StopWordFilterFactory to throw out values which are stop words. The stored value for a TextField and a StrField are returned to clients in exactly the same way. -Hoss

Applying Stop words for Field Type String

2008-09-29 Thread payalsharma
We have the facility of applying stop words for Field Type text during Query analyzer in schema.xml as shown below

Re: Stop words and exact phrase

2008-05-14 Thread Walter Underwood
he query - its got nothing to do > with the indexing imo. > > If indexing has removed the stop words then I should not get any results > right? But I get the results with the stop word removed. > > How do I tell Solr to send phrase queries to a field other than defau

Re: Stop words and exact phrase

2008-05-14 Thread Otis Gospodnetic
, May 14, 2008 1:54:15 PM > Subject: Re: Stop words and exact phrase > > > Hi wunder, > > Thanks for your response. I am still a little confused. Solr's analysis page > shows that the stop word is removed from the query - its got nothing to do > with the indexing imo. >

Re: Stop words and exact phrase

2008-05-14 Thread cricdigs
Hi wunder, Thanks for your response. I am still a little confused. Solr's analysis page shows that the stop word is removed from the query - its got nothing to do with the indexing imo. If indexing has removed the stop words then I should not get any results right? But I get the results

Re: Stop words and exact phrase

2008-05-14 Thread Walter Underwood
exact" field has a higher boost. This helps with movies like "Saw" and "Ran", which should not show "see" or "run" as the top match. wunder On 5/14/08 8:09 AM, "cricdigs" <[EMAIL PROTECTED]> wrote: > > Hi all, > > Is there a

Stop words and exact phrase

2008-05-14 Thread cricdigs
Hi all, Is there a config setting that I could use to not remove stop words when doing an exact phrase match. For example when searching for "the world" (in quotes) I would like to look for just that and not get results for just "world". When I look at the analysis, I se

Re: Making stop-words optional with DisMax?

2008-03-28 Thread Chris Hostetter
ot;-" in front of it), that's where the mm param comes in, it decides how many of those optional params should be mandatory. it sounds like what you want is for a new DisMaxOptional parser to look at this... on mice and men and because it knows "on" and "and" ar

Re: Making stop-words optional with DisMax?

2008-03-27 Thread Ronald K. Braun
nction words (articles and prepositions) seem to be the ones that folks either omit or confuse, so they'd be good candidates. > start by hitting Solr using a qf with fields that contain stop words. if > you get 0 hits, then query with a qf that contains all fields that don't > have

Re: Making stop-words optional with DisMax?

2008-03-27 Thread Ronald K. Braun
s less so but still present in the results set. The main problem is getting past the qf parm such that we don't have invisible titles (stop-words removed by the qf pipeine leaving an empty query) or over-specified generated queries (where stop-words turn out to be required but can't m

Re: Making stop-words optional with DisMax?

2008-03-27 Thread Otis Gospodnetic
If you have "doors" in your index and a person enters: "the doors", why not just drop stop-words at query time? If a person searches for "music by the doors" and you have "music doors" in the index and really uses quotes to get the exact phrase, you can t

Re: Making stop-words optional with DisMax?

2008-03-27 Thread Chris Hostetter
g the problem) the best suggestion i can give is one that i usually discourage: execute multiple queries. start by hitting Solr using a qf with fields that contain stop words. if you get 0 hits, then query with a qf that contains all fields that don't have stop words in them, (but you c

Re: Making stop-words optional with DisMax?

2008-03-26 Thread Walter Underwood
, but it is hard to argue with 32 million clicks. wunder On 3/26/08 6:05 PM, "Ronald K. Braun" <[EMAIL PROTECTED]> wrote: > Hi Otis, > >> I skimmed your email. You are indexing book and music titles. Those tend to >> be short. >> Do you really benef

Re: Making stop-words optional with DisMax?

2008-03-26 Thread Ronald K. Braun
Hi Otis, > I skimmed your email. You are indexing book and music titles. Those tend to > be short. > Do you really benefit from removing stop words in the first place? I'd try > keeping all the stop > words and seeing if that has any negative side-effects in your conte

Re: Making stop-words optional with DisMax?

2008-03-26 Thread Otis Gospodnetic
Hi Ron,, I skimmed your email. You are indexing book and music titles. Those tend to be short. Do you really benefit from removing stop words in the first place? I'd try keeping all the stop words and seeing if that has any negative side-effects in your context. Otis -- Sematext --

Making stop-words optional with DisMax?

2008-03-26 Thread Ronald K. Braun
). We are using DisMax, and indexing media titles (books, music). We want our queries to be sensitive to stop-words, but not so sensitive that we fail to match on missing or incorrect stop-words. For example, here are a set of queries and desired behavior: * it -> matches It by steven king (h

Re: common words not stop words?? how to ??

2007-02-19 Thread rubdabadub
Walter: Thanks for the feedback. On 2/19/07, Walter Underwood <[EMAIL PROTECTED]> wrote: Lucene/Solr does this automatically. That is how a tf.idf engine works, it boosts rare words. Do you have examples of problems or are you worrying about something that might happen? Actually my use case

Re: common words not stop words?? how to ??

2007-02-19 Thread Walter Underwood
ondering how are you guys dealing with "common words"? What I > mean by common words is the ones that fall outside the "stop words" > category. Offcourse "stop words" is subjective i.e. its up to the > implementor. What I would like to do is how do i increase

common words not stop words?? how to ??

2007-02-19 Thread rubdabadub
Hi: I was wondering how are you guys dealing with "common words"? What I mean by common words is the ones that fall outside the "stop words" category. Offcourse "stop words" is subjective i.e. its up to the implementor. What I would like to do is how do i increase