Re: Why use a different analyzer for "index" and "query"?

2020-09-10 Thread Tim Casey
ely see HTML in queries, but we never know when > someone will get clever with the source text, sigh. > > wunder > Walter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > On Sep 10, 2020, at 9:48 AM, Erick Erickson > wrote: > >

Re: Why use a different analyzer for "index" and "query"?

2020-09-10 Thread Walter Underwood
son wrote: > > When you want to do something different and index and query time. There, an > answer that’s almost, but not quite, completely useless while being accurate > ;) > > A concrete example is synonyms as have been mentioned. Say you have an > index-time synon

Re: Why use a different analyzer for "index" and "query"?

2020-09-10 Thread Erick Erickson
When you want to do something different and index and query time. There, an answer that’s almost, but not quite, completely useless while being accurate ;) A concrete example is synonyms as have been mentioned. Say you have an index-time synonym definition of A,B,C These three tokens will be

Re: Why use a different analyzer for "index" and "query"?

2020-09-10 Thread Stavros Macrakis
gt; > > > Why would one want to not use the same logic for both and simply use: > > positionIncrementGap="100"> > > > > > > What are real word use cases to use a different analyzer for index and > query? > > Thanks, > > Steve >

Re: Why use a different analyzer for "index" and "query"?

2020-09-10 Thread Alexandre Rafalovitch
; Why would one want to not use the same logic for both and simply use: > > positionIncrementGap="100"> > > > > > > What are real word use cases to use a different analyzer for index and > query? > > Thanks, > > Steve

Re: Why use a different analyzer for "index" and "query"?

2020-09-10 Thread Thomas Corthals
> > > > > > Why would one want to not use the same logic for both and simply use: > > positionIncrementGap="100"> > > > > > > What are real word use cases to use a different analyzer for index and > query? > > Thanks, > > Steve >

RE: Why use a different analyzer for "index" and "query"?

2020-09-10 Thread Dunham-Wilkie, Mike CITZ:EX
. Google "solr synonyms index vs query" Mike -Original Message- From: Steven White Sent: September 10, 2020 8:19 AM To: solr-user@lucene.apache.org Subject: Why use a different analyzer for "index" and "query"? [EXTERNAL] This email came from an external sou

Why use a different analyzer for "index" and "query"?

2020-09-10 Thread Steven White
logic for both and simply use: What are real word use cases to use a different analyzer for index and query? Thanks, Steve

Re: Is Running the Same Filters on Index and Query Redundant?

2018-08-15 Thread Erick Erickson
Thomas: If you go to the admin UI, pick a collection (or core) and go to the "analysis" page. Put different values in the "index" and "query" entry boxes. Sometimes a picture is worth a thousand words ;). And, indeed, synonyms are one of the prime filters that a

Re: Is Running the Same Filters on Index and Query Redundant?

2018-08-15 Thread Andrea Gazzarini
tags. Best, Andrea On 15/08/18 20:43, Zimmermann, Thomas wrote: Hi, We have the text field below configured on fields that are both stored and indexed. It seems to me that applying the same filters on both index and query would be redundant, and perhaps a waste of processing on the retrieval

Re: Is Running the Same Filters on Index and Query Redundant?

2018-08-15 Thread Zimmermann, Thomas
ime >I can't imagine a scenario where the user inputs queries containing HTML >tags. > >Best, >Andrea > >On 15/08/18 20:43, Zimmermann, Thomas wrote: >> Hi, >> >> We have the text field below configured on fields that are both stored >>and indexed. It see

Re: Is Running the Same Filters on Index and Query Redundant?

2018-08-15 Thread Andrea Gazzarini
query time I can't imagine a scenario where the user inputs queries containing HTML tags. Best, Andrea On 15/08/18 20:43, Zimmermann, Thomas wrote: Hi, We have the text field below configured on fields that are both stored and indexed. It seems to me that applying the same filter

Is Running the Same Filters on Index and Query Redundant?

2018-08-15 Thread Zimmermann, Thomas
Hi, We have the text field below configured on fields that are both stored and indexed. It seems to me that applying the same filters on both index and query would be redundant, and perhaps a waste of processing on the retrieval side if the filter work was already done on the index side. Is

Re: Index and query time suggester behavior in a SolrCloud environment

2017-04-20 Thread Shalin Shekhar Mangar
I also opened https://issues.apache.org/jira/browse/SOLR-10532 to fix this annoying and confusing behavior of SuggestComponent. On Thu, Apr 20, 2017 at 8:40 PM, Andrea Gazzarini wrote: > Ah great, many thanks again! > > > > On 20/04/17 17:09, Shalin Shekhar Mangar wrote: >> >> Hi Andrea, >> >> Lo

Re: Index and query time suggester behavior in a SolrCloud environment

2017-04-20 Thread Andrea Gazzarini
Ah great, many thanks again! On 20/04/17 17:09, Shalin Shekhar Mangar wrote: Hi Andrea, Looks like I have you some bad information. I looked at the code and ran a test locally. The suggest.build and suggest.reload params are in fact distributed across to all shards but only to one replica of e

Re: Index and query time suggester behavior in a SolrCloud environment

2017-04-20 Thread Shalin Shekhar Mangar
Hi Andrea, Looks like I have you some bad information. I looked at the code and ran a test locally. The suggest.build and suggest.reload params are in fact distributed across to all shards but only to one replica of each shard. This is still bad enough and you should use buildOnOptimize as suggest

Re: Index and query time suggester behavior in a SolrCloud environment

2017-04-20 Thread Andrea Gazzarini
Perfect, I don't need NRT at this moment so that fits perfectly Thanks, Andrea On 20/04/17 14:37, Shalin Shekhar Mangar wrote: Yeah, if it is just once a day then you can afford to do an optimize. For a more NRT indexing approach, I wouldn't recommend optimize at all. On Thu, Apr 20, 2017 at 5

Re: Index and query time suggester behavior in a SolrCloud environment

2017-04-20 Thread Shalin Shekhar Mangar
Yeah, if it is just once a day then you can afford to do an optimize. For a more NRT indexing approach, I wouldn't recommend optimize at all. On Thu, Apr 20, 2017 at 5:29 PM, Andrea Gazzarini wrote: > Ok, many thanks > > I see / read that it should be better to rely on the background merging > in

Re: Index and query time suggester behavior in a SolrCloud environment

2017-04-20 Thread Andrea Gazzarini
Ok, many thanks I see / read that it should be better to rely on the background merging instead of issuing explicit optimizes, but I think in this case one optimize in a day it shouldn't be a problem. Did I get you correctly? Thanks again, Andrea On 20/04/17 13:17, Shalin Shekhar Mangar wro

Re: Index and query time suggester behavior in a SolrCloud environment

2017-04-20 Thread Shalin Shekhar Mangar
On Thu, Apr 20, 2017 at 4:27 PM, Andrea Gazzarini wrote: > Hi Shalin, > many thanks for your response. This is my scenario: > > * I build my index once in a day, it could be a delta or a full >re-index.In any case, that takes some time; > * I have an auto-commit (hard, no soft-commits) set t

Re: Index and query time suggester behavior in a SolrCloud environment

2017-04-20 Thread Andrea Gazzarini
Hi Shalin, many thanks for your response. This is my scenario: * I build my index once in a day, it could be a delta or a full re-index.In any case, that takes some time; * I have an auto-commit (hard, no soft-commits) set to a given period and during the indexing cycle, several hard comm

Re: Index and query time suggester behavior in a SolrCloud environment

2017-04-20 Thread Shalin Shekhar Mangar
Comments inline: On Wed, Apr 19, 2017 at 2:46 PM, Andrea Gazzarini wrote: > Hi, > any help out there? > > BTW I forgot the Solr version: 6.5.0 > > Thanks, > Andrea > > > On 18/04/17 11:45, Andrea Gazzarini wrote: >> >> Hi, >> I have a project, with SolrCloud, where I'm going to use the Suggester

Re: Index and query time suggester behavior in a SolrCloud environment

2017-04-19 Thread Andrea Gazzarini
Hi, any help out there? BTW I forgot the Solr version: 6.5.0 Thanks, Andrea On 18/04/17 11:45, Andrea Gazzarini wrote: Hi, I have a project, with SolrCloud, where I'm going to use the Suggester component (BlendedInfixLookupFactory with DocumentDictionaryFactory). Some info: * I will have

Index and query time suggester behavior in a SolrCloud environment

2017-04-18 Thread Andrea Gazzarini
Hi, I have a project, with SolrCloud, where I'm going to use the Suggester component (BlendedInfixLookupFactory with DocumentDictionaryFactory). Some info: * I will have a suggest-only collection, with no NRT requirements (indexes will be updated with a daily frequency) * I'm not yet sure

Re: Index and query

2017-03-15 Thread rangeli nepal
Thank you. I like both option XSLT and mapping rules. Would you please provide some pointers to it? so that I can use it. Thanks again. Regards, rn On Wed, Mar 15, 2017 at 1:37 PM, Alexandre Rafalovitch wrote: > Additionally, > > Solr can index arbitrary XML by applying an XSLT transform to it

Re: Index and query

2017-03-15 Thread rangeli nepal
Would you please elaborate the 1> I guess you are saying add an attribute in managed-schema that is stored only. i.e While posting the doc provide the location of file with loc attribute? Thanks again. Regards, rn On Wed, Mar 15, 2017 at 2:24 PM, Erick Erickson wrote: > bq: How original docu

Re: Index and query

2017-03-15 Thread Alexandre Rafalovitch
Additionally, Solr can index arbitrary XML by applying an XSLT transform to it before indexing. But you still need to write the XSLT transform. Solr can also index arbitrary XML with DataImportHandler by pulling out specific fields. But you need to write mapping rules. I am not sure what exactly

Re: Index and query

2017-03-15 Thread Erick Erickson
bq: How original document X will be returned? Should I store location of X in Tx? I s there a generic way of doing it? A couple of choices here: 1> create a stored-only field (i.e. stored="true" indexed="false" docValues="false") and stuff the original in that. It'll chew up some disk space, but

Re: Index and query

2017-03-15 Thread Walter Underwood
Solr does not index XML. Period. Solr uses an XML protocol for indexing. It can also use JSON or binary protocols for indexing. You need to convert your XML document into fields, then send those fields to Solr using one of the indexing protocols. If you need an XML database and search engine,

Re: Index and query

2017-03-15 Thread rangeli nepal
Thank you Erick for such a prompt reply. I am bit confused. Suppose I have a document X, I transformed it document Tx. Tx matches the format that you have described. I post Tx and I asume it get indexed. Now I query. How original document X will be returned? Should I store location of X in Tx?

Re: Index and query

2017-03-15 Thread Erick Erickson
Solr does _not_ index arbitrary XML, it will index XML in a very specific format, i.e. value . . So if you're sending arbitrary XML to Solr I'm actually surprised it's indexing. You might be able to do something with sending docs through Tika (ExtractingRequestHandler).

Index and query

2017-03-15 Thread rangeli nepal
Good Afternoon, I am trying to index xml documents and query them. Once query successfully matches, I am hoping to download the uploaded and indexed xml document. Initially I thought solr supports xml. Thus I did not make any change to my default installation. However I was not able to query wi

Re: Index and query brackets

2016-07-18 Thread Anil
_name}[ DATA ] > > > https://cwiki.apache.org/confluence/display/solr/Other+Parsers > > > : Date: Tue, 5 Jul 2016 08:45:57 +0530 > : From: Anil > : Reply-To: solr-user@lucene.apache.org > : To: solr-user@lucene.apache.org > : Subject: Re: Index and query brackets

Re: Index and query brackets

2016-07-18 Thread Chris Hostetter
: Date: Tue, 5 Jul 2016 08:45:57 +0530 : From: Anil : Reply-To: solr-user@lucene.apache.org : To: solr-user@lucene.apache.org : Subject: Re: Index and query brackets : : NO Ediwin. Thanks for your response. : : i was checking how to check [1 TO 5] as a content not as a range query. : : i tried by

Re: Index and query brackets

2016-07-04 Thread Anil
; Are you referring to something like q=level:[1 TO 5] ? This will search for > level that ranges from 1 to 5. > You may refer to the documentation here: > https://wiki.apache.org/solr/SolrQuerySyntax > > Regards, > Edwin > > > On 4 July 2016 at 15:05, Anil wrote: >

Re: Index and query brackets

2016-07-04 Thread Zheng Lin Edwin Yeo
Hi Anil, Are you referring to something like q=level:[1 TO 5] ? This will search for level that ranges from 1 to 5. You may refer to the documentation here: https://wiki.apache.org/solr/SolrQuerySyntax Regards, Edwin On 4 July 2016 at 15:05, Anil wrote: > HI, > > how can index

Index and query brackets

2016-07-04 Thread Anil
HI, how can index and query content with brackets as bracket is used for range query Ex : [DATA] - Anil

Re: how to index and query newly added filed

2015-05-15 Thread Erick Erickson
added one new field 'startPrice'. i am > selecting that filed but it is not coming in response. what would be the > probme, > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/how-to-index-and-query-newly-added-filed-tp4205595.html > Sent from the Solr - User mailing list archive at Nabble.com.

how to index and query newly added filed

2015-05-15 Thread pradeep
66.n3.nabble.com/how-to-index-and-query-newly-added-filed-tp4205595.html Sent from the Solr - User mailing list archive at Nabble.com.

Define index and query with many delimiter

2013-12-31 Thread dtphat
;hello", "world"} instead of index {"hello_world"}. I search on internet and I see types="wdfftypes.txt", but I don't know how to define delimiter in types="wdfftypes.txt". Help me solve this problem! - Phat T. Dong -- View this message in

Re: Best practice to index and query SolrCloud

2013-09-24 Thread shamik
Thanks for the insight Shawn, extremely helpful. Appreciate it. -- View this message in context: http://lucene.472066.n3.nabble.com/Best-practice-to-index-and-query-SolrCloud-tp4091823p4091836.html Sent from the Solr - User mailing list archive at Nabble.com.

Best practice to index and query SolrCloud

2013-09-24 Thread shamik
nclude all four server information. But then any change in the server configuration will have an impact.Any help will be appreciated.Regards,Shamik -- View this message in context: http://lucene.472066.n3.nabble.com/Best-practice-to-index-and-query-SolrCloud-tp4091817.html Sent from the Solr - Us

Re: Best practice to index and query SolrCloud

2013-09-24 Thread Shawn Heisey
On 9/24/2013 2:46 PM, Shamik Bandopadhyay wrote: Now, I'm using SolrJ client (CloudSolrServer) to send documents for indexing. Based on SolrCloud fundamentals, I can send the document to any of the four servers or to a specific shard id. Is it advisable to use the server information directly into

Best practice to index and query SolrCloud

2013-09-24 Thread Shamik Bandopadhyay
Hi, I'm new to SolrCloud , trying to set up a test environment based on the wiki documentation. Based on the example, the setup and sample indexing / query works fine. But I need some pointers on the best practices of indexing / querying in SolrCloud. For e.g. I've 2 shards, with 1 leader an

RE: How to index and query "C#" as whole term?

2011-05-16 Thread Gnanakumar
e.org Subject: Re: How to index and query "C#" as whole term? The other advantage to the synonyms approach is it will be much less of a headache down the road. For instance, imagine you've defined "whitespacetokenizer" and "lowercasefilter". That'll fix

Re: How to index and query "C#" as whole term?

2011-05-16 Thread Erick Erickson
us Jelsma [mailto:markus.jel...@openindex.io] > Sent: Monday, May 16, 2011 8:51 AM > To: solr-user@lucene.apache.org > Subject: Re: How to index and query "C#" as whole term? > > Before indexing so outside Solr? Using the SynonymFilter would be easier > i > guess. >

RE: How to index and query "C#" as whole term?

2011-05-16 Thread Robert Petersen
, May 16, 2011 8:51 AM To: solr-user@lucene.apache.org Subject: Re: How to index and query "C#" as whole term? Before indexing so outside Solr? Using the SynonymFilter would be easier i guess. On Monday 16 May 2011 17:44:24 Robert Petersen wrote: > I have always just converted terms

Re: How to index and query "C#" as whole term?

2011-05-16 Thread Markus Jelsma
d similarly converted those terms if > someone searched on them. That always has worked just fine for me... > > :) > > -Original Message- > From: Jonathan Rochkind [mailto:rochk...@jhu.edu] > Sent: Monday, May 16, 2011 8:28 AM > To: solr-user@lucene.apache.org > S

RE: How to index and query "C#" as whole term?

2011-05-16 Thread Robert Petersen
nathan Rochkind [mailto:rochk...@jhu.edu] Sent: Monday, May 16, 2011 8:28 AM To: solr-user@lucene.apache.org Subject: Re: How to index and query "C#" as whole term? I don't think you'd want to use the string type here. String type is almost never appropriate for a field you want t

Re: How to index and query "C#" as whole term?

2011-05-16 Thread Jonathan Rochkind
the value is still split into different tokens on word boundaries; you just don't want an analyzer set that removes punctuation. On 5/16/2011 10:46 AM, Gora Mohanty wrote: On Mon, May 16, 2011 at 7:05 PM, Gnanakumar wrote: Hi, I'm using Apache Solr v3.1. How do I configure/allow So

Re: How to index and query "C#" as whole term?

2011-05-16 Thread Gora Mohanty
On Mon, May 16, 2011 at 7:05 PM, Gnanakumar wrote: > Hi, > > I'm using Apache Solr v3.1. > > How do I configure/allow Solr to both index and query the term "c#" as a > whole word/term?  From "Analysis" page, I could see that the term "c

How to index and query "C#" as whole term?

2011-05-16 Thread Gnanakumar
Hi, I'm using Apache Solr v3.1. How do I configure/allow Solr to both index and query the term "c#" as a whole word/term? From "Analysis" page, I could see that the term "c#" is being reduced/converted into just "c" by solr.WordDelimiterFilterFactory. Regards, Gnanam

Re: How to Index and query URLs as fields

2011-03-08 Thread Robert Krüger
My mistake. The error turned out to be somewhere else and the described approach seems to work. Sorry for the wasted bandwidth. On Mar 8, 2011, at 11:06 AM, Robert Krüger wrote: > Hi, > > I've run into problems trying to achieve a seemingly simple thing. I'm > indexing a bunch of files (loc

How to Index and query URLs as fields

2011-03-08 Thread Robert Krüger
Hi, I've run into problems trying to achieve a seemingly simple thing. I'm indexing a bunch of files (local ones and potentially some accessible via other protocols like http or ftp) and have an index field with the url to the file, e.g. "file:/home/foo/bar.pdf". Now I want to perform two simpl