Re: Protwords in solr spellchecker

The best bet is to use solr.StopFilterFactory. Have all such words added to stopwords.txt and add this filter to your analyzer. Reference links https://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.StopFilterFactory https://cwiki.apache.org/confluence/display/solr/Filter+Descriptions#F

Protwords in solr spellchecker

Hi Team, I am currently working with Java-1.7, Solr-4.8.1 with tomcat 7. Is there any feature by which I can refrain the following words to appear in spell suggestion. For example: Somebody searches for sexe, I does not want to show him sex as the spell suggestion via solr. How can I stop these t

Re: Grouping and recip function not working with Sharding

Hi Erick, Below example is for grouping issue not for sorting. I have indexed 1839 records with 'NAME' field in all, There may be duplicate record for each 'NAME' value. Let say There are 5 records with NAME='A-SERIES',similarly 3 records with NAME='E-SERIES' etc. I have total 264 unique NAME va

Re: Grouping and recip function not working with Sharding

Erick Erickson gmail.com> writes: > > From the reference guide: > > group.ngroups and group.facet require that all documents in each group > must be co-located on the same shard in order for accurate counts to > be returned. Document routing via composite keys can be a useful > solution in ma

Re: Solr cache when using custom scoring

No sure I get you, the parameter is passed to solr as a string. It seems like solr use for the caching key only the query, sort and range of documents (from the doc - "This cache holds the results of previous searches: ordered lists of document IDs (DocList) based on a query, a sort, and the range

RE: EmbeddedSolrServer No such core: collection1

Hi, My problem was that I didn't had core.properties file, so it couldn't create the core. Thanks for the help Shani -Original Message- From: Upayavira [mailto:u...@odoko.co.uk] Sent: Sunday, July 05, 2015 18:25 To: solr-user@lucene.apache.org Subject: Re: EmbeddedSolrServer No such co

RE: Solr Encoding Issue?

Shawn - Stupid coding error in my java code. Used default charset. Changed to UTF-8 and problem fixed. Thanks again! -Original Message- From: Tarala, Magesh Sent: Wednesday, July 08, 2015 8:11 PM To: solr-user@lucene.apache.org Subject: RE: Solr Encoding Issue? Wow, that makes total s

Re: Too many Soft commits and opening searchers realtime

Yonik, Mikhail, Alessandro After a lot of digging around and isolation, All u guys were right. I was using property based value and there was one place where it was 30 secs and that was overriding my main props. Also Yonik thanks for the explanation on the real time searcher. I wasn't sure i

RE: Solr Encoding Issue?

Wow, that makes total sense. Thanks Shawn!! I'll go down this path. Thanks, Magesh -Original Message- From: Shawn Heisey [mailto:apa...@elyograg.org] Sent: Wednesday, July 08, 2015 7:24 PM To: solr-user@lucene.apache.org Subject: Re: Solr Encoding Issue? On 7/8/2015 6:09 PM, Tarala,

Re: Solr Encoding Issue?

On 7/8/2015 6:09 PM, Tarala, Magesh wrote: > I believe the issue is in solr. The character “à” is getting stored in solr > as “Ã ”. Notice the space after Ã. > > I'm using solrj to ingest the documents into solr. So, one of those could be > the culprit? Solr accepts and outputs text in UTF-8. T

Re: Difference in WordDelimiterFilter behavior between 4.7.2 and 4.9.1

On Wed, Jul 8, 2015 at 6:50 PM, Shawn Heisey wrote: > After the fix (with luceneMatchVersion at 4.9), both "aaa" and "bbb" end > up at position 2. Yikes, that's definitely wrong. -Yonik

RE: Solr Encoding Issue?

Thanks Erick. I believe the issue is in solr. The character “à” is getting stored in solr as “Ã ”. Notice the space after Ã. I'm using solrj to ingest the documents into solr. So, one of those could be the culprit? -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.co

Best way to facets with value preprocessing (w/ docValues)

Hi, folks. Earlier I used solr.TextField with preprocessing (ASCII folding, lowercase etc) on some fields for search and faceting. But on larger index it takes several minutes to uninvert that fields for faceting (I use fieldValueCache & warmup queries with facets). It becomes too expensive in cas

Re: Tlog replay

On Wed, Jul 8, 2015 at 12:31 PM, Summer Shire wrote: > Thanks Alessandro ! > > Any idea on why I couldn't curl the solr core and pass the flag param ? These flags are for internal use only. Solr sets them, the client doesn't. -Yonik

RE: Do I really need copyField when my app can do the copy?

Perhaps some people like maybe those using DIH to feed their index might not have that luxury and copyfield is the better way for them. If you have an application you can do it either way. I have done both ways in different situations. Robi -Original Message- From: Steven White [mail

Re: Do I really need copyField when my app can do the copy?

On 7/8/2015 4:38 PM, Steven White wrote: > What good is the use of copyField in Solr's schema.xml if my application > can do it into the designated field? Having my application do so helps me > simplify the schema.xml maintains task thus my motivation. I can think of two main uses for copyField.

Re: Difference in WordDelimiterFilter behavior between 4.7.2 and 4.9.1

On 7/8/2015 4:01 PM, Jack Krupansky wrote: > In Lucene 4.8, LUCENE-5111: Fix WordDelimiterFilter offsets > > https://issues.apache.org/jira/browse/LUCENE-5111 > > Make sure the documents are queried and indexed with the same Lucene match > version. Since I have updated the luceneMatchVersion on th

Do I really need copyField when my app can do the copy?

Hi Everyone, What good is the use of copyField in Solr's schema.xml if my application can do it into the designated field? Having my application do so helps me simplify the schema.xml maintains task thus my motivation. Thanks Steve

Re: Jetty in Solr 5.2.0

Thank you all for your help. I will leave Solr as-is and not step on its feet. Steve On Wed, Jul 8, 2015 at 2:29 AM, Shawn Heisey wrote: > On 7/7/2015 10:51 AM, Steven White wrote: > > What I am faced with is this. I have to create my own crawler, similar > to > > DIH. I have to deploy this

Re: Difference in WordDelimiterFilter behavior between 4.7.2 and 4.9.1

In Lucene 4.8, LUCENE-5111: Fix WordDelimiterFilter offsets https://issues.apache.org/jira/browse/LUCENE-5111 Make sure the documents are queried and indexed with the same Lucene match version. -- Jack Krupansky On Wed, Jul 8, 2015 at 5:19 PM, Shawn Heisey wrote: > On 7/8/2015 2:19 PM, Shawn

SolrQueryRequest in SolrCloud vs Standalone Solr

Hi all We have a cluster of standalone Solr cores (Solr 4.3) for which we had built some custom requesthandlers and filters which do query processing using the Terms API. I'm now trying to port the custom functionality to work in the Solr Cloud world. Old configuration had standalone cores with

Re: Difference in WordDelimiterFilter behavior between 4.7.2 and 4.9.1

Yes Shawn, I was raising the fact that I see strange values in the positions as well. You said you fixed going back with an old version ? This should not be ok, I mean, I assume the latest version should be the best… Any idea or clarification guys ? 2015-07-08 21:10 GMT+01:00 Shawn Heisey : > On

Re: Adding field to query result

Yes, product is a function query and yes you can write your own. Score is a _really_ special field, accessed with even referenced differently by just the plain score "field". You can also use "doc transformers" to return things like which shard the doc came from, but that's a different syntax just

Re: Difference in WordDelimiterFilter behavior between 4.7.2 and 4.9.1

On 7/8/2015 2:19 PM, Shawn Heisey wrote: > It appears that changing luceneMatchVersion from LUCENE_4_9 to LUCENE_47 > has fixed this problem ... so I think somebody must have "fixed" WDF to > its current behavior, but put in a version check for the old behavior. The luceneMatchVersion change has f

Re: Solr cache when using custom scoring

On Wed, Jul 8, 2015 at 11:30 PM, amid wrote: > The custom scoring code use a parameter which passed to the solr query, this param should be evaluated in equals() and hashcode(). isn;t it? -- Sincerely yours Mikhail Khludnev Principal Engineer, Grid Dynamics

Re: Adding field to query result

Hey, Thanks for your response. Yes, I think what I'm looking for is a pseudo field. Is the "product" function a funtion query? I assume I can replace the the "product" function in an implementation of my own. BTW - is the score field a pseudo field? Maya -- View this message in context: htt

Re: Difference in WordDelimiterFilter behavior between 4.7.2 and 4.9.1

On 7/8/2015 2:10 PM, Shawn Heisey wrote: > At this point I think I should probably file a bug in Jira ... anyone > have any thoughts on that? It appears that changing luceneMatchVersion from LUCENE_4_9 to LUCENE_47 has fixed this problem ... so I think somebody must have "fixed" WDF to its current

Solr cache when using custom scoring

Hi, We are using solr and implemented our own custom scoring. The custom scoring code use a parameter which passed to the solr query, different parameter value will change the score of the same query. The problem which we have is that this parameter is not part of the query caching so running the

Re: Difference in WordDelimiterFilter behavior between 4.7.2 and 4.9.1

On 7/8/2015 9:26 AM, Alessandro Benedetti wrote: > Taking a look into the documentation I see this inconsistent orderings in > my opinion : Alessandro, thank you for your reply. I couldn't really tell what you were saying. I *think* you were agreeing with me that the current behavior seems like

RE: Can I instruct the Tika Entity Processor to skip the first page using the DIH?

Unfortunately, no. We can't even do that now with straight Tika. I imagine this is for pdf files? If you'd like to add this as a feature, please submit a ticket over on Tika. -Original Message- From: Paden [mailto:rumsey...@gmail.com] Sent: Wednesday, July 08, 2015 12:14 PM To: solr-

RE: About indexing embed file with solr

This may have been an issue with Solr's wrapper of Tika. See: https://issues.apache.org/jira/browse/SOLR-7189 -Original Message- From: 步青云 [mailto:mailliup...@qq.com] Sent: Wednesday, June 17, 2015 10:17 PM To: solr-user Subject: About indexing embed file with solr Hello, Could a

RE: Solr Encoding Issue?

Looks like images did not come through. Here's the text... I'm ingesting a .TXT file with HTML content into Solr. The content has the following character highlighted below: The file we get from CRM (also attached): Enter Data in TK Onlyà After ingesting into solr, I see a different character.

Re: Solr Encoding Issue?

Attachments are pretty aggressively stripped by the e-mail server, so there's nothing to see, you'll have to paste it somewhere else and provide a link. Usually, though, this is a character set issue with the browser using a different charset than Solr, it's really the same character, just display

Re: Adding field to query result

Maya - where’s the variable come from? You can compute a “pseudo-field”, something like this: $ bin/solr create -c test $ bin/post -c test -type text/csv -out yes -d $'id,type,price_td\n1,Toys,55.00’ $ open http://localhost:8983/solr/test/select?q=*:*&wt=xml&fl=id,type,price_td,sale_price:pro

Adding field to query result

Hello, I'm using solr 4.10. I'd like to know if it is possible to add a field only on query response and calculate its' value for the specific query. For example: Assume this is the document. 1 Toys 55 I would like the response to contain another field which its' value to be calculates from th

Solr Encoding Issue?

I'm ingesting a .TXT file with HTML content into Solr. The content has the following character highlighted below: The file we get from CRM (also attached): [cid:image001.png@01D0B972.75BE23F0] After ingesting into solr, I see a different character. This is query response from solr management co

Re: Tlog replay

Thanks Alessandro ! Any idea on why I couldn't curl the solr core and pass the flag param ? > On Jul 8, 2015, at 7:12 AM, Alessandro Benedetti > wrote: > > Hi Summer, > > If you take a look to the CommitUpdateCommand class, you will notice no > Flag is in there. > > // this is the toString

Can I instruct the Tika Entity Processor to skip the first page using the DIH?

Hello, I'm using the DIH to import some files from one of my local directories. However, every single one of these files has the same first page. So I want to skip that first page in order to optimize search. Can this be accomplished by an instruction within the dataimporthandler or, if not, how

Re: Remove operation of partial update doesn't work

Can you post your solrj code? در تاریخ 8 ژوئیهٔ 2015 19:32، "Alessandro Benedetti" < benedetti.ale...@gmail.com> نوشت: > I just tried on my own, and it is working perfectly. > Stupid question, have you committed after your update? > > Cheers > > 2015-07-08 15:41 GMT+01:00 Mohsen Saboorian : > > >

Re: Remove operation of partial update doesn't work

Yes I did. I use commitWithin to commit after a fixed timeout. Moreover my add operation works! در تاریخ 8 ژوئیهٔ 2015 19:32، "Alessandro Benedetti" < benedetti.ale...@gmail.com> نوشت: > I just tried on my own, and it is working perfectly. > Stupid question, have you committed after your update? >

Re: Remove operation of partial update doesn't work

Won June Tai: Please follow the instructions here: http://lucene.apache.org/solr/resources.html search for unsubscribe. You must use the _exact_ e-mail you used to subscribe. Also see the "problems" link if it doesn't work the first time. Best, Erick On Wed, Jul 8, 2015 at 8:03 AM, Won June Tai

Re: Grouping and recip function not working with Sharding

>From the reference guide: group.ngroups and group.facet require that all documents in each group must be co-located on the same shard in order for accurate counts to be returned. Document routing via composite keys can be a useful solution in many situations. It's not clear what you think the pr

Re: Solr 5.2.1 - SolrCloud create collection, core is only loaded after restart

My _guess_ is that you're getting a cached page somehow and never getting to Solr at all when you don't see the new core. What happens if you look at the admin UI from another machine? Or perhaps a different browser? If you tail the Solr log when you are looking you should see the request when you

Re: Synonym with Proximity search in solr 5.1.0

What do you mean ? Have you used the implemented plugins already ? Can you show us the debugged query please ? Cheers 2015-07-08 16:48 GMT+01:00 dinesh naik : > Hi Alessandro, > I have gone through the above suggested links, but i am not able to achieve > the above expected result. > > The issue

Re: Synonym with Proximity search in solr 5.1.0

Hi Alessandro, I have gone through the above suggested links, but i am not able to achieve the above expected result. The issue here is , my searched text is a part of field 'text' . I like nokia mobile searched text: "nokia mobile"~500. Best Regards, Dinesh Naik On Wed, Jul 8, 2015 at 8:36 P

Re: solr 5 and schema.xml

bq: I've then read that solr 5 doesn't by default use the schema.xml file, but is using a managed schema by default. Apparently, I can't alter the schema.xml file (which I can't find) but now need to use a REST api. However, since I'm using dynamic fields, I'm not sure if this is still necessary.

Re: Difference in WordDelimiterFilter behavior between 4.7.2 and 4.9.1

Taking a look into the documentation I see this inconsistent orderings in my opinion : *Example:* Concatenate word parts and number parts, but not word and number parts that occur in the same token. *In:* "hot-spot 100+42 XL40" *Tokenizer to Filter:* "hot-spot"(1), "100+42"(2), "XL40"(3

unexpected hl.fragsize behavior

I'm seeing strange hl.fragsize behavior in the version of Solr 4.6.0, the version I happen to be using. I've been testing with this "mp500.xml" file... http://svn.apache.org/viewvc/lucene/dev/tags/lucene_solr_4_6_0/solr/example/exampledocs/mp500.xml?view=markup ... using the query "q=indication"

Re: Synonym with Proximity search in solr 5.1.0

Showing your debug query would clarify the situation, but I assume you got into a classic multi-word synonym problem[1] . Hope the documents I pointed out are good for you. Cheers [1] http://nolanlawson.com/2012/10/31/better-synonym-handling-in-solr/ [2] http://lucidworks.com/blog/solution-for-mu

Re: Remove operation of partial update doesn't work

I’d like to unsubscribe please. > On Jul 8, 2015, at 11:01 AM, Alessandro Benedetti > wrote: > > I just tried on my own, and it is working perfectly. > Stupid question, have you committed after your update? > > Cheers > > 2015-07-08 15:41 GMT+01:00 Mohsen Saboorian : > >> ​ >> I use add and

Re: Difference in WordDelimiterFilter behavior between 4.7.2 and 4.9.1

On 7/8/2015 8:44 AM, Shawn Heisey wrote: > This is what 4.9.1 does with it: > > 1 rrr-coleccion > 2 rrr > 2 coleccion > 2 rrrcoleccion > 3 coleccion > 4 gracita > 5 morales > 6 foobar Followup: This is what Solr 5.2.1 does for query analysis, which also seems wrong, and doesn't match the phrase q

Re: Remove operation of partial update doesn't work

I just tried on my own, and it is working perfectly. Stupid question, have you committed after your update? Cheers 2015-07-08 15:41 GMT+01:00 Mohsen Saboorian : > ​ > I use add and remove both on a multivalue field (think of tags on a blog > post). For this, set null won't work because I want on

Synonym with Proximity search in solr 5.1.0

Hi, We have a synonym file with below content: 1 2 cell phone ,nokia mobile And we have 3 documents: doc1: 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 1001

Re: Search Handler Question

Awesome. This looks like a great resource. Thanks! -- View this message in context: http://lucene.472066.n3.nabble.com/Search-Handler-Question-tp4216341p4216348.html Sent from the Solr - User mailing list archive at Nabble.com.

Difference in WordDelimiterFilter behavior between 4.7.2 and 4.9.1

I'm not sure if this is a bug, but it does break searches that work fine in 4.7.2if we put the same config and index on 4.9.1. Here's a slightly redacted bit of text that's been sent to the index, and is also used as a phrase query: RRR-COLECCION: COLECCIÓN: Gracita Morales foobar Here are the f

Re: Remove operation of partial update doesn't work

​ I use add and remove both on a multivalue field (think of tags on a blog post). For this, set null won't work because I want only one value (tag) to be removed ​, ​ and set null neither remove one nor all of values (all tags here). So I use some ​S olr ​J code which would translate to something

Re: Search Handler Question

You are actually describing the Edismax Query parser ( which does what you quoted and even more) : https://cwiki.apache.org/confluence/display/solr/The+Extended+DisMax+Query+Parser Take a look there, probably with a little tuning this is going to be a good fit for you. If any additional questions

Search Handler Question

Hello, I've been trying to tune my search handler to get some better search results and I just have like a general question about the search handler. This being the first time I've designed/implemented a search engine I've been "told" that other engines operate on a kind of layered search. By l

Re: Indexed field to schema field

Sorry,thought this was common problem. Will present with decoration in some time if not able to solve it by then. Thanks and regards, Gajendra Dadheech On Wed, Jul 8, 2015 at 6:23 PM, Alessandro Benedetti < benedetti.ale...@gmail.com> wrote: > I am really sorry Gajendra, but what do your late

Re: Tlog replay

Hi Summer, If you take a look to the CommitUpdateCommand class, you will notice no Flag is in there. // this is the toString for example @Override public String toString() { return super.toString() + ",optimize="+optimize +",openSearcher="+openSearcher +",waitSearcher="+wai

Grouping and recip function not working with Sharding

Hi, I am using sharding (3 shards) with Zookeeper. When I query a collection using " *group=true&group.field=NAME&group.ngroups=true*" parameters, "*ngroups*" in response is incorrect. However I am getting correct count in doclist array. Ex: Below response contains 5 groups (Which is correct) bu

Re: Solr 5.2.1 - SolrCloud create collection, core is only loaded after restart

Hi, there was a problem with zookeeper and IPv6 that could be solved by using -Djava.net.preferIPv4Stack=true. Now, the core is correctly created, but I am wondering why I cannot see the core on the web interface, neither on the core admin screen nor in the Core Selector field. Only after resta

Re: Indexed field to schema field

I am really sorry Gajendra, but what do your latex mails mean ? Why classic field boosting is not an option for you ? Are you developing a custom query parser ? What are the parameter expected for this query parser ? What is the behaviour expected ? It is really hard to help with such fragmented in

Re: Too many Soft commits and opening searchers realtime

A realtime searcher is necessary for internal bookkeeping / uses if a normal searcher isn't opened on a commit. This searcher doesn't have caches and hence doesn't carry the weight that a normal searcher would. It's also invisible to clients (it doesn't change the view of the index for normal sear

Re: Too many Soft commits and opening searchers realtime

Summer, A log excerpt usually helps to troubleshoot any magic. Would you mind to provide one? On Wed, Jul 8, 2015 at 2:30 PM, Alessandro Benedetti < benedetti.ale...@gmail.com> wrote: > So you are saying that no-one is triggering any commit, and that the auto > soft commit solution is not actual

Re: Too many Soft commits and opening searchers realtime

So you are saying that no-one is triggering any commit, and that the auto soft commit solution is not actually waiting the proper time ? I suspect something is not like described, because if the Auto Soft commit was not working I would expect thousands of bugs raised. let's dig a little bit into d

Re: Sorting documents by child documents

I would like to get a deep understanding of your problem… How do you want to sort a parent document by a normal field of children ?? Example : Document 1 Id: 5 Children 1 Id:51 Title : "A" Children 2 Id:52 Title : "Z" Document 2 Id: 6

Re: Solr Boost Search word before Specific Content

Thanks Ahmet for the proposed Solution, that should work, but it is really hardcoded and coupled with the specific keyword ( "with" in the example) . I recently read an article from master Doug ( http://opensourceconnections.com/blog/2014/12/08/title-search-when-relevancy-is-only-skin-deep/ ) . I

Re: Remove operation of partial update doesn't work

In this scenarios, Documentation is key : Modifier Usage set Set or replace the field value(s) with the specified value(s), or *remove the values if 'null' or empty list is specified as the new value.* May be specified as a single value, or as a list for multivalued fields add Adds the speci

Re: Indexed field to schema field

At the time of forming this request i am not sure which kind of field that would be. So i read fields in new searcher. Thanks and regards, Gajendra Dadheech On Wed, Jul 8, 2015 at 2:12 PM, Gajendra Dadheech wrote: > I wish to do it in code so schema browser is lesser of an option. > > Use cas

Re: solr 5 and schema.xml

You have the choice. You can use dynamic schema and control it using API or use classic schema and control it explicitly via schema.xml. You control that when you create the schema by using different templates. It's just the default one is a dynamic schema. Also, dynamic fields is not the same as

RE: Running Solr 5.2.1 on WIndows using NSSM

Answered my own question. :) It seems to work great for me by following this article. http://www.norconex.com/how-to-run-solr5-as-a-service-on-windows/ Regards, Adrian -Original Message- From: Adrian Liew [mailto:adrian.l...@avanade.com] Sent: Wednesday, July 8, 2015 4:43 PM To: solr-u

Re: Remove operation of partial update doesn't work

In my code when operation is "add" it works correctly on a multivalue field. But no multivalue field can be deleted with "remove" operation. The add operation adds a value to a multivaled field. The remove operation removes a value from a multivalued field. If you believe that something is not wor

solr 5 and schema.xml

Had a look at previous postings, but am still thoroughly confused. I installed Solr 5 "out of the box", built a core and uploaded some documents using dynamic field types. I can see my uploaded docs using the get method. When I query those docs, results seem all over the place. The answer seems to

Re: Indexed field to schema field

I wish to do it in code so schema browser is lesser of an option. Use case is : I wish to boost particular fields while matching, for that i need to know My field to Solr field mapping. SO that i can put that in the query. Thanks and regards, Gajendra Dadheech On Tue, Jul 7, 2015 at 9:23 PM,

Running Solr 5.2.1 on WIndows using NSSM

Hi guys, I am looking to run Apache Solr v5.2.1 on a windows machine. I tried to setup a windows service using NSSM (Non-Sucking-Service-Manager) to install the windows service on the machine pointing to the solr.cmd file path itself and installing the service. After installation, I tried to s

Re: Solr Boost Search word before Specific Content

Hi Jack, Here is hypothetical example: product_title_1 : dell laptop with laptop bag product_title_2 : laptop bag with cover product_title_3 : laptop bag and table You create an artificial/additional field, before_field_1 : dell laptop before_field_2 : laptop bag before_field_3 : laptop bag