How hits are calculate in Collations?

Hi, Please anybody can explain me what is hits in collations and how they are calculated? Sometimes, I get the collation and sometimes not. *Problem:* *1)* URL : http://localhost:8983/solr/wikingram/spell?q=gram_ci:*"salmn khn"*&wt=json&indent=true&shards.qt=/spell&rows=1 Output : No col

Re: indexed and stored fields don't appear in the response

Thanks for Anshum & Gora's suggestion. I haven't set default fl in solrconfig.xml and the documents do contain tagid and bizid field(I've tried both q=*:* and q=bizid:2380505101). I'll look into the reindex possibility that Gora mentioned. 2015-02-09 18:37 GMT+08:00 Gora Mohanty : > On 9 February

RE: Total number of Facets

harish singh [harish.sing...@gmail.com] wrote: > Now suppose, there are 100, distinct "loginName"s. > How to I get this count directly? Currently your don't. There is a bit of a challenge there as the problem is very easy to solve for single-shards, but hard for SolrCloud. > I don't want to

Does comparatorClass not work in Shards?

I want to sort the suggestions on frequency. Default, they are sorting on score. *Working (Single Node):* freq It is working on single node. Suggestions are sorted on frequency. *Not Working (Multiple Nodes):* freq I tried the same property but it doesn't seems like working on multiple nodes. Def

Re: Collations are not working fine.

Hi Bill Bell, Sorry, I don't know how to sort collation on hits. Will you please assist me? On Mon, Feb 9, 2015 at 9:11 PM, Bill Bell wrote: > Can you order the collation a by highest to lowest hits ? > > Bill Bell > Sent from mobile > > > > On Feb 9, 2015, at 6:47 AM, Nitin Sol

Re: Collations are not working fine.

Hi *James Dyer* *,* I have not done stemming and my spellcheck.alternativeTermCount is set equals to spellcheck.count. Below, I have pasted my solrconfig.xml and schema.xml configuration. *URL: * localhost:8983/solr/wikingram/spell?q=gram_ci:"deligh"&wt=json&indent=true&sha

Re: Collection API calls on SSL sometimes hang

Also, this is how the Solr node's log looks when the above Curl request fails: 2249660 [qtp883065319-18] INFO org.apache.solr.servlet.SolrDispatchFilter – [admin] webapp=null path=/admin/collections params={indent=on&action=CLUSTERSTATUS&wt=json} status=500 QTime=180028 2249657 [zkCallback-2-threa

Collection API calls on SSL sometimes hang

Hi all, I'm using self-signed certificates between my SolrCloud (4.10.3 ) instance and Curl/Solr http client with needClientAuth=true on jetty.xml. I'm able to load the Solr home page, and also make select/query

Re: Complaint of multiple /updates but solrconfig.xml has one

On 2/9/2015 6:19 PM, Benson Margulies wrote: > 4.10.3: Customized solrconfig.xml. > > My log shows: > > 2/9/2015, 8:14:44 PMWARNRequestHandlersMultiple requestHandler > registered to the same name: /update ignoring: > org.apache.solr.handler.UpdateRequestHandler > > But there is only one: > >

Re: Complaint of multiple /updates but solrconfig.xml has one

OK, I see, I forgot to include the core name in the URL. On Mon, Feb 9, 2015 at 8:27 PM, Benson Margulies wrote: > I see https://issues.apache.org/jira/browse/SOLR-6302 but I don't see > what I am supposed to do about it. > > On Mon, Feb 9, 2015 at 8:19 PM, Benson Margulies wrote: >> 4.10.3: Cus

log location when using bin/start

Running bin/start with a command like: /data/solr-4.10.3/bin/solr start -s $PWD/solr_home -a "-Djava.library.path=$libdir -Dbt.root=$bt_root\ " "$@" I note that the logs are ending up in the solr install dir/examples/logs. Can I move them?

Complaint of multiple /updates but solrconfig.xml has one

4.10.3: Customized solrconfig.xml. My log shows: 2/9/2015, 8:14:44 PMWARNRequestHandlersMultiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler But there is only one: RNI And all attempts to post with the simple

Re: Complaint of multiple /updates but solrconfig.xml has one

I see https://issues.apache.org/jira/browse/SOLR-6302 but I don't see what I am supposed to do about it. On Mon, Feb 9, 2015 at 8:19 PM, Benson Margulies wrote: > 4.10.3: Customized solrconfig.xml. > > My log shows: > > 2/9/2015, 8:14:44 PMWARNRequestHandlersMultiple requestHandler > registered t

Re: [MASSMAIL]Re: Trending functionality in Solr

Thanks for stating this in a simple fashion. On Sun, Feb 8, 2015 at 6:07 PM, Jorge Luis Betancourt González < jlbetanco...@uci.cu> wrote: > For a project I'm working on, what we do is store the user's query in a > separated core that we also use to provide an autocomplete query > functionality, s

Re: Trending functionality in Solr

Folks, Thanks for this wealth of information , the consensus generally seems to be that one should be able to save the queries in Solr core (another one) and then times stamp it to do further analysis . I will try and implement the same . Siegfried, I looked at your JIRA issue which is impressiv

Re: 1 Solr many Shards?

Check out the maxShardsPerNode param for CREATE collection here: https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-api1 It defaults to 1 i.e. on a single node, only a single shard for the collection is allowed but you can override to a really high value e.g. start Sol

Re: Solrcloud open new searcher not happening in slave for deletebyID

Thanks Anshum for additional info. - Sriram -- View this message in context: http://lucene.472066.n3.nabble.com/Solrcloud-open-new-searcher-not-happening-in-slave-for-deletebyID-tp4182439p4185196.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solrcloud open new searcher not happening in slave for deletebyID

SOLR-5890 fixes this issue and would be released with 5.1. There was another issue (SOLR-6984 ) which acknowledged this problem and was closed as a duplicate of 5890. On Mon, Feb 9, 2015 at 3:27 PM,

Re: Solrcloud open new searcher not happening in slave for deletebyID

I tried with deleteByQuery but still in replicas, new searcher is not opened. Hence I configured solr to issue soft commit every one second. Didn't try this with latest solr 4.10.3 Thanks, V.Sriram -- View this message in context: http://lucene.472066.n3.nabble.com/Solrcloud-open-new-searcher-

Re: [MASSMAIL]Total number of Facets

So bottom line you're trying to get the count on distinct values on the loginName field? At least based on your query "*:*", if this is what you're after checkout the Stats component, specially the calcDistinct parameter, although if you expect a really high cardinality in the field this could b

1 Solr many Shards?

My understanding is that a single Solr instance can "manage" multiple cores/indexes. I am wondering if a single Solr instance can manage multiple shards (but not necessarily all) of an index. If so, how might this be configured and the Solr instance started? I am familiar with starting a Sol

Total number of Facets

While doing a facet query: example: - params: { - facet: "true", - indent: "true", - q: "*:*", - facet.field: "loginName", - wt: "json" } By defualt, Solr return 100 Facets. This is fine. If I do "facet.limit=-1", I can get all the facets. Now suppose,

Solr 4.10.3 annotations on nested objects

Hello, I have Java beans with parent-child relation that I am trying to index using @Field annotation (copying the sample code below). I see that https://issues.apache.org/jira/browse/SOLR-1945 is open. Is there any other way or document that describes how to use solrj annotations to index ne

Re: Advantages over solrj api over Spring Data Solr api

Spring Data Solr is on top of SolrJ api, though it uses it's own data/object mapper. The advantages of Spring Data Solr is that it can automatically generate queries from the method names. That approach works well for databases with structured content, but somewhat less for Solr with unstructured.

Advantages over solrj api over Spring Data Solr api

Hi folks, We are using solrj api at large to index and query, wondering if any one have already used any version of spring data solr and what are the advantages over solrj api? We are exploring other new technologies or updates around solr. *Rajesh.*

Re: Trending functionality in Solr

Hi folks, In the project that i am working now, we have used logstash to parse the log files and store the user queries back into a separate collection in solr and banana dashboard configure to view the usage. logstash: logstash.net/ banana : github.com/LucidWorks/banana *Rajesh.* On Mon, Feb

RE: Collations are not working fine.

Nitin, My guess here is that your spellcheck field is a field that has stemming. This might be why you get a collation that return "wind" even though the user queried "wnd" and it does not get any suggestions. Perhaps "wnd" is stemmed the same as "wind" ? (Spellcheck usually works best if yo

Re: Query always fail if row value is too high

On 9 February 2015 at 14:12, Yago Riveiro wrote: > Now that I know what I’m looking for, in fact the wiki has an entry for > formdataUploadLimitInKB, but doesn’t help too much if you don´t know that > internal requests in solrcloud mode can be limited by this configuration. Awesome. Change it t

Re: Query always fail if row value is too high

Alex,  Now that I know what I’m looking for, in fact the wiki has an entry for formdataUploadLimitInKB, but doesn’t help too much if you don´t know that internal requests in solrcloud mode can be limited by this configuration. +1 to Toke’s suggestion. In some cases the error messages are

RE: Query always fail if row value is too high

Shawn Heisey [apa...@elyograg.org] wrote: > You can change this value in solrconfig.xml by adding/modifying the > formdataUploadLimitInKB attribute on the requestParsers tag. Bingo. Checking on our server, I can see that we increased that value at some point. I am a big fan of error messages wit

Re: Query always fail if row value is too high

Now that you have the (probable) answer, is there a particular page you would have expected to see that at, when you did your own research? Somewhere on the SolrCloud page? Or on the performance tuning page? Regards, Alex. P.s. It helps to mention that you have a SolrCloud setup when you face i

Re: Query always fail if row value is too high

Ok, now I understand the POST thing, is an internal query done between node. I will put the formdataUploadLimitInKB in the solrconfig.xml. I think that this should be documented in the wiki, is odd enough and is not an error per se. — /Yago Riveiro On Mon, Feb 9, 2015 at 6:03 PM, Alexa

Re: Query always fail if row value is too high

On 2/9/2015 11:02 AM, Alexandre Rafalovitch wrote: > You have a distributed collection (SolrCloud) setup, right? So, it > seems that the request to collect the data from other nodes is hitting > this exception. Though the error message is weird enough I would put > only 80% probability on my explan

Re: Query always fail if row value is too high

You have a distributed collection (SolrCloud) setup, right? So, it seems that the request to collect the data from other nodes is hitting this exception. Though the error message is weird enough I would put only 80% probability on my explanation. Were there any _other_ exceptions in the logs. On t

Re: Query always fail if row value is too high

Ok, but why the error is related to POST limit if I don’t doing a POST request? is a normal GET request …  — /Yago Riveiro On Mon, Feb 9, 2015 at 5:53 PM, Shawn Heisey wrote: > On 2/9/2015 8:29 AM, yriveiro wrote: >> I'm trying to retrieve from Solr a query in CSV format with around 500K >> r

Re: Query always fail if row value is too high

On 2/9/2015 8:29 AM, yriveiro wrote: > I'm trying to retrieve from Solr a query in CSV format with around 500K > registers and I always get this error: > > "Expected mime type application/octet-stream but got application/xml. version=\"1.0\" encoding=\"UTF-8\"?>\n\n name=\"msg\">application/x-www-

RE: Query always fail if row value is too high

Toke Eskildsen [t...@statsbiblioteket.dk] wrote: yriveiro [yago.rive...@gmail.com] wrote: >> I'm trying to retrieve from Solr a query in CSV format with around 500K >> registers and I always get this error: >> [...] application/x-www-form-urlencoded content length (6040427 >> bytes) exceeds upload

RE: Query always fail if row value is too high

yriveiro [yago.rive...@gmail.com] wrote: > I'm trying to retrieve from Solr a query in CSV format with around 500K > registers and I always get this error: > [...] application/x-www-form-urlencoded content length (6040427 > bytes) exceeds upload limit of 2048 KB [...] I remember running into this

Re: Query always fail if row value is too high

the stack trace ERROR - localhost - 2015-02-09 15:05:03.698; org.apache.solr.common.SolrException; org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got application/xml. application/x-www-form-urlencoded content length

Re: Query always fail if row value is too high

Is there an exception stack trace on the server side in the logs? Might tell a lot more of the story. Regards, Alex. Sign up for my Solr resources newsletter at http://www.solr-start.com/ On 9 February 2015 at 11:11, Yago Riveiro wrote: > I’m using solr 4.6.1 with jetty and I have no ot

Re: Query always fail if row value is too high

I’m using solr 4.6.1 with jetty and I have no other piece of custom software that can raise this issue. The query is something like this: http://localhost:8983/solr/collection-1/query?q=datetime:[2015-02-01T00:00:00Z%20TO%202015-02-01T23:59:59Z]&fl=field_1&wt=csv&csv.header=false&rows=4000

Re: Query always fail if row value is too high

Hmmm, that's interesting... It looks like a container (jetty/tomcat or whatever) configuration limit somewhere. I'd only expect this error from Solr when trying to send something really large though - notice "upload" in the error. Is this error message really from Solr or another piece of your sy

Re: Query always fail if row value is too high

That's strange. The message seems to be about upload. You are querying Solr for data it already has, right? What does your query looks like? Regards Alex On 9 Feb 2015 10:30 am, "yriveiro" wrote: > I'm trying to retrieve from Solr a query in CSV format with around 500K > registers and I al

Re: Sort on multivalued attributes

Could you inject an UpdateRequestProcesssor into the processing chain? Then you could copy the field to a sort specific field and choose only one value. And use docValues for faster sort too. Regards, Alex On 9 Feb 2015 4:33 am, "Flavio Pompermaier" wrote: > In my use case it could be very

Re: Query always fail if row value is too high

Yago, I can't speak to the specific error. However, that's quite a lot of rows from one request. Solr and Lucene need to build that in memory, which can create all kinds of heap issues. You could try using start to page through the rows, but you'll run into a problem known as deep paging. In short

Re: Sort on multivalued attributes

Definitely needed !! Bill Bell Sent from mobile > On Feb 9, 2015, at 5:51 AM, Jan Høydahl wrote: > > Sure, vote for it. Number of votes do not directly make prioritized sooner. > So you better also add a comment to the JIRA, it will raise committer's > attention. > Even better of course is if

Re: Collations are not working fine.

Can you order the collation a by highest to lowest hits ? Bill Bell Sent from mobile > On Feb 9, 2015, at 6:47 AM, Nitin Solanki wrote: > > I am working on spell checking in Solr. I have implemented Suggestions and > collations in my spell checker component. > > Most of the time collations wo

Query always fail if row value is too high

I'm trying to retrieve from Solr a query in CSV format with around 500K registers and I always get this error: "Expected mime type application/octet-stream but got application/xml. \n\napplication/x-www-form-urlencoded content length (6040427 bytes) exceeds upload limit of 2048 KB400\n\n" If the

Re: XML nested structure in solr

There’s https://issues.apache.org/jira/browse/SOLR-5147 - but unfortunately it didn’t make it to the upcoming 5.0 release. It will be in the 5.1 release though. Using parent/child (block/join) is what I would consider a last resort choice thoug

Re: XML nested structure in solr

Hey, could you please give me an example how I can store the original xml? And do you know an existing way how I can import the xml with parent/childrens without using solrJ e.g. DataImportHandler? Jan Høydahl schrieb am 13:58 Montag, 9.Februar 2015: Hi, By storing your original X

Re: Sort on multivalued attributes

Ok, done :) On Mon, Feb 9, 2015 at 1:51 PM, Jan Høydahl wrote: > Sure, vote for it. Number of votes do not directly make prioritized sooner. > So you better also add a comment to the JIRA, it will raise committer's > attention. > Even better of course is if you are able to help bring the issue f

Collations are not working fine.

I am working on spell checking in Solr. I have implemented Suggestions and collations in my spell checker component. Most of the time collations work fine but in few case it fails. *Working*: I tried query:*gone wthh thes wnd*: In this "wnd" doesn't give suggestion "wind" but collation is coming

Re: Sort on multivalued attributes

Sure, vote for it. Number of votes do not directly make prioritized sooner. So you better also add a comment to the JIRA, it will raise committer's attention. Even better of course is if you are able to help bring the issue forward by submitting patches. -- Jan Høydahl, search solution architect

Re: XML nested structure in solr

Hey, thanks for your answer.Yes I've already checked out the XPathEntityProcessor but it's flatten my documents.This is quite good working for the first part of my example xml-file, but now i´m looking for a solution of the "timeinfo" part. I like to keep the nested structure up. So I search for

Re: Problem with faceting

Hi, that was the problem. I don't know why, but we have some documents duplicated in the two shards, maybe we have had our config file wrong some time. Thank very much, David Dávila Atienza AEAT De: Erick Erickson Para: solr-user@lucene.apache.org, Fecha: 08/02/2015 11:21 Asunto:

Delete Replica API Async Calls not being processed

Hi, I needed to delete a couple replica for a shard and used the Async Collections API calls to do that. I see all my requests in the 'submitted' state but none have been processed yet. (been 4 hours or so) How do I know whether these requests are under process at all? And if required how could I

Re: Sort on multivalued attributes

Do I have to vote for it..? On Mon, Feb 9, 2015 at 11:50 AM, Jan Høydahl wrote: > See https://issues.apache.org/jira/browse/SOLR-2522 > > -- > Jan Høydahl, search solution architect > Cominvent AS - www.cominvent.com > > > 9. feb. 2015 kl. 10.30 skrev Flavio Pompermaier : > > > > In my use case

RE: multiple patterns in solr.PatternTokenizerFactory

Please let me know the syntax. -- View this message in context: http://lucene.472066.n3.nabble.com/multiple-patterns-in-solr-PatternTokenizerFactory-tp4184986p4184992.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: multiple patterns in solr.PatternTokenizerFactory

You can split into all groups by specifying group=-1. -Original message- > From:Nivedita > Sent: Monday 9th February 2015 12:08 > To: solr-user@lucene.apache.org > Subject: multiple patterns in solr.PatternTokenizerFactory > > Can I give multiple patterns in > > pattern="(SKU|Part(\

multiple patterns in solr.PatternTokenizerFactory

Can I give multiple patterns in -- View this message in context: http://lucene.472066.n3.nabble.com/multiple-patterns-in-solr-PatternTokenizerFactory-tp4184986.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: XML nested structure in solr

Hi The most common approach is to flatten the document and map to chosen schema fields in Solr. You could also store the original XML in a STORED field for the purpose of returning to the client. Have you checked out XPathEntityProcessor (https://cwiki.apache.org/confluence/display/solr/Uploadi

Re: Sort on multivalued attributes

See https://issues.apache.org/jira/browse/SOLR-2522 -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 9. feb. 2015 kl. 10.30 skrev Flavio Pompermaier : > > In my use case it could be very helpful because I use the SIREn plugin to > index arbitrary JSON-LD and this plug

Re: indexed and stored fields don't appear in the response

On 9 February 2015 at 15:50, Anshum Gupta wrote: > Common reasons for that would be > 1. Your default fl in solrconfig is set to id, _version_. Can you try > explicitly mentioning fl=id,tagid,bizid in the request? Also, it'd be good > to look at your solrconfig.xml. > 2. Chances are, those documen

Re: indexed and stored fields don't appear in the response

Common reasons for that would be 1. Your default fl in solrconfig is set to id, _version_. Can you try explicitly mentioning fl=id,tagid,bizid in the request? Also, it'd be good to look at your solrconfig.xml. 2. Chances are, those documents do not contain those fields to begin with. Both bizid and

XML nested structure in solr

Hey @all, I have a problem with nested documentsin solr. I like to import avery big XML file which contains a nested structure:                                     aa                 a                 a                 a                                         open                          

Re: Trending functionality in Solr

Hi, In a project I'm working on, we adopted the same approach as the one commented by Jorge Luis (use a separate core and let the front-end send the query to solr to store it). Depending on the analysis you want to achieve it could be interesting to delete duplicates or not (have 1 solr document p

Re: indexed and stored fields don't appear in the response

Sorry about the error, I have copied the wrong schema file :( The schema.xml file is actually as follows: The command curl "http://localhost:8983/solr/pa_info/select? q=bizid:2380505101&rows=10 " will get the following response:

Re: Sort on multivalued attributes

In my use case it could be very helpful because I use the SIREn plugin to index arbitrary JSON-LD and this plugin automatically index also all nested attributes as a Solr field. Thus I need for example to gather all entries with a certain value of the "type" attribute, ordered by "name" (but name c

Re: indexed and stored fields don't appear in the response

What happens? You seem to be getting back the stored fields for the top 10 documents. What do you want/think should happen? On Mon, Feb 9, 2015 at 12:56 AM, Sandy Ding wrote: > Part of my schema is as follows: > > > required="true" multiValued="false" docValues="true" /> > requir

Re: indexed and stored fields don't appear in the response

On 9 February 2015 at 14:26, Sandy Ding wrote: > Part of my schema is as follows: > > > required="true" multiValued="false" docValues="true" /> > required="false" multiValued="true" docValues="true"/> > > When I issue the following command, > > curl "http://localhost:8983/solr/

Re: Leaders in Recovery Failed state

Hi Eric, Sorry I did not reply earlier. I see this page cached here - on gmane.org but the original post I posted on Solr Users list does not show your comment - http://lucene.472066.n3.nabble.com/Leaders-in-Recovery-Failed-state-td4180610.html I'm on Solr 4.10.1 - The last time this had happ

Re: Leaders in Recovery Failed state

Erick Erickson gmail.com> writes: > > What version of Solr? > > On Tue, Jan 20, 2015 at 7:07 AM, anand.mahajan zerebral.co.in> > wrote: > > Hi all, > > > > > > I have a cluster with 36 Shards and 3 replica per shard. I had to > recently > > restart the entire cluster - most of the shards & rep

Re: Sort on multivalued attributes

Sure, that's correct and makes sense in some use cases. I'll need to check if Solr functions support such a thing. On Mon, Feb 9, 2015 at 12:47 AM, Flavio Pompermaier wrote: > I saw that this is possible in Lucene ( > https://issues.apache.org/jira/browse/LUCENE-5454) and also in > Elasticsearch

indexed and stored fields don't appear in the response

Part of my schema is as follows: When I issue the following command, curl "http://localhost:8983/solr/pa_info/select?q=*:*&rows=10"; The response is: 016*:*106594047971492348841962242048101233589714923488419632906261783978259149234884196329062711972893031492348841963290629

Re: Sort on multivalued attributes

I saw that this is possible in Lucene ( https://issues.apache.org/jira/browse/LUCENE-5454) and also in Elasticsearch. Or am I wrong? On Mon, Feb 9, 2015 at 9:05 AM, Anshum Gupta wrote: > Unless I'm missing something here, sorting on a multi-valued field would be > non-deterministic in nature. >

Re: Trending functionality in Solr

Hi folks, I implemented something similar but never got around to contribute it - see https://issues.apache.org/jira/browse/SOLR-4056 The code was initially for SOLR3 but was recently ported to SOLR4 * capturing the most frequent search terms per core * supports ad-hoc queries * CSV export I

Re: Sort on multivalued attributes

Unless I'm missing something here, sorting on a multi-valued field would be non-deterministic in nature. On Sun, Feb 8, 2015 at 11:59 PM, Flavio Pompermaier wrote: > Hi to all, > > Is there any possibility that in the near future Solr could support sorting > on multivalued fields? > > Best, > Fl

Sort on multivalued attributes

Hi to all, Is there any possibility that in the near future Solr could support sorting on multivalued fields? Best, Flavio