Re: Elevation with distributed search causes NPE

2020-08-17 Thread Erick Erickson
I "enabled patch review”… Thanks! > On Aug 17, 2020, at 9:43 AM, smk wrote: > > H Erick, > > I am a colleague of Marc and have attached a patch to his ticket > https://issues.apache.org/jira/browse/SOLR-14662 > Can you set the ticket to "Patch Available"? For me there is no such option. > > Th

Re: Elevation with distributed search causes NPE

2020-08-17 Thread smk
H Erick, I am a colleague of Marc and have attached a patch to his ticket https://issues.apache.org/jira/browse/SOLR-14662 Can you set the ticket to "Patch Available"? For me there is no such option. Thank you very much, Thomas -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472

Re: Elevation with distributed search causes NPE

2020-07-22 Thread Erick Erickson
issues usually works. I could not find anything that helped me. > > Thanks in advance. > > Best, > Marc > > -Ursprüngliche Nachricht- > Von: Marc Linden > Gesendet: Freitag, 17. Juli 2020 11:35 > An: solr-user@lucene.apache.org > Betreff: AW: Elevati

AW: Elevation with distributed search causes NPE

2020-07-22 Thread Marc Linden
-user@lucene.apache.org Betreff: AW: Elevation with distributed search causes NPE There it is: https://issues.apache.org/jira/browse/SOLR-14662. I'd love to dig deeper into that and provide a patch for it, but I'm fully occupied with our own project. Thanks and best reg

AW: Elevation with distributed search causes NPE

2020-07-17 Thread Marc Linden
li 2020 15:06 An: solr-user@lucene.apache.org Betreff: Re: Elevation with distributed search causes NPE Can you raise a JIRA? If you’re ambitious, you can add a patch too ;) > On Jul 16, 2020, at 2:52 AM, Marc Linden > wrote: > > Thanks Erick for your fast response. > > I&#x

Re: Elevation with distributed search causes NPE

2020-07-16 Thread Erick Erickson
t; > Best regards, > Marc > > -Ursprüngliche Nachricht- > Von: Erick Erickson > Gesendet: Mittwoch, 15. Juli 2020 14:32 > An: solr-user@lucene.apache.org > Betreff: Re: Elevation with distributed search causes NPE > > Hmmm, looking at the code that lin

AW: Elevation with distributed search causes NPE

2020-07-15 Thread Marc Linden
e(HttpSolrCall.java:780) ... Best regards, Marc -Ursprüngliche Nachricht- Von: Erick Erickson Gesendet: Mittwoch, 15. Juli 2020 14:32 An: solr-user@lucene.apache.org Betreff: Re: Elevation with distributed search causes NPE Hmmm, looking at the code that line looks like this: sortSpec

Re: Elevation with distributed search causes NPE

2020-07-15 Thread Erick Erickson
legitimate JIRA, please go ahead and raise one. Best, Erick > On Jul 15, 2020, at 4:34 AM, Marc Linden > wrote: > > Hi all, > > I'm facing the problem that Solr is throwing a NullPointerException when > performing a distributed search with multiple shards having ele

Elevation with distributed search causes NPE

2020-07-15 Thread Marc Linden
Hi all, I'm facing the problem that Solr is throwing a NullPointerException when performing a distributed search with multiple shards having elevation configured where one or more shards do have elevated results but others do not. We are using Solr 8.2 and have the QueryElevationComp

Re: Federated / Distributed search using Solr

2018-12-29 Thread Erick Erickson
unless it's a time routed alias. > > http://lucene.apache.org/solr/guide/7_6/collections-api.html#createalias > > > > On Sat, Dec 29, 2018 at 4:35 PM Steven White wrote: > > > Hi everyone, > > > > Does Solr support federated / distributed search when the schema

Re: Federated / Distributed search using Solr

2018-12-29 Thread Gus Heck
2018 at 4:35 PM Steven White wrote: > Hi everyone, > > Does Solr support federated / distributed search when the schema of the 2 > or more indexes are different? > > I have 3 indexes and all three use different schema. However, the unique > key field name is the same a

Federated / Distributed search using Solr

2018-12-29 Thread Steven White
Hi everyone, Does Solr support federated / distributed search when the schema of the 2 or more indexes are different? I have 3 indexes and all three use different schema. However, the unique key field name is the same across all 3 indexes. I need to search on all 3 indexes and return results

RE: QueryElevator prepare() in in distributed search

2018-03-20 Thread Markus Jelsma
Anything on this one to share? Thanks, Markus -Original message- > From:Markus Jelsma > Sent: Friday 16th March 2018 18:13 > To: Solr-user > Subject: QueryElevator prepare() in in distributed search > > Hello, > > QueryElevator.prepare() runs five tim

QueryElevator prepare() in in distributed search

2018-03-16 Thread Markus Jelsma
Hello, QueryElevator.prepare() runs five times for a single query in distributed search, this is probably not how it should be, but in what phase of distributed search is it supposed to actually run? Many thanks, Markus

Authentication and distributed search in 7.2.1

2018-02-28 Thread Peter Sturge
Hi, In 7.2.1 there's the authentication module and associated security.json file, which works well for single cores. (Note: standalone mode, no SolrCloud) It doesn't appear to work with distributed searches, including multi-shard local searches . e.g. shards=localhost:8983/solr/core1,localhost:89

Re: Distributed search cross cluster

2018-01-31 Thread Jan Høydahl
Erick: > ...one for each cluster and just merged the docs when it got them back This would be the logical way. I'm afraid that "just merged the docs" is the crux here, that would make this an expensive task. You'd have to merge docs, facets, highlights etc, handle the different search phases (

Re: Distributed search cross cluster

2018-01-31 Thread Jan Høydahl
Hi, I am an ex FAST employee and actually used Unity a lot myself, even hacking the code writing custom mixers etc :) That is all cool, if you want to write a generic federation layer. In our case we only ever need to talk to Solr instances with exactly the same schema and doument types, compat

Re: Distributed search cross cluster

2018-01-31 Thread Bernd Fehling
Many years ago, in a different universe, when Federated Search was a buzzword we used Unity from FAST FDS (which is now MS ESP). It worked pretty well across many systems like FAST FDS, Google, Gigablast, ... Very flexible with different mixers, parsers, query transformers. Was written in Python an

Re: Distributed search cross cluster

2018-01-31 Thread Charlie Hull
On 30/01/2018 16:09, Jan Høydahl wrote: Hi, A customer has 10 separate SolrCloud clusters, with same schema across all, but different content. Now they want users in each location to be able to federate a search across all locations. Each location is 100% independent, with separate ZK etc. Ban

Re: Distributed search cross cluster

2018-01-30 Thread Erick Erickson
Jan: Hmmm, must Solr do the work? On some level it seems easier if your middle layer (behind your single IP) has 10 CloudSolrClient thread pools, one for each cluster and just merged the docs when it got them back. That would take care of all of the goodness of internal LBs and all that. Somewher

Distributed search cross cluster

2018-01-30 Thread Jan Høydahl
Hi, A customer has 10 separate SolrCloud clusters, with same schema across all, but different content. Now they want users in each location to be able to federate a search across all locations. Each location is 100% independent, with separate ZK etc. Bandwidth and latency between the clusters i

score field returns NaN with distributed Search after Upgrade from 4.5 to 4.10

2017-07-27 Thread Natarajan, Rajeswari
Hi All, We are upgrading from Solr/Lucene 4.5.1 to 4.10.4. When testing we found the below issue. The score field in the query response for a distributed query results in NaN. This happens if the indexes were created in 4.5 and the query is received in 4.10.1. Also the score in the explain

RE: How to avoid unnecessary query parsing on distributed search in QueryComponent.prepare()?

2017-05-24 Thread Markus Jelsma
tring to a real object, could that be lighter than parsing the incoming query text? Markus -Original message- > From:Mikhail Khludnev > Sent: Thursday 11th May 2017 10:43 > To: solr-user > Subject: How to avoid unnecessary query parsing on distributed search in &g

d: org.apache.http.ParseException: Invalid content type: - solr distributed search 4.10.4

2017-05-13 Thread Natarajan, Rajeswari
Hi, When doing a distributed query from solr 4.10.4 ,getting below exception org.apache.solr.common.SolrException: org.apache.http.ParseException: Invalid content type: org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:311) org

How to avoid unnecessary query parsing on distributed search in QueryComponent.prepare()?

2017-05-11 Thread Mikhail Khludnev
Hello, When the distributed search is requested (SolrCloud), the query component invokes prepare() where a query is parsed. But then it's just ignored, I suppose because all work is done by subordinate shards' requests. It's fine the most of the times because query parsing is cheap

honouring terms.limit parameter in a distributed search for /terms api

2017-03-08 Thread radha krishnan
Hi, in the TermsComponent.java's, createShardQuery, the motive to specify terms.limit to -1 is clearly specified in java comment but we have a usecase where have thousands of terms and we want each core to return only the value specfied by terms.limit. can we have two flavours of TermsComponent

Re: Distributed Search: Wrong count?

2017-03-01 Thread Kelly, Frank
gt;" mailto:solr-user@lucene.apache.org>> Date: Wednesday, March 1, 2017 at 2:04 PM To: "solr-user@lucene.apache.org<mailto:solr-user@lucene.apache.org>" mailto:solr-user@lucene.apache.org>> Subject: Distributed Search: Wrong count? Environment: SolrCloud 5.3 Col

Distributed Search: Wrong count?

2017-03-01 Thread Kelly, Frank
Environment: SolrCloud 5.3 Collection has 12.3m docs split across 3 shards and 3 replicas In the query below I get one document ID returned but a numFound of 365 { "responseHeader":{ "status":0, "QTime":47, "params":{ "q":"haUserId: AND haAccountType:google AND type:use

Re: Distributed Search (across collections) + partial Filter query

2017-02-08 Thread alessandro.benedetti
6.n3.nabble.com/Distributed-Search-across-collections-partial-Filter-query-tp4319166p4319292.html Sent from the Solr - User mailing list archive at Nabble.com.

Distributed Search (across collections) + partial Filter query

2017-02-07 Thread alessandro.benedetti
have any idea, let me know! Cheers [1] http://yonik.com/solr-query-parameter-substitution/ - --- Alessandro Benedetti Search Consultant, R&D Software Engineer, Director Sease Ltd. - www.sease.io -- View this message in context: http://lucene.472066.n3.nabble.com/Distribu

Re: [Rerank Query] Distributed search + pagination

2016-09-20 Thread Alessandro Benedetti
Perfect Joel, keep me updated ! Cheers On Mon, Sep 19, 2016 at 10:26 PM, Joel Bernstein wrote: > Alessandro, I'll be doing some testing with the re-ranker as part of > SOLR-9403 for Solr 6.3. I'll see if I can better understand the issue > you're bringing up during the testing. I'll report back

Re: [Rerank Query] Distributed search + pagination

2016-09-19 Thread Joel Bernstein
Alessandro, I'll be doing some testing with the re-ranker as part of SOLR-9403 for Solr 6.3. I'll see if I can better understand the issue you're bringing up during the testing. I'll report back to this thread after I've done some testing. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Sep

Re: [Rerank Query] Distributed search + pagination

2016-09-16 Thread Alessandro Benedetti
In addition to that, I think the only way to solve this is to rely on the aggregator node to actually re-rank after having aggregated. Cheer On Fri, Sep 9, 2016 at 11:48 PM, Alessandro Benedetti wrote: > Let me explain further, > let's assume a simple case when we have 2 shards. > ReRankDocs =1

Re: [Rerank Query] Distributed search + pagination

2016-09-09 Thread Alessandro Benedetti
Let me explain further, let's assume a simple case when we have 2 shards. ReRankDocs =10 , rows=10 . Correct me if I am wrong Joel, What we would like : 1 page : top 10 re-scored 2 page: remaining 10 re-scored >From page 3 the original scored docs. This is what is happening in a single sol instanc

Re: [Rerank Query] Distributed search + pagination

2016-09-09 Thread Joel Bernstein
I'm not understanding where the inconsistency comes into play. The re-ranking occurs on the shards. The aggregator node will be sent some docs that have been re-scored and others that are not. But the sorting should be the same as someone pages through the result set. Joel Bernstein http://joel

[Rerank Query] Distributed search + pagination

2016-09-09 Thread Alessandro Benedetti
Hi guys, was just experimenting some reranker with really low number of rerank docs ( 10= pageSize) . Let's focus on the distributed enviroment and the manual sharding approach. Currently what happens is that the reranking task is delivered by the shards, they rescore the docs and then send them

Re: Solr Cloud - how to implement local indexing without SSL and distributed search with SSL

2016-07-19 Thread Shawn Heisey
On 7/17/2016 8:13 AM, Sarit Weber wrote: > We noticed that indexing is much faster without SSL, but we can not > remove it from distributed search. Solr doesn't handle the networking. That's Jetty. Jetty sets up one listening port, and that port either uses SSL or it doesn'

Re: Solr Cloud - how to implement local indexing without SSL and distributed search with SSL

2016-07-19 Thread Sarit Weber
email: sar...@il.ibm.com From: Sarit Weber/Haifa/IBM@IBMIL To: solr-user@lucene.apache.org Date: 17/07/2016 05:21 PM Subject:Solr Cloud - how to implement local indexing without SSL and distributed search with SSL Hi all, We are currently using Solr 6.0.0, with Solr Cloud an

Solr Cloud - how to implement local indexing without SSL and distributed search with SSL

2016-07-17 Thread Sarit Weber
distributed - from each machine we want to search for data on the entire collection - using the Solr Cloud API. We noticed that indexing is much faster without SSL, but we can not remove it from distributed search. Because we force the index to be local (each machine index its own data) - We were

Solr Cloud - how to implement local indexing without SSL and distributed search with SSL

2016-07-17 Thread Sarit Weber
distributed - from each machine we want to search for data on the entire collection - using the Solr Cloud API. We noticed that indexing is much faster without SSL, but we can not remove it from distributed search. Because we force the index to be local (each machine index its own data) - We were

Re: Pivot facets - distributed search - request

2016-04-12 Thread Yonik Seeley
On Tue, Apr 12, 2016 at 8:47 AM, Pablo wrote: > Hi, > Is there any way of requesting limit 10 order by a stat within facet pivot? No. > I know that the "json facet" component can do this and it has a very > comphrehensive api, but it has a problem of consistency (refinement) when > querying acro

Pivot facets - distributed search - request

2016-04-12 Thread Pablo
s supports distributed searching, I tried to make a similar request, but couldn't find how to do it. Thanks in advance! -- View this message in context: http://lucene.472066.n3.nabble.com/Pivot-facets-distributed-search-request-tp4269570.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Null Pointer Exception on distributed search

2016-02-24 Thread Shawn Heisey
On 2/24/2016 9:58 AM, Lokesh Chhaparwal wrote: > Can someone please update on this exception trace while we are using > distributed search using shards parameter (solr-master-slave). The line of code where the NPE happened (from the 4.7.2 source) is in XMLWriter.java, at line 190:

Re: Null Pointer Exception on distributed search

2016-02-24 Thread Lokesh Chhaparwal
Hi, Can someone please update on this exception trace while we are using distributed search using shards parameter (solr-master-slave). Thanks, Lokesh On Wed, Feb 17, 2016 at 5:33 PM, Lokesh Chhaparwal wrote: > Hi, > > We are facing NPE while using distributed search (Solr vers

Null Pointer Exception on distributed search

2016-02-17 Thread Lokesh Chhaparwal
Hi, We are facing NPE while using distributed search (Solr version 4.7.2) (using *shards* parameter in solr query) Exception Trace: ERROR - 2016-02-17 16:44:26.616; org.apache.solr.common.SolrException; null:java.lang.NullPointerException at org.apache.solr.response.XMLWriter.writeSolrDocument

RE: How for distributed search only log collective search response

2015-12-18 Thread Koorosh Vakhshoori
It turns out there is a better way to do this. It does not require code change in Solr, if you are using log4j. However, you need to migrate to log4j.xml file format. The solution is to use the filter feature. Here is what my console appender looks like with the filter:

How for distributed search only log collective search response

2015-12-14 Thread Koorosh Vakhshoori
In my use case, I have a number of shards where a query would run as distributed search. I am not using Solr Cloud, I have just a Solr server. Now, when the search runs, I see one entry for each shard query as well as the finally collective search query response. As the results, I am ending

Re: Merging documents from a distributed search

2015-09-08 Thread tedsolr
ached when it will have to be split. -- View this message in context: http://lucene.472066.n3.nabble.com/Merging-documents-from-a-distributed-search-tp4226802p4227595.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Merging documents from a distributed search

2015-09-04 Thread tedsolr
looks like I need another solution for multi shard collections. -- View this message in context: http://lucene.472066.n3.nabble.com/Merging-documents-from-a-distributed-search-tp4226802p4227261.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Merging documents from a distributed search

2015-09-04 Thread Joel Bernstein
o store the > "unique" docs, but I only keep the docId, my stats, and the ordinals for > each field. Would you expect the new streams API to perform as well as my > implementation of an AnalyticsQuery and a DelegatingCollector? > > > > -- > View this message in

Re: Merging documents from a distributed search

2015-09-03 Thread Upayavira
On Wed, Sep 2, 2015, at 10:12 PM, tedsolr wrote: > I've read from http://heliosearch.org/solrs-mergestrategy/ > that the AnalyticsQuery > component only works for a single instance of Solr. I'm planning to > "migrate" to the SolrCloud soon and I ha

RE: Merging documents from a distributed search

2015-09-03 Thread Markus Jelsma
It seems so indeed. Please look up the thread titled "Custom merge logic in SolrCloud." -Original message- > From:tedsolr > Sent: Thursday 3rd September 2015 21:28 > To: solr-user@lucene.apache.org > Subject: RE: Merging documents from a distributed s

RE: Merging documents from a distributed search

2015-09-03 Thread tedsolr
Markus, did you mistakingly post a link to this same thread? -- View this message in context: http://lucene.472066.n3.nabble.com/Merging-documents-from-a-distributed-search-tp4226802p4227035.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Merging documents from a distributed search

2015-09-03 Thread tedsolr
message in context: http://lucene.472066.n3.nabble.com/Merging-documents-from-a-distributed-search-tp4226802p4227034.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Merging documents from a distributed search

2015-09-03 Thread Markus Jelsma
Hello - another current topic is also covering this issue, you may want to check it out: http://lucene.472066.n3.nabble.com/Merging-documents-from-a-distributed-search-td4226802.html -Original message- > From:Markus Jelsma > Sent: Thursday 3rd September 2015 10:27 > To:

RE: Merging documents from a distributed search

2015-09-03 Thread Markus Jelsma
> Sent: Wednesday 2nd September 2015 23:46 > To: solr-user@lucene.apache.org > Subject: Re: Merging documents from a distributed search > > The merge strategy probably won't work for the type of distributed collapse > you're describing. > > You may want to begin explo

Re: Merging documents from a distributed search

2015-09-02 Thread Joel Bernstein
gt; If shard1 returns docs A & B and shard2 returns docs B & C (letters > denoting > what I consider to be unique docs), can my implementation of a merge > strategy return only docs A, B, & C, rather than A, B, B, & C? > > thanks! > solr 5.2.1 > > > >

Merging documents from a distributed search

2015-09-02 Thread tedsolr
a merge strategy return only docs A, B, & C, rather than A, B, B, & C? thanks! solr 5.2.1 -- View this message in context: http://lucene.472066.n3.nabble.com/Merging-documents-from-a-distributed-search-tp4226802.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Problem with distributed search using grouping and highlighting

2015-07-09 Thread Cario, Elaine
to:rh...@identifix.com] Sent: Monday, June 08, 2015 2:23 PM To: solr-user@lucene.apache.org Subject: Problem with distributed search using grouping and highlighting I am currently using Solr 4.5.1. In the hopes of seeing better query performance, I have sharded an index and I am trying to use the s

Distributed Search component question

2015-06-19 Thread Mihran Shahinian
Hi all, I have the following search components that I don't have a solution at the moment to get them working in distributed mode on solr 4.10.4. [standard query component] [search component-1] (StageID - 2500): handleResponses: get few values from docs and populate parameters for stats component

Problem with distributed search using grouping and highlighting

2015-06-08 Thread Rich Hume
I am currently using Solr 4.5.1. In the hopes of seeing better query performance, I have sharded an index and I am trying to use the shards parameter along with grouping and highlighting. I am not currently using Solr cloud. I got past an earlier problem by adding a second sort parameter (as

Re: distributed search limitations via SolrCloud

2015-05-28 Thread Erick Erickson
5.x will still build a war file that you an deploy on Tomcat. But support for that is going away eventually, certainly by 6.0. But you do have to make the decision sometime before 6.0 at least. Best, Erick On Wed, May 27, 2015 at 1:24 PM, Vishal Swaroop wrote: > Thanks a lot Erick... great input

Re: distributed search limitations via SolrCloud

2015-05-27 Thread Vishal Swaroop
Thanks a lot Erick... great inputs... Currently our deployment is on Tomcat 7 and I think SOLR 5.x does not support Tomcat but runs on its own Jetty server, right ? I will discuss this with the team. Thanks again. Regards Vishal On Wed, May 27, 2015 at 4:16 PM, Erick Erickson wrote: > I'd mov

Re: distributed search limitations via SolrCloud

2015-05-27 Thread Erick Erickson
I'd move to Solr 4.10.3 at least, but preferably Solr 5.x. Solr 5.2 is being readied for release as we speak, it'll probably be available in a week or so barring unforeseen problems and that's the one I'd go with by preference. Do be aware, though, that the 5.x Solr world deprecates using a war fi

Re: distributed search limitations via SolrCloud

2015-05-27 Thread Vishal Swaroop
Thanks a lot Erick... You are right we should not delay moving to sharding/SolrCloud process. As you all are expert... currently we are using SOLR 4.7.. Do you suggest we should move to latest SOLR release 5.1.0 ? or we can manage the above issue using SOLR 4.7 Regards Vishal On Wed, May 27, 201

Re: distributed search limitations via SolrCloud

2015-05-27 Thread Erick Erickson
Hard to say. I've seen 20M doc be the place you need to consider sharding/SolrCloud. I've seen 300M docs be the place you need to start sharding. That said I'm quite sure you'll need to shard before you get to 2B. There's no good reason to delay that process. You'll have to do something about the

distributed search limitations via SolrCloud

2015-05-27 Thread Vishal Swaroop
Currently, we have SOLR configured on single linux server (24 GB physical memory) with multiple cores. We are using SOLR joins (https://wiki.apache.org/solr/Join) across cores on this single server. But, as data will grow to ~2 billion we need to assess whether we’ll need to run SolrCloud as "In a

Re: distributed search on tables

2015-04-08 Thread avinash09
thanks Erick -- View this message in context: http://lucene.472066.n3.nabble.com/distributed-search-on-tables-tp4197456p4198285.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: distributed search on tables

2015-04-03 Thread Erick Erickson
657666", > table_name: "product" > }, > { > name: "test 657689", > table_name: "product" > }, > { > name: "test 6576yu", > table_name: "product" > }, > { > name: "test 657607", > table_name: "product&qu

distributed search on tables

2015-04-03 Thread avinash09
689", table_name: "product" }, { name: "test 6576yu", table_name: "product" }, { name: "test 657607", table_name: "product" }, { name: "test 657687", table_name: "product" } ] }, facet_counts: { facet_queries: { }, facet_fields:

Distributed Search returns Empty document list

2015-01-14 Thread Jaikit Savla
Hello, I am running Solr (4.10) in cloud mode by configuring multiple collections (1 for each day). Structure is as shown below. I can fetch documents for given query, if I query individual collection. However when I send distributed request to multiple shards, I only see numFound and no documen

Re: Distributed search across Solr cores in a collection - NPE

2015-01-14 Thread Jaikit Savla
It was because I did not have unique id's in my index. I added that and it worked. Also it is mentioned as one of the requirement for Distributed Search. Thanks,Jaikit On Wednesday, January 14, 2015 1:53 AM, Jaikit Savla wrote: Folks, I have set up 3 cores in a single colle

Re: Distributed search across Solr cores in a collection - NPE

2015-01-14 Thread Mikhail Khludnev
Jaikit, uniq key is mandatory for distributed search. if most of your docs have ids assigned, you can drop remaining ones by adding something like ..&fq=id:[* TO *] On Wed, Jan 14, 2015 at 12:53 PM, Jaikit Savla < jaikit.sa...@yahoo.com.invalid> wrote: > Folks, > I have set

Distributed search across Solr cores in a collection - NPE

2015-01-14 Thread Jaikit Savla
Folks, I have set up 3 cores in a single collection and they all have same schema but different index. I have set unique Id required field to false. When I run query against single core, it works fine. But when I add the shard param and point to different core than request fails with NPE. I looke

Re: Fwd: Issue with SOLR Distributed Search

2014-12-18 Thread Shawn Heisey
he documents during distributed search, so that the results seem > more relevant. SOLR-1632 covers the distributed IDF issue. Plans right now are to include this in Solr 5.0 when it is released. https://issues.apache.org/jira/browse/SOLR-1632 The only way to have a reasonably accurate di

Fwd: Issue with SOLR Distributed Search

2014-12-17 Thread rashi gandhi
Hi, This is regarding the issue that we are facing with SOLR distributed search. In our application, we are managing multiple shards at SOLR server to manage the load. But there is a problem with the order of results that we going to return to client during the search. For Example: Currently

Re: Exception in unit tests for distributed search component

2014-11-27 Thread Shalin Shekhar Mangar
Is that the complete stack trace? There are multiple indexDoc methods in that class. Some of them assert that the response from control collection and the default collection are the same. However, in this case, it seems that an AssertionError is being sent from the server itself as a RemoteSolrExce

Exception in unit tests for distributed search component

2014-11-25 Thread Suchi Amalapurapu
Hi I am trying to test a custom distributed component with solr 4.6.1 which extends BaseDistributedSearchTestCase but end up with the following error. There are lot of tests in the solr code base which extend BaseDistributedSearchTestCase. Not sure what is wrong here. Suchi testDistribSearch(com.

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-23 Thread S.L
Shawn , Just wanted to follow up , I still face this issue of inconsistent search results on Solr Cloud 4.1.0.1 , upon further looking into logs , I found out a few exceptions , what was obvious was zkConnection time out issues and other exceptions , please take a look . *Logs* /opt/tomcat1/logs

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-17 Thread S.L
Shawn, Just wondering if you have any other suggestions on what the next steps whould be ? Thanks. On Thu, Oct 16, 2014 at 11:12 PM, S.L wrote: > Shawn , > > >1. I will upgrade to 67 JVM shortly . >2. This is a new collection as , I was facing a similar issue in 4.7 >and based on

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-16 Thread S.L
Shawn , 1. I will upgrade to 67 JVM shortly . 2. This is a new collection as , I was facing a similar issue in 4.7 and based on Erick's recommendation I updated to 4.10.1 and created a new collection. 3. Yes, I am hitting the replicas of the same shard and I see the lists are

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-16 Thread Shawn Heisey
On 10/16/2014 6:27 PM, S.L wrote: 1. Java Version :java version "1.7.0_51" Java(TM) SE Runtime Environment (build 1.7.0_51-b13) Java HotSpot(TM) 64-Bit Server VM (build 24.51-b03, mixed mode) I believe that build 51 is one of those that is known to have bugs related to Lucene. If you can upgr

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-16 Thread S.L
Shawn, Please find the answers to your questions. 1. Java Version :java version "1.7.0_51" Java(TM) SE Runtime Environment (build 1.7.0_51-b13) Java HotSpot(TM) 64-Bit Server VM (build 24.51-b03, mixed mode) 2.OS CentOS Linux release 7.0.1406 (Core) 3. Everything is 64 bit , OS , Java , and CPU

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-15 Thread Shawn Heisey
On 10/15/2014 10:24 PM, S.L wrote: Yes , I tried those two queries with distrib=false , I get 0 results for first and 1 result for the second query( (i.e. server 3 shard 2 replica 2) consistently. However if I run the same second query (i.e. server 3 shard 2 replica 2) with distrib=true, I som

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-15 Thread S.L
Shawn, Yes , I tried those two queries with distrib=false , I get 0 results for first and 1 result for the second query( (i.e. server 3 shard 2 replica 2) consistently. However if I run the same second query (i.e. server 3 shard 2 replica 2) with distrib=true, I sometimes get a result and somet

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-15 Thread Shawn Heisey
On 10/15/2014 9:26 PM, S.L wrote: Look at the logging information I provided below , looks like the results are only being returned back for this solrCloud cluster if the request goes to one of the two replicas of a shard. I have verified that numDocs in the replicas for a given shard is same b

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-15 Thread S.L
cky perhaps ;)... >> > > >> > > Erick >> > > >> > > On Mon, Oct 6, 2014 at 8:04 PM, S.L >> wrote: >> > > > Erick, >> > > > >> > > > Thanks for the suggestion , I am not sure if I would be able to >>

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-15 Thread S.L
ouldn't be anything you need to do to keep these in synch, > so > > > >> if you can capture what happened when things got out of synch we'll > > > >> fix it. But a lot has changed in the last several months, so the > first > > > >> thing I'd

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-14 Thread Tim Potter
t; > Hi Erick, > > >> > > > >> > Before I tried your suggestion of issung a commit=true update, I > > >> realized that for eaach shard there was atleast a node that had its > > index > > >> directory named like index.. > > >> > >

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-13 Thread S.L
ow the index directory got syched with the other node and is properly > >> named as 'index' without any timestamp attached to it.This is now > giving me > >> consistent results for distrib=true using a load balancer.Also > >> distrib=false returns expexted r

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-06 Thread Erick Erickson
gt;> > The underlying issue appears to be that in every shard the leader and >> the replica(follower) were out of sych. >> > >> > How can I avoid this from happening again? >> > >> > Thanks for your help! >> > >> > Sent from my HTC >

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-06 Thread S.L
ns expexted results for a given shard. > > > > The underlying issue appears to be that in every shard the leader and > the replica(follower) were out of sych. > > > > How can I avoid this from happening again? > > > > Thanks for your help! > > > > S

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-06 Thread Erick Erickson
> How can I avoid this from happening again? > > Thanks for your help! > > Sent from my HTC > > ----- Reply message - > From: "Erick Erickson" > To: > Subject: SolrCloud 4.7 not doing distributed search when querying from a load > balancer. > Date: Fri,

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-06 Thread S.L
leader and the replica(follower) were out of sych. How can I avoid this from happening again? Thanks for your help! Sent from my HTC - Reply message - From: "Erick Erickson" To: Subject: SolrCloud 4.7 not doing distributed search when querying from a load balancer. Date: Fri,

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-02 Thread Erick Erickson
do you mean by "indexing" anyway? How are documents being fed >> to your system? >> >> Best, >> Erick@PuzzledAsWell >> >> On Thu, Oct 2, 2014 at 7:32 PM, S.L wrote: >> > Erick, >> > >> > I would like to add that the interesting

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-02 Thread S.L
ndexing" anyway? How are documents being fed > to your system? > > Best, > Erick@PuzzledAsWell > > On Thu, Oct 2, 2014 at 7:32 PM, S.L wrote: > > Erick, > > > > I would like to add that the interesting behavior i.e point #2 that I > > mentioned in m

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-02 Thread Erick Erickson
w are documents being fed to your system? Best, Erick@PuzzledAsWell On Thu, Oct 2, 2014 at 7:32 PM, S.L wrote: > Erick, > > I would like to add that the interesting behavior i.e point #2 that I > mentioned in my earlier reply happens in all the shards , if this were to > be a dist

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-02 Thread S.L
Erick, I would like to add that the interesting behavior i.e point #2 that I mentioned in my earlier reply happens in all the shards , if this were to be a distributed search issue this should have not manifested itself in the shard that contains the key that I am searching for , looks like the

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-02 Thread S.L
ery a particular node ,I get the same behaviour as if I were using a loadbalancer , meaning the distributed search from a node works intermittently .Does this give any clue ? On Thu, Oct 2, 2014 at 7:47 PM, Erick Erickson wrote: > Hmmm, nothing quite makes sense here > > Here are some ex

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-02 Thread Erick Erickson
Hmmm, nothing quite makes sense here Here are some experiments: 1> avoid the load balancer and issue queries like http://solr_server:8983/solr/collection/q=whatever&distrib=false the &distrib=false bit will cause keep SolrCloud from trying to send the queries anywhere, they'll be served only

  1   2   3   4   5   6   7   >