Load existing Lucene sharded indexes onto single Solr collection

2015-01-14 Thread Jaikit Savla
Folks, I have generated multiple (count of 100) sharded Lucene indexes on Hadoop and they are of format. The total indexed data (sum of all the index-*) is of size 500GB and hence the number of shards.drwxr-x--- 2 index-66drwxr-x--- 2 index-68drwxr-x--- 2 index-9 and each index directory

Re: Load existing Lucene sharded indexes onto single Solr collection

2015-01-14 Thread Jaikit Savla
l Khludnev wrote: On Wed, Jan 14, 2015 at 11:42 AM, Jaikit Savla wrote: Now to load this index, I am currently using Lucene IndexMergeTool to merge all the shards into one giant index. My question is, is there a way to load shared index without merging into one giant index on to single

Distributed search across Solr cores in a collection - NPE

2015-01-14 Thread Jaikit Savla
Folks, I have set up 3 cores in a single collection and they all have same schema but different index. I have set unique Id required field to false. When I run query against single core, it works fine. But when I add the shard param and point to different core than request fails with NPE. I looke

Re: Load existing Lucene sharded indexes onto single Solr collection

2015-01-14 Thread Jaikit Savla
On Wed, Jan 14, 2015 at 1:25 AM, Jaikit Savla wrote: > This solution will merge the index as well. I want to find out if merge is > "required" before loading indexes onto Solr ?  If that is possible than I can > just point solrconfig.xml to directory where I have all the shards

Re: Distributed search across Solr cores in a collection - NPE

2015-01-14 Thread Jaikit Savla
It was because I did not have unique id's in my index. I added that and it worked. Also it is mentioned as one of the requirement for Distributed Search. Thanks,Jaikit On Wednesday, January 14, 2015 1:53 AM, Jaikit Savla wrote: Folks, I have set up 3 cores in a single colle

Distributed Search returns Empty document list

2015-01-14 Thread Jaikit Savla
Hello, I am running Solr (4.10) in cloud mode by configuring multiple collections (1 for each day). Structure is as shown below. I can fetch documents for given query, if I query individual collection. However when I send distributed request to multiple shards, I only see numFound and no documen

Solr numFound > 0 but doc list empty in Solr Cloud setup

2015-01-16 Thread Jaikit Savla
I am using below tutorial for Solr Cloud setup with 2 shards http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster I am able to get the default set up working. However, I have a requirement where my index is not in default location (data/index) and hence when I start jvm for

Re: Solr numFound > 0 but doc list empty in Solr Cloud setup

2015-01-16 Thread Jaikit Savla
ws=0 in your handler? Or is it possible that you have not set stored="true" for any of your fields? Best, Erick On Fri, Jan 16, 2015 at 9:46 AM, Jaikit Savla wrote: > I am using below tutorial for Solr Cloud setup with 2 shards > http://wiki.apache.org/solr/SolrCloud#Example_A:

Re: Solr numFound > 0 but doc list empty in Solr Cloud setup

2015-01-16 Thread Jaikit Savla
, 2015 11:56 AM, Jaikit Savla wrote: Verified that all my fields are stored and marked as indexed. --> http://localhost:/solr/collection1/query?q=body%3A%22from%22&wt=json&indent=true&shards=http://localhost:/solr/collection1&start=1&rows=10&shards.info=true

Re: Solr numFound > 0 but doc list empty in Solr Cloud setup

2015-01-16 Thread Jaikit Savla
e: all of above works in single core mode. On Friday, January 16, 2015 12:13 PM, Jaikit Savla wrote: As I said earlier - single core set up works fine with same solrconfig.xml and schema.xml cd example java -Djetty.port= -Dsolr.data.dir=/index/path -jar start.jar I am running Solr-4.10.

Re: Solr numFound > 0 but doc list empty in Solr Cloud setup

2015-01-16 Thread Jaikit Savla
015 at 12:20 PM, Jaikit Savla < jaikit.sa...@yahoo.com.invalid> wrote: > One more point: > In cloud mode: If I submit a request with fl=id, it returns doc list. But > when I add any other field, I get an empty doc list. > > > http://localhost:/solr/select?q=domain:ebay&am

Re: Solr numFound > 0 but doc list empty in Solr Cloud setup

2015-01-16 Thread Jaikit Savla
15 1:24 PM, Jaikit Savla wrote: I followed all the steps listed here: http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster I have not updated solrconfig.xml and it is same as what comes default with 4.10. The only thing I added extra was list of my fields in example/