Re: Solr Aggregation queries are way slower than Elastic Search

2017-12-11 Thread RAUNAK AGRAWAL
Hi Yonik, I will try the JSON Facet API and update here but my hunch is that querying mechanism is not the problem. Rather the problem lies with the solr aggregations. Thanks On Tue, Dec 12, 2017 at 6:31 AM, Yonik Seeley wrote: > I think the SolrJ below uses the old stats component. > Hopefull

Re: Solr Aggregation queries are way slower than Elastic Search

2017-12-11 Thread Yonik Seeley
I think the SolrJ below uses the old stats component. Hopefully the JSON Facet API would be faster for this, but it's not completely clear what the main query here looks like, and if it's the source of any bottleneck rather than the aggregations. What does the generated query string actually look l

Solr Aggregation queries are way slower than Elastic Search

2017-12-11 Thread RAUNAK AGRAWAL
Hi, We have a use case where there are 4-5 dimensions and around 3500 metrics in a single document. We have indexed only 2 dimensions and made all the metrics as doc_values so that we can run the aggregation queries. We have 6 million such documents and we are using solr cloud(6.6) on a 6 node cl

Re: Solr ssl issue while creating collection

2017-12-11 Thread Shawn Heisey
On 12/11/2017 12:24 PM, Sundaram, Dinesh wrote: > 1. Configure SSL > using https://lucene.apache.org/solr/guide/7_1/enabling-ssl.html > > 2. Restart solr  > 3. Validate solr with https url https://localhost:8983/solr - works fine > 4. Create a collection https://localhost:8983/solr/#/~collections >

Re: How to implement Incremental Indexing.

2017-12-11 Thread Rick Leir
Fiz Here is a blog article that seems to cover your plans https://www.toadworld.com/platforms/nosql/b/weblog/archive/2017/02/03/indexing-mongodb-data-in-apache-solr Also look at github, there are several projects which could do it for you. Cheers -- Rick On December 11, 2017 5:19:43 PM EST, Fiz N

Re: Recovery Issue - Solr 6.6.1 and HDFS

2017-12-11 Thread Joe Obernberger
Thank you Erick.  Perhaps it makes more sense to not use any replicas when using HDFS for storage (and having a very large index) since it is already replicated.  It seems to me that if there were no replicas, and a leader went down, that another node could take over by just going through the r

How to implement Incremental Indexing.

2017-12-11 Thread Fiz Newyorker
Hello Solr Group Team, I am working on Solr 6.5 and indexing data from MongoDB 3.2.5. I want to know the best practices to implement incremental indexing. Every 30 mins the Updated Data in Mongo DB needs to indexed on Solr. How to implement this. ? How would Solr know whenever there is an update

Re: solr.TrieDoubleField deprecated with 7.1.0 but wildcard "*" search behaviour is different with solr.DoublePointField

2017-12-11 Thread Chris Hostetter
AFAICT The behavior you're describing with Trie fields was never intentionally supported/documented? It appears that it only worked as a fluke side effect of how the default implementation of FieldType.getprefixQuery() was inherited by Trie fields *and* because "indexed=true" TrieFields use T

Solr suggester build takes a very long time

2017-12-11 Thread ruby
So when following command is run to build solr suggester: ?suggest.build=true It takes a very long time to finish. I found out that this is because each time dictionary is built, it does not build delta, it rebuilds the entire dictionary. Is there a way to speed up the suggester build time? TIA

RE: FW: Need Help Configuring Solr To Work With Nutch

2017-12-11 Thread Mukhopadhyay, Aratrika
Thank you Erick Erickson and Rick Leir . My issue was permission related where the solr user was not running the indexing job through Nutch and therefore was being unable to write anything to Solr. I changed the ownership of the nutch's runtime directory to solr and all is well and working. I th

Incremental Indexing on Solr 6.5.

2017-12-11 Thread Fiz Newyorker
Hi Team, I am working on Solr 6.5 and indexing data from MongoDB 3.2.5. I want to the best practices to implement incremental indexing. Like . Every 30 mins the Updated the Data in Mongo DB needs to indexed on Solr. How to implement this. ? How would Solr know whenever there is an update on Mongo

RE: Solr ssl issue while creating collection

2017-12-11 Thread Sundaram, Dinesh
Hi, How do I change the protocol to https everywhere including replica. NOTE: I have just only one node 8983. started solr using this command. bin/solr start -cloud -p 8983 -noprompt 1. Configure SSL using https://lucene.apache.org/solr/guide/7_1/enabling-ssl.html 2. Restart solr 3. Validate so

Solr ssl issue while creating collection

2017-12-11 Thread Sundaram, Dinesh
Hi, How do I change the protocol to https everywhere including replica. NOTE: I have just only one node 8983. started solr using this command. bin/solr start -cloud -p 8983 -noprompt 1. Configure SSL using https://lucene.apache.org/solr/guide/7_1/enabling-ssl.html 2. Restart solr 3. Validate so

Re: Solrcloud Drupal 7

2017-12-11 Thread Fengtan
One way to provide Solr with the config files is to upload them to ZooKeeper https://lucene.apache.org/solr/guide/6_6/using-zookeeper-to-manage-configuration-files.html#UsingZooKeepertoManageConfigurationFiles-UploadingConfigurationFilesusingbin_solrorSolrJ This can be achieved by copying the conf

Re: Specific cores/collections to specific nodes

2017-12-11 Thread Erick Erickson
Take a look at the collections API CREATE command, especially the "createNodeSet". One variant lets you specify the nodes used to distribute the collection with limited control over what core goes where through the createNodeSet.shuffle parameter. Alternatively you can use "EMPTY" for the createNo

Re: Solrcloud Drupal 7

2017-12-11 Thread Per Qvindesland
Hi Thanks for the information. Once the collection is created how do you drop such as the schema.xml to the folder locations, I have used rsync -av search_api_solr/solr-conf/5.x /var/solr/data/search_shard2_replica1/ on one instance but I can’t see the files being replicated between the insta

Re: Solr :: How to trigger the DIH from SolrNet API with C# code

2017-12-11 Thread Shawn Heisey
On 12/11/2017 4:40 AM, Karan Saini wrote: > *Solr Version :: 6.6.1* > API :: SolrNet with C# based application > > I wish to invoke or trigger the data import handler from the C# code with > the help of SolrNet. But i am unable to locate any tutorial in the SolrNet > API. > > Please suggest how do

Re: Solrcloud Drupal 7

2017-12-11 Thread Fengtan
Hi, Drupal can talk to a SolrCloud cluster the same way it talks to a standalone Solr server, i.e. by using the Search API suite https://www.drupal.org/project/search_api You will have to create the collection yourself on Solr though (Drupal will not do it for you). If you want to take advantage

Re: Learning to Rank (LTR) with grouping

2017-12-11 Thread Roopa Rao
Hi Diego, Thank you, I am interested in reranking the documents inside one of the groups. I will try the options you mentioned here. Thank you, Roopa On Mon, Dec 11, 2017 at 6:57 AM, Diego Ceccarelli (BLOOMBERG/ LONDON) < dceccarel...@bloomberg.net> wrote: > Hi Roopa, > > If you look at the d

Solrcloud Drupal 7

2017-12-11 Thread Per Qvindesland
Hi All I have a solr cloud with zookeeper 3.4.10 and solr 5.4.1, i on 3 centos 7 instances in AWS, I intend to use the cluster for Drupal 7 search. At the moment we have 2 instances running in production with each having their own solr installation (no cloud) but I would like to improve the red

solr.TrieDoubleField deprecated with 7.1.0 but wildcard "*" search behaviour is different with solr.DoublePointField

2017-12-11 Thread Torsten Krah
Hi, some question about the new DoublePointField which should be used instead of the TrieDoubleField in 7.1. https://lucene.apache.org/solr/guide/7_1/field-types-included-with-solr.html If i am using the deprecated one its possible to get a match for a double field like this: test_d:* even in

Re: Learning to Rank (LTR) with grouping

2017-12-11 Thread Diego Ceccarelli (BLOOMBERG/ LONDON)
Hi Roopa, If you look at the diff: https://github.com/apache/lucene-solr/pull/162/files I didn't change much in SolrIndexSearcher, you can try to skip the file when applying the patch and redo the changes after. Alternatively, the feature branch is available here: https://github.com/bloombe

Solr :: How to trigger the DIH from SolrNet API with C# code

2017-12-11 Thread Karan Saini
Hi guys, *Solr Version :: 6.6.1* API :: SolrNet with C# based application I wish to invoke or trigger the data import handler from the C# code with the help of SolrNet. But i am unable to locate any tutorial in the SolrNet API. Please suggest how do i invoke the data import action from the C# ba

Specific cores/collections to specific nodes

2017-12-11 Thread Leo Prince
Hi, I just wanted to delegate specific Solr nodes to specific collections. As per my understanding, when a collection creates in Solr7, core is automatically creates in the backend. Since my cores are getting different volume of traffic, I wanted to delegate specific collections to specific nodes.