Re: Solr cloud production set up

2020-02-24 Thread Paras Lehana
Hi Rajdeep, 1. I assume you had enabled docValues for the facet fields, right? 2. What does your GC logs tell? Do you get freezes and CPU spikes during intervals? 3. Caching will help in querying. I'll need to see a sample query of yours to recommend what you can tweak. On Tue, 2

Re: Solr 6.3 and OpenJDK 11

2020-02-24 Thread Paras Lehana
Hi Arnold, Why not simply use the latest Solr 8 with Java 11? Upgrade is worth it. :) Actually, no one would be able to answer your question without having the experience with the same. Or you can experiment and report the experience here. :P On Wed, 29 Jan 2020 at 04:43, Arnold Bronley wrote:

Re: Spell check with data from database and not from english dictionary

2020-02-24 Thread Paras Lehana
Just asking here. What are community's experiences regarding using spellcheck with external file against Synonym filter for exact matches? On Wed, 29 Jan 2020 at 17:28, seeteshh wrote: > Hello Jan > > Let me work on your suggestions too. > > Also I had one query > > While working on the spell c

Re: Query Autocomplete Evaluation

2020-02-24 Thread Walter Underwood
Here is a blog article with a worked example for MRR based on customer clicks. https://observer.wunderwood.org/2016/09/12/measuring-search-relevance-with-mrr/ At my place of work, we compare the CTR and MRR of queries using suggestions to those that do not use suggestions. Solr autosuggest based

Re: Re: Query Autocomplete Evaluation

2020-02-24 Thread Paras Lehana
Hey Audrey, I assume MRR is about the ranking of the intended suggestion. For this, no human judgement is required. We track position selection - the position (1-10) of the selected suggestion. For example, this is our recent numbers: Position 1 Selected (B3) 107,699 Position 2 Selected (B4) 58,7

Re: Solr Cloud Question

2020-02-24 Thread Erick Erickson
Assuming that the Solr node you stop does not contain all of the replicas for any shard, there should really be no effect. I do strongly recommend that you stop the node gracefully if possible unless what you really want to test is when a node goes away mysteriously... What’ll happen is that al

Re: Reindex Required for Merge Policy Changes?

2020-02-24 Thread Erick Erickson
Thomas: Yes, upgrading to 7.5+ will automagically take advantage of the improvements, eventually... No, you don’t have to reindex. The “eventually” part. As you add, and particularly replace, existing documents, TMP will make decisions based on the new policy. If you’ve optimized in the past an

Reindex Required for Merge Policy Changes?

2020-02-24 Thread Zimmermann, Thomas
Hi Folks – Few questions before I tackled an upgrade here. Looking to go from 7.4 to 7.7.2 to take advantage of the improved Tiered Merge Policy and segment cleanup – we are dealing with some high (45%) deleted doc counts in a few cores. Would simply upgrading Solr and setting the cores to use

Solr Cloud Question

2020-02-24 Thread Kevin Sante
Hello guys, I need some help understanding the setup with solr cloud. I am a newbie to solr and I have successfully set up solr cloud with some alarms on AWS. I have a two solr nodes and 3 zookeeper nodes for my set up. I already have data indexed on the nodes and I am able to query the data fr

Re: 5th solr node does not connect to zk host

2020-02-24 Thread Sotiris Fragkiskos
It was problem with /etc/resolv.conf in the end, unrelated to solr or zk. Thanks Erick! On Mon, Feb 24, 2020 at 3:20 PM Erick Erickson wrote: > Your solr logs on that node will probably give you a better idea of what > the root cause is. > > best, > Erick > > > On Feb 24, 2020, at 8:18 AM, Soti

Re: Re: Query Autocomplete Evaluation

2020-02-24 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
Hi Paras, This is SO helpful, thank you. Quick question about your MRR metric -- do you have binary human judgements for your suggestions? If no, how do you label suggestions successful or not? Best, Audrey On 2/24/20, 2:27 AM, "Paras Lehana" wrote: Hi Audrey, I work for Auto-S

Re: 5th solr node does not connect to zk host

2020-02-24 Thread Erick Erickson
Your solr logs on that node will probably give you a better idea of what the root cause is. best, Erick > On Feb 24, 2020, at 8:18 AM, Sotiris Fragkiskos wrote: > > Hi all! > I had a cluster with 2 solr nodes, and a single zk host and it all worked > fine. > Then we got 3 more VMs, so i con

Re: Missing methods in solr-common.jar

2020-02-24 Thread Sachin Divekar
Thanks, Jan. Yep, solr-common.jar was not required. -- Sachin On Mon, Feb 24, 2020 at 6:56 PM Jan Høydahl wrote: > solr-common is old. Try to include solr-core:8.4.1 in your project instead > (from Maven) > > Check this example if you’re stuck: > https://github.com/cominvent/solr-mapping-proces

Re: Missing methods in solr-common.jar

2020-02-24 Thread Jan Høydahl
solr-common is old. Try to include solr-core:8.4.1 in your project instead (from Maven) Check this example if you’re stuck: https://github.com/cominvent/solr-mapping-processor Jan > 24. feb. 2020 kl. 14:03 skrev Sachin Divekar : > > Hi, > > I am developing a custom update processor. I am usi

5th solr node does not connect to zk host

2020-02-24 Thread Sotiris Fragkiskos
Hi all! I had a cluster with 2 solr nodes, and a single zk host and it all worked fine. Then we got 3 more VMs, so i configured them *in parallel* to the *exact* same configuration, so that they can be added to the existing cluster. 2 of them connected fine, and the third just refuses to. I can see

Missing methods in solr-common.jar

2020-02-24 Thread Sachin Divekar
Hi, I am developing a custom update processor. I am using solr-common.jar:1.3.0 which I found on Maven. I am studying the code in Solr repo. I found there are many methods available in src/java/org/apache/solr/common/SolrInputDocument.java which are not available for me after importing solr-commo

Re: Ordering in Nested Document

2020-02-24 Thread Mikhail Khludnev
You may try. Content-type should be absolutely the same across parents and child-free. It may work now. Earlier, mixing blocks and childfrees in one index wasn't supported. On Mon, Feb 24, 2020 at 2:57 AM Gajendra Dadheech wrote: > That extra s was intentional, should have added a better name. >

Re: Auto-Suggest within Tier Architecture

2020-02-24 Thread Paras Lehana
Hi Brett, We, at IndiaMART, have Solr installed behind PHP servers which are behind Varnish servers. Yes, you are right exposing Solr URL is not a good idea. A single service in between would do the trick. You can try our service at dir.indiamart.com. We have a client-side JS that handles AJAX r

Re: Exact search in Solr

2020-02-24 Thread Paras Lehana
Use fieldType string. If you're using custom fieldType, "secret" would not match with "secrets" unless you use appropriate analyzer (Stemmer, EdgeNGrams) but it may still match with "secret something" if you're using StandardTokenizer or something similar (use KeywordTokenizer). On Tue, 4 Feb 202

Re: ID is a required field in SolrSchema . But not found in DataConfig

2020-02-24 Thread Paras Lehana
Your schema describes id as a required field. You need to tell Solr which field from the source (most probably, the primary key) will be the id field in Solr index. On Tue, 4 Feb 2020 at 23:15, Karl Stoney wrote: > Hey all, > I'm trying to use the DIH to copy from one collection to another, it >

Re: Ordering in Nested Document

2020-02-24 Thread Gajendra Dadheech
That extra s was intentional, should have added a better name. So ideally we shouldn't have childfree and blocks together while indexing? Or in the whole index they shouldn't be together, i.e. We should have atleast one child doc for all if any of doc has one? On Mon, Feb 24, 2020 at 4:24 PM Mikh

Re: Ordering in Nested Document

2020-02-24 Thread Mikhail Khludnev
Hello, Gajendra. Pics doesn't come through mailing list. May it caused by unnecessary s *s* parentDocument? At least earlier mixing childfrees and blocks wasn't allowed, and caused some troubles. Usually, child stub used to keep childfrees in the index. On Mon, Feb 24, 2020 at 2:22 AM Gajendra Da

Ordering in Nested Document

2020-02-24 Thread Gajendra Dadheech
Hi i want to ingest below documents, where there is a mix of nested and un-nested documents: 5 5 5Solr adds block join support sparentDocument 1 1 Solr adds block join support parentDocument 2 1 SolrCloud

Re: How to monitor the performance of the SolrCloud cluster in real time

2020-02-24 Thread Adonis Ling
Hi Emir, Thanks for your suggestion! Cloud based monitoring solution doesn't satisfy the security requirements, so we can't use it. Emir Arnautović 于2020年2月24日周一 下午3:48写道: > Hi Adonis, > If you are up to 3rd party, cloud based monitoring solution, you can try > our integration for Solr/SolrCl