Re: Master/Slave

2020-10-07 Thread Jan Høydahl
The API that enables master/slave is the ReplicationHandler, where the follower (slave) pulls index files from leader (master). This same API is used in SolrCloud for the PULL replica type, and also as a fallback for full recovery if transaction log is not enough. So I don’t see it going away an

Re: Question about solr commits

2020-10-07 Thread yaswanth kumar
Thank you very much both Eric and Shawn Sent from my iPhone > On Oct 7, 2020, at 10:41 PM, Shawn Heisey wrote: > > On 10/7/2020 4:40 PM, yaswanth kumar wrote: >> I have the below in my solrconfig.xml >> >> >> ${solr.Data.dir:} >> >> >> ${solr.autoCommit.maxTime:6000

Re: Question about solr commits

2020-10-07 Thread Shawn Heisey
On 10/7/2020 4:40 PM, yaswanth kumar wrote: I have the below in my solrconfig.xml ${solr.Data.dir:} ${solr.autoCommit.maxTime:6} false ${solr.autoSoftCommit.maxTime:5000} Does this mean even though we are always sending da

Re: Question about solr commits

2020-10-07 Thread Erick Erickson
Yes. > On Oct 7, 2020, at 6:40 PM, yaswanth kumar wrote: > > I have the below in my solrconfig.xml > > > > ${solr.Data.dir:} > > > ${solr.autoCommit.maxTime:6} > false > > > ${solr.autoSoftCommit.maxTime:5000} > > > > Does this mean even thoug

Re: Term too complex for spellcheck.q param

2020-10-07 Thread Walter Underwood
The spellcheck feature was replaced by the suggester in Solr 4, released in 2012, so I would not expect any changes in spellcheck. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Oct 7, 2020, at 3:53 PM, gnandre wrote: > > Is there a way to truncat

Re: Term too complex for spellcheck.q param

2020-10-07 Thread gnandre
Is there a way to truncate spellcheck.q param value from Solr side? On Wed, Oct 7, 2020, 6:22 PM gnandre wrote: > Thanks. Is this going to be fixed in some future version? > > On Wed, Oct 7, 2020, 4:15 PM Mike Drob wrote: > >> Right now the only solution is to use a shorter term. >> >> In a fuz

Question about solr commits

2020-10-07 Thread yaswanth kumar
I have the below in my solrconfig.xml ${solr.Data.dir:} ${solr.autoCommit.maxTime:6} false ${solr.autoSoftCommit.maxTime:5000} Does this mean even though we are always sending data with commit=false on update solr api, the above should

Re: Term too complex for spellcheck.q param

2020-10-07 Thread gnandre
Thanks. Is this going to be fixed in some future version? On Wed, Oct 7, 2020, 4:15 PM Mike Drob wrote: > Right now the only solution is to use a shorter term. > > In a fuzzy query you could also try using a lower edit distance e.g. term~1 > (default is 2), but I’m not sure what the syntax for a

Re: Term too complex for spellcheck.q param

2020-10-07 Thread Mike Drob
Right now the only solution is to use a shorter term. In a fuzzy query you could also try using a lower edit distance e.g. term~1 (default is 2), but I’m not sure what the syntax for a spellcheck would be. Mike On Wed, Oct 7, 2020 at 2:59 PM gnandre wrote: > Hi, > > I am getting following erro

Term too complex for spellcheck.q param

2020-10-07 Thread gnandre
Hi, I am getting following error when I pass ' 김포오피➬유유닷컴➬✗UUDAT3.COM유유닷컴김포풀싸롱て김포오피ふ김포휴게텔け김포마사지❂김포립카페じ김포안마 ' in spellcheck.q param. How to avoid this error? I am using Solr 8.5.2 { "error": { "code": 500, "msg": "Term too complex: 김포오피➬유유닷컴➬✗uudat3.com 유유닷컴김포풀싸롱て김포오피ふ김포휴게텔け김포마사지❂김포립카페じ김포

Using fromIndex for single collection

2020-10-07 Thread Irina Kamalova
I suppose my question is very simple. Am I right that if I want to use joins in the single collection in SolrCloud across several shards, I need to use semantic "fromIndex"? According to documentation I should use it only if I have different collections. I have one single collection across multiple

Re: Java GC issue investigation

2020-10-07 Thread Walter Underwood
First thing is to stop using CMS and use G1GC. We’ve been using these settings with over a hundred machines in prod for nearly four years. SOLR_HEAP=8g # Use G1 GC -- wunder 2017-01-23 # Settings from https://wiki.apache.org/solr/ShawnHeisey GC_TUNE=" \ -XX:+UseG1GC \ -XX:+ParallelRefProcEnabled

Re: Help using Noggit for streaming JSON data

2020-10-07 Thread Christopher Schultz
Yonic, Thanks for the reply, and apologies for the long delay in this reply. Also apologies for top-posting, I’m writing from my phone. :( Oh, of course... simply subclass the CharArr. In my case, I should be able to immediately base64-decode the value (saves 1/4 in-memory representation) and,

Solr 8.6.2 - Admin UI Issue

2020-10-07 Thread Vinay Rajput
Hi All, We are currently using Solr 7.3.1 in cloud mode and planning to upgrade. When I bootstrapped Solr 8.6.2 in my local machine and uploaded all necessary configs, I noticed one issue in admin UI. If I select a collection and go to files, it shows the content tree having all files and folders

Re: Java GC issue investigation

2020-10-07 Thread Karol Grzyb
Hi Matthew, Erick! Thank you very much for the feedback, I'll try to convince them to reduce the heap size. current GC settings: -XX:+CMSParallelRemarkEnabled -XX:+CMSScavengeBeforeRemark -XX:+ParallelRefProcEnabled -XX:+UseCMSInitiatingOccupancyOnly -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX: