Different number of replicas for different shards

2019-06-28 Thread Nawab Zada Asad Iqbal
Hi, is it possible to specify different number of replicas for different shards? i.e if I expect some shard to get more queries , i can add more replicas to that shard alone, instead of adding replicas for all the shards. Thanks Nawab

Re: Discuss: virtual nodes in Solr

2019-06-28 Thread Will Martin
From: S G mailto:sg.online.em...@gmail.com>> Subject: Discuss: virtual nodes in Solr Date: June 28, 2019 at 8:04:44 PM EDT To: solr-user@lucene.apache.org Reply-To: solr-user@lucene.apache.org Hi, Has Solr tried to use vnodes

Discuss: virtual nodes in Solr

2019-06-28 Thread S G
Hi, Has Solr tried to use vnodes concept like Cassandra: https://www.datastax.com/dev/blog/virtual-nodes-in-cassandra-1-2 If this can be implemented carefully, we need not live with just shard-splitting alone that can only double the number of shards. With vnodes, shards can be increased incremen

Re: Solr 7.7.2 - Autoscaling in new cluster ignoring sysprop rules, possibly all rules

2019-06-28 Thread Andrew Kettmann
Entered ticket https://issues.apache.org/jira/browse/SOLR-13586 Sadly, no patch attached this time as it is a much more complicated issue than my last one, and a good bit above my paygrade with Java. From: Andrzej Białecki Sent: Friday, June 28, 2019 4:29:49

Re: different numFound value /select vs. /export

2019-06-28 Thread Kudrettin Güleryüz
Thank you, issue was indeed format error. On Fri, Jun 28, 2019 at 2:23 PM Colvin Cowie wrote: > */stream?explain=true&expr=sear* > > > *ch(myCore,zkHost=”192.168.1.10:2181 > ",qt=”/export”,q=”*:*”, fl=”id”,sort=”id asc”) > returns* > * 'search(myCore,zkHost=”192.168.1.1

Re: different numFound value /select vs. /export

2019-06-28 Thread Colvin Cowie
*/stream?explain=true&expr=sear* *ch(myCore,zkHost=”192.168.1.10:2181 ",qt=”/export”,q=”*:*”, fl=”id”,sort=”id asc”) returns* * 'search(myCore,zkHost=”192.168.1.10:2181 \",qt=”/export”,q=”** *:*”, fl=”id”,sort=”id asc”)' is not a proper expres

Re: Question regarding Solr fq query

2019-06-28 Thread Saurabh Sharma
Hi, Images are not visible. Please upload on some image sharing platform and share the link. Thanks On Fri, 28 Jun, 2019, 11:00 PM Krishna Kammadanam, wrote: > Hello, > > > > I am a back-end developer working with Solr 4.0 version. > > > > I am running into so many issues, but trying to unders

Question regarding Solr fq query

2019-06-28 Thread Krishna Kammadanam
Hello, I am a back-end developer working with Solr 4.0 version. I am running into so many issues, but trying to understand at the same time. But I have a question for anyone who can help me. [cid:image001.png@01D52DA7.A0B2FA10] [cid:image004.png@01D52DA8.1A222A60] A list exists within The Jou

Re: different numFound value /select vs. /export

2019-06-28 Thread Kudrettin Güleryüz
Thank you for responding. I didn't go though the parsers involved, I assume they'd be the defaults. I did notice later, though that /export is core specific. In fact we have a Solr Cloud with 6 shards. I also found out that /stream can be used for this but couldn't get a solution that works so fa

Re: different numFound value /select vs. /export

2019-06-28 Thread Erick Erickson
First I’d make sure that you were using the same query parser in both situations. Second, export is specific to a core, it is not cloud-aware so if this is SolrCloud I’d expect major differences, which you haven’t told us about, off by 5? 10,000?. Third, there was a bug at one point where exp

different numFound value /select vs. /export

2019-06-28 Thread Kudrettin Güleryüz
Hi, I'd like to give my website users ability to export a field for the full search result set. Specifying a very large pageSize seems to perform very poorly for this purpose. Therefore, considering using export requestHandler for exporting search results. When I play with a core, I noticed that

Re: Best practice for saving state of large cluster?

2019-06-28 Thread Jörn Franke
I agree - and it would provide you the opportunity to use snapshots for backups on S3. > Am 28.06.2019 um 15:06 schrieb Kyle Fransham : > > Just my two cents, but why not put your data on EBS volumes and decouple > from the AMI? This way you're storing the collections in the "amazon > suggested"

Re: Relevance by term position

2019-06-28 Thread Alexandre Rafalovitch
This past thread may be relevant: https://markmail.org/message/aau6bjllkpwcpmro It suggests that using SpanFirst of XMLQueryParser will have automatic boost for earlier matches. The other approach suggested was to use Payloads (which got better since the original thread). Regards, Alex. On Thu

Re: Best practice for saving state of large cluster?

2019-06-28 Thread Kyle Fransham
Just my two cents, but why not put your data on EBS volumes and decouple from the AMI? This way you're storing the collections in the "amazon suggested" way: https://aws.amazon.com/premiumsupport/knowledge-center/instance-store-vs-ebs/ Also saves the (potentially error-prone) step of creating a n

Best practice for saving state of large cluster?

2019-06-28 Thread chris
I have a cluster of 100 shards on 100 nodes, with solr 7.5, running in AWS.The use case is read-dominant, with ingestion performed about once per week. There are about 84 billion documents in the cluster. It is unused on weekends and only used during normal business hours M-F.What I do now is af

Synonym SpellCheckCollator StringIndexOutOfBoundsException

2019-06-28 Thread Gonzalo Carracedo
Hello, Using version 6.5.1, I get the error: *java.lang.StringIndexOutOfBoundsException: String index out of range: -1 at java.lang.AbstractStringBuilder.replace(AbstractStringBuilder.java:851) at java.lang.StringBuilder.replace(StringBuilder.java:262) at org.apache.solr.spelling.SpellCheckC

Re: refused connection

2019-06-28 Thread Colvin Cowie
I've not seen that error before (except when it's a failed JVM_BIND because the port is in use), but a quick google suggests it might be related to file descriptor limits being enforced by your OS https://groups.google.com/forum/#!topic/gatling/rRpv8LPa51I On Fri, 28 Jun 2019 at 09:34, Midas A wr

Re: Solr 7.7.2 - Autoscaling in new cluster ignoring sysprop rules, possibly all rules

2019-06-28 Thread Andrzej Białecki
Andrew, please create a JIRA issue - in my opinion this is a bug not a feature, or at least something that needs clarification. > On 27 Jun 2019, at 23:56, Andrew Kettmann > wrote: > > I found the issue. Autoscaling seems to silently ignore rules (at least > sysprop rules). Example rule: > >

Querying _nest_path_ while querying child

2019-06-28 Thread Saurabh Sharma
Hi All, I am currently working on nested documents and not able to find a way to query the _nest_path_ field. There is no documentation about it.we can reach to children using q={!parent which='-_nest_path_:* *:*'} But is there any way using which we can reach deeper levels using _nest_path_.

Re: refused connection

2019-06-28 Thread Midas A
We are doing bulk indexing here . Might it be possible due to heavy indexing . jetty connection related thing ? On Fri, Jun 28, 2019 at 1:47 PM Markus Jelsma wrote: > Hello, > > If you get a Connection Refused, then normally the server is just offline. > But, something weird is hiding in your st

RE: refused connection

2019-06-28 Thread Markus Jelsma
Hello, If you get a Connection Refused, then normally the server is just offline. But, something weird is hiding in your stack trace, you should check it out further: > Caused by: java.net.ConnectException: Cannot assign requested address > (connect failed) I have not seen this before. Regards

Re: refused connection

2019-06-28 Thread Midas A
Please reply . THis error is coming intermittently. On Fri, Jun 28, 2019 at 11:50 AM Midas A wrote: > Hi All , > > I am getting following error while indexing . Please suggest resolution. > > We are using kafka consumer to index solr . > > > org.apache.solr.client.solrj.SolrServerException: Ser