AW: AW: SolrClient#updateByQuery?

2018-01-26 Thread Clemens Wyss DEV
Thanks for all these (main contributor's 😉) valuable inputs! First thing I did was getting getting rid of "expungeDeletes". My "single-deletion" unittest failed unti I added the optimize-param > updateReques.setParam( "optimize", "true" ); Does this make sense or should JIRA it? How expensive is

Re: 7.2.1 cluster dies within minutes after restart

2018-01-26 Thread Shawn Heisey
On 1/26/2018 10:02 AM, Markus Jelsma wrote: > o.a.z.ClientCnxn Client session timed out, have not heard from server in > 22130ms (although zkClientTimeOut is 3). Are you absolutely certain that there is a setting for zkClientTimeout that is actually getting applied?  The default value in Solr

Re: AW: SolrClient#updateByQuery?

2018-01-26 Thread Shawn Heisey
On 1/26/2018 9:55 AM, Clemens Wyss DEV wrote: > Why do I want to do all this (dumb things)? The context is as follows: > when a document is deleted in an index/core this deletion is not immediately > reflected in the searchresults. Deletions at not really NRT (or has this > changed?). Till now we

Re: Bitnami, or other Solr on AWS recommendations?

2018-01-26 Thread Shawn Heisey
On 1/26/2018 12:24 PM, TK Solr wrote: > If I want to deploy Solr on AWS, do people recommend using the > prepackaged Bitnami Solr image? Or is it better to install Solr > manually on a computer instance? Or are there a better way? Solr has included an installer script for quite some time (since 5.

Re: Bitnami, or other Solr on AWS recommendations?

2018-01-26 Thread Phillip Rhodes
Also shameless self-promotion, but my company (Fogbeam Labs) is about to launch a Solr / ManifoldCF powered Search-as-a-Service offering. If you'd like to learn more, shoot me an email at prho...@fogbeam.com and I'd be happy to give you the skinny. Phil This message optimized for indexing by NSA

Re: Solr 7.2.1 - cursorMark and elevateIds

2018-01-26 Thread Greg Roodt
Ok, thanks for the clarification. I'll open a Jira issue. On Fri, 26 Jan 2018 at 01:21, Yonik Seeley wrote: > Yes, please open a JIRA issue. > The elevate component modifies the sort parameter, and it looks like > that doesn't play well with cursorMark, which needs to > serialize/deserialize s

Re: Bitnami, or other Solr on AWS recommendations?

2018-01-26 Thread Sameer Maggon
Although this is shameless promotion, but have you taken a look at SearchStax (https://www.searchstax.com)? Why not use a Solr-as-a-Service? On Fri, Jan 26, 2018 at 11:24 AM, TK Solr wrote: > If I want to deploy Solr on AWS, do people recommend using the prepackaged > Bitnami Solr image? Or is i

Re: Bitnami, or other Solr on AWS recommendations?

2018-01-26 Thread John Bickerstaff
I guess I'd say test with the image - especially if you're deploying a larger number of Solr boxes. We do a lot of them where I work and (unfortunately, for reasons I won't bother you with) can't use an image. The time it takes to install solr is noticeable when we deploy Solr on our 100 plus EC2

Re: SolrClient#updateByQuery?

2018-01-26 Thread Erick Erickson
Wait. What do you mean by: "... this deletion is not immediately reflected in the search results..."? Like all other index operations this change won't be "visible" until the next commit, but expungeDeletes is (or should be) totally unnecessary. And very costly for reasons other than you might be a

cdcr replication of new collection doesn't replicate

2018-01-26 Thread Webster Homer
We have just upgraded our QA solr clouds to 7.2.0 We have 3 solr clouds. collections in the first cloud replicate to the other 2 For existing collections which we upgraded in place using the lucene index upgrade tool seem to behave correctly data written to collections in the first environment rep

Bitnami, or other Solr on AWS recommendations?

2018-01-26 Thread TK Solr
If I want to deploy Solr on AWS, do people recommend using the prepackaged Bitnami Solr image? Or is it better to install Solr manually on a computer instance? Or are there a better way? TK

Re: Solr 4.8.1 multiple client updates the same collection

2018-01-26 Thread Shawn Heisey
On 1/26/2018 4:23 AM, Vincenzo D'Amore wrote: > The first client does the following: > > 1. rollbacks all add/deletes made to the index since the last commit (in > case previous client execution was completed unsuccessfully). > 2. reads data from sql server > 3. updates solr documents > 4. manually

Re: SolrClient#updateByQuery?

2018-01-26 Thread Walter Underwood
Use a filter query to filter out all the documents marked deleted. Don’t use “expunge deletes”, it does more than you want because it forces a merge. Just commit after sending the delete. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Jan 26, 2018

Re:***UNCHECKED*** Limit Solr search to number of character/words (without changing index)

2018-01-26 Thread Diego Ceccarelli (BLOOMBERG/ LONDON)
Hi Zahid, if you want to allow searching only if the query is shorter than a certain number of terms / characters, I would do it before calling solr probably, otherwise you could write a QueryParserPlugin (see [1]) and check that the query is sound before processing it. See also: http://coding

7.2.1 cluster dies within minutes after restart

2018-01-26 Thread Markus Jelsma
Hello, We recently upgraded our clusters from 7.1 to 7.2.1. One collection (2 shard, 2 replica) specifically is in a bad state almost continuously, After proper restart the cluster is all green. Within minutes the logs are flooded with many bad omens: o.a.z.ClientCnxn Client session timed out,

AW: SolrClient#updateByQuery?

2018-01-26 Thread Clemens Wyss DEV
Thx Emir! > You are thinking too RDMS maybe the DBQ "missled" me 😉 > The best you can do is select and send updates as a single bulk how can I do "In-Place Updates" (https://lucene.apache.org/solr/guide/6_6/updating-parts-of-documents.html#UpdatingPartsofDocuments-In-PlaceUpdates) from/through

Re: SolrClient#updateByQuery?

2018-01-26 Thread Emir Arnautović
Hi Clemens, You are thinking too RDMS. You can use query to select doc, but how would you provide what are updated doc? I guess you could use this approach only for incremental updates or with some scripting language. That is not supported at the moment. The best you can do is select and send up

SolrClient#updateByQuery?

2018-01-26 Thread Clemens Wyss DEV
SolrClient has the method(s) deleteByQuery (which I make use of when I need to reindex). #updateByQuery does nicht exist. What if I want to "update all documents matching a query"? Thx Clemens

Re: pf2

2018-01-26 Thread Rick Leir
Emir Sow=false .. thanks for this! The problem seems to be due to a stopword. Everything is fine when I avoid stopwords in my query. The stopword might get removed in the query matching, but I would need to allow some slop perhaps for pf2. Thanks Rick On January 26, 2018 8:14:06 AM EST, "Emir

***UNCHECKED*** Limit Solr search to number of character/words (without changing index)

2018-01-26 Thread Muhammad Zahid Iqbal
Hi All, Is there any way I can restrict Solr search query to look for specified number of characters/words (for only searching purposes not for highlighting) *For example:* *Indexed content:* *I am a man of my words I am a lazy man...* Search to consider only below mentioned (words=7 or

Re: pf2

2018-01-26 Thread Emir Arnautović
Hi Rick, It does not work in any case or it does not work for some cases - e.g. something like l’avion? Maybe you can try use sow=false and see if it will help. Cheers, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sem

RE: solr usage reporting

2018-01-26 Thread Rick Leir
Becky, There are excellent log analysis systems. Logstash? Awstats? I do not think Solr should do this. Some people index their logs into a separate Solr core for analysis, but it might be a challenge to do this in a useful way. Cheers -- Rick On January 25, 2018 2:56:01 PM EST, Becky Bonner wr

Re: pf2

2018-01-26 Thread Rick Leir
Emir Thanks, I will do when I get off this bus. I have run the text thru the SolrAdmin Analyzer, it looks fine. According to the debugQuery output, individual words match in the qf, but not the pair that pf2 should match. I compare the configs for English and French, and they are the same apart

Re: Solr 4.8.1 multiple client updates the same collection

2018-01-26 Thread Vincenzo D'Amore
Thanks Shawn, >> >> 30 >> false >> >> > > That autoCommit configuration is not affecting document visibility at all, > because openSearcher is set to false. Don't rush to change this -- this > kind of configuration is what you want. I would probably use one minute > here rather than five

Re: pf2

2018-01-26 Thread Emir Arnautović
Hi Rick, Can you include sample of your query and text that should match. Thanks, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > On 25 Jan 2018, at 23:13, Rick Leir wrote: > > > > Hi all > My pf2 k