Re: [EXTERNAL] Re: Facet Sorting

2018-07-23 Thread Satheesh . Akkinepally
Chris, I was trying the below method for sorting the faceted buckets but am seeing that the function query query($q) applies only to the score from “q” parameter. My solr request has a combination of q, “bq” and “bf” and it looks like the function query query($q) is calculating the scores only o

Anthill Inside and The Fifth Elephant Bengaluru India 2018 Edition

2018-07-23 Thread Amrit Sarkar
*Anthill Inside and The Fifth Elephant -- HasGeek’s marquee annual conferences -- bring together business decision makers, data engineers, architects, data scientists and product managers – to understand nuances of managing and leveraging data. And what’s more, Solr community members can avail a 10

Re: Solr fails even ZK quorum has majority

2018-07-23 Thread Shalin Shekhar Mangar
Can you please open a Jira issue? I don't think we handle DNS problems very well during startup. Thanks. On Tue, Jul 24, 2018 at 2:31 AM Susheel Kumar wrote: > Something messed up with DNS which resulted into unknown host exception for > one the machines in our env and caused Solr to throw the a

How to use tika-OCR in data import handler?

2018-07-23 Thread Yasufumi Mizoguchi
Hi, I am trying to use tika-OCR(Tesseract) in data import handler and found that processing English documents was quite good. But I am struggling to process the other languages such as Japanese, Chinese, etc... So, I want to know how to switch Tesseract-OCR's processing language via data import

Re: Solr fails even ZK quorum has majority

2018-07-23 Thread Susheel Kumar
Something messed up with DNS which resulted into unknown host exception for one the machines in our env and caused Solr to throw the above exception Eric, I have the Solr configured using service installation script and the ZK_HOST entry in solr.in.sh="server1:2181,server2:2181,server3:2181/coll

Re: Solr fails even ZK quorum has majority

2018-07-23 Thread Erick Erickson
And how do you start Solr? Do you use the entire 3-node ensemble address? On Mon, Jul 23, 2018 at 12:55 PM, Michael Braun wrote: > Per the exception, this looks like a network / DNS resolution issue, > independent of Solr and Zookeeper code: > > Caused by: org.apache.solr.common.SolrException: >

Re: Solr fails even ZK quorum has majority

2018-07-23 Thread Michael Braun
Per the exception, this looks like a network / DNS resolution issue, independent of Solr and Zookeeper code: Caused by: org.apache.solr.common.SolrException: java.net.UnknownHostException: ditsearch001.es.com: Name or service not known Is this address actually resolvable at the time? On Mon, Jul

Solr fails even ZK quorum has majority

2018-07-23 Thread Susheel Kumar
In usual circumstances when one Zookeeper goes down while others 2 are up, Solr continues to operate but when one of the ZK machine was not reachable with ping returning below results, Solr count't starts. See stack trace below ping: cannot resolve ditsearch001.es.com: Unknown host Setup: Solr

Re: SolrCloud acceptable latency, when to use CDCR?

2018-07-23 Thread Erick Erickson
It Depends (tm). There are several issues when communications are unreliable, basically all having to do with timeouts. > ZK not getting "keep alive" requests back in time and marking the node as down > leaders not getting responses back in time from followers in time and putting > them into rec

Re: /state.json vs /clusterstate.json

2018-07-23 Thread Erick Erickson
Oh boy. These bits are awkward during the transition but I think you'll be OK. bq. "but for some of them there is no entry state.json" This is a bit concerning. Are the entries in clustersate.json for valid replicas that are _not_ in the associated state.json? There is a cluster property "legacy

Re: Question

2018-07-23 Thread Alexandre Rafalovitch
That depends on what you mean by "unstructured" and "handle". If by "unstructured" you mean things like PDFs and MSWord - which are structured under the covers, then yes. Solr ships with Apache Tika to injest such documents (see shipped examples as well as Data Import Handler example). E.g. http:/

Re: Can I use RegEx function?

2018-07-23 Thread Peter Sh
Right you are. I hadn't been known it during index-time On Mon, Jul 23, 2018 at 3:43 PM Erik Hatcher wrote: > this is best done at index-time. (it seems like you're trying to avoid > doing that though) > > > > > On Jul 23, 2018, at 5:36 AM, Peter Sh wrote: > > > > I want to be able to parse "

Re: Solr 7 replication speed cap?

2018-07-23 Thread David Hastings
Actually this could be ignored, I think solr 5 used Mb in the admin interface and solr 7 is using MB, correct? On Mon, Jul 23, 2018 at 9:33 AM, David Hastings < hastings.recurs...@gmail.com> wrote: > Hey all, just set up a tradition solr slave to my indexing master > alongside a solr 5 instance.

Re: Question

2018-07-23 Thread Andrea Gazzarini
Hi Driss, I think the answer to the first question is yes, but I guess It doesn't help you so much. Second and third questions: "It depends", you should describe better your contest, narrowing questions ad much as possibile ("how can web do It" is definitely top much generic) Best, Andrea Il lun

Solr 7 replication speed cap?

2018-07-23 Thread David Hastings
Hey all, just set up a tradition solr slave to my indexing master alongside a solr 5 instance. on solr 5 we were getting about 100 MB/sec over our interface, and it would divide accordingly for how many slaves were replicating, ie 50 MB each if two slaves were replicating 33 for three so on a so f

Question

2018-07-23 Thread Driss Khalil
Hi, I'm new to Solr and I just want to know if it's possible to handle Unstrcutured data in solr .If yes how can we do it ? Do we need it to combine it with something else? *Driss KHALIL* Responsable prospection & sponsoring, Forum GENI Entreprises. Elève ingénieur en Génie Logiciel, ENSIAS.

Re: Can I use RegEx function?

2018-07-23 Thread Erik Hatcher
this is best done at index-time. (it seems like you're trying to avoid doing that though) > On Jul 23, 2018, at 5:36 AM, Peter Sh wrote: > > I want to be able to parse "KEY:VALUE" pairs from my text and have a facet > representing distribution of VALUES > > On Mon, Jul 23, 2018 at 12:25 PM

/state.json vs /clusterstate.json

2018-07-23 Thread Patrick Recchia
>From what I know until today, the status of a solr cluster used to be stored in a zk entry /clusterstate.json; but is now, from solr 5.0, stored within a sub-folder /collections//state.json. We are having issues with our cluster, and I have noticed today that: for most of the collections there i

SolrCloud acceptable latency, when to use CDCR?

2018-07-23 Thread Pavel Micka
Hi, We are discussing advantages of SolrCloud Replication and Cross Data Center Replication (CDCR). In CDCR docs, it is written that "The SolrCloud architecture is not particularly well suited for situations where a single SolrCloud cluster consists of nodes in separated data clusters connected

Re: Can I use RegEx function?

2018-07-23 Thread Peter Sh
I want to be able to parse "KEY:VALUE" pairs from my text and have a facet representing distribution of VALUES On Mon, Jul 23, 2018 at 12:25 PM Markus Jelsma wrote: > Hello, > > Neither fl nor facet.field support functions, but facet.query is analogous > to the latter. I do not understand what y

RE: Can I use RegEx function?

2018-07-23 Thread Markus Jelsma
Hello, Neither fl nor facet.field support functions, but facet.query is analogous to the latter. I do not understand what you need/want with fl and regex. Regards, Markus -Original message- > From:Peter Sh > Sent: Monday 23rd July 2018 11:21 > To: solr-user@lucene.apache.org > Subj

Re: Can I use RegEx function?

2018-07-23 Thread Peter Sh
Can I use it in "fl" and "facet.field" as a function On Mon, Jul 23, 2018 at 11:33 AM Markus Jelsma wrote: > Hello, > > The usual faceting works for all queries, facet.query=q:field:/[a-z]+$/ > will probably work too, i would be really surprised if it didn't. Keep in > mind that my example does

RE: Can I use RegEx function?

2018-07-23 Thread Markus Jelsma
Hello, The usual faceting works for all queries, facet.query=q:field:/[a-z]+$/ will probably work too, i would be really surprised if it didn't. Keep in mind that my example doesn't work, the + needs to be URL encoded! Regards, Markus -Original message- > From:Peter Sh > Sent: Mon

Re: Can I use RegEx function?

2018-07-23 Thread Peter Sh
can it be used in facets? On Mon, Jul 23, 2018, 11:24 Markus Jelsma wrote: > Hello, > > It is not really obvious in documentation, but the standard query parser > supports regular expressions. Encapsulate your regex with forward slashes > /, q=field:/[a-z]+$/ will work. > > Regards, > Markus > >

RE: Can I use RegEx function?

2018-07-23 Thread Markus Jelsma
Hello, It is not really obvious in documentation, but the standard query parser supports regular expressions. Encapsulate your regex with forward slashes /, q=field:/[a-z]+$/ will work. Regards, Markus -Original message- > From:Peter Sh > Sent: Monday 23rd July 2018 10:09 > To: so

Can I use RegEx function?

2018-07-23 Thread Peter Sh
I've got collection with a string or text field storing free-text. I'd like to use some RexEx function looking for patterns like "KEY:VALUE" from the text and use it for filtering and faceting.

Re: Solr [subquery] document transformer

2018-07-23 Thread Mikhail Khludnev
Hello, Dwane. [subquery] is made unaware of authentication. You can create a jira ticket for this feature. On Mon, Jul 23, 2018 at 5:42 AM Dwane Hall wrote: > Good afternoon knowledgeable solr community. I’m experiencing problems > using a document transformer across a multiple shard collectio