solr cloud without hard commit?

2017-09-28 Thread Wei
Hello All, What are the impacts if solr cloud is configured to have only soft commits but no hard commits? In this way if a non-leader node crashes, will it still be able to recover from the leader? Basically we are wondering in a read heavy & write heavy scenario, whether taking hard commit out

Re: streaming with SolrJ

2017-09-28 Thread Joel Bernstein
There isn't much documentation for how to use the Streaming API java classes directly. All of the effort has been going into Streaming Expressions which you send to the /stream handler to execute. Over time it's become more and more complicated to use the Java classes because there are so many of t

How to recover from failed SPLITSHARD?

2017-09-28 Thread Kai 'wusel' Siering
Hi, this is with SolrCloud 6.5.1 on Ubuntu LTS 16.04 and OpenJDK 8, 4 Solr in Cloud mode, external ZK. I tried to split my colection's shard1 (500 GB) with SPLITSHARD, it kind of worked. After more than 8 hours the new shards left "construction" state — and entered "recovery" :( Another about

Re: streaming with SolrJ

2017-09-28 Thread Hendrik Haddorp
hm, thanks, but why are all those withFunctionName calls required and how did you get to this? On 28.09.2017 22:01, Susheel Kumar wrote: I have this snippet with couple of functions e.g. if that helps --- TupleStream stream; List tuples; StreamContext streamContext = new StreamC

Re: streaming with SolrJ

2017-09-28 Thread Susheel Kumar
I have this snippet with couple of functions e.g. if that helps --- TupleStream stream; List tuples; StreamContext streamContext = new StreamContext(); SolrClientCache solrClientCache = new SolrClientCache(); streamContext.setSolrClientCache(solrClientCache); StreamFactory

streaming with SolrJ

2017-09-28 Thread Hendrik Haddorp
Hi, I'm trying to use the streaming API via SolrJ but have some trouble with the documentation and samples. In the reference guide I found the below example in http://lucene.apache.org/solr/guide/6_6/streaming-expressions.html. Problem is that "withStreamFunction" does not seem to exist. Ther

Re: how to recover from OpenSearcher called on closed core

2017-09-28 Thread Erick Erickson
Are you using NFS or other shared file system? I have some details from Uwe Schindler on issues with NFS resulting from the fact that NFS is not POSIX compliant. Best, Erick On Thu, Sep 28, 2017 at 9:32 AM, rubi.hali wrote: > Hi Nawaz > > No we are not doing any upgradation. > > We hardly have 3

Re: how to recover from OpenSearcher called on closed core

2017-09-28 Thread rubi.hali
Hi Nawaz No we are not doing any upgradation. We hardly have 3 documents so we dont feel the need of having a cloud configuration Regarding d exception we analyzed before this error comes We always see Cahching Directory Factory closing the core Plus we tried Solr 6.2 version and the same e

Unauthorized Requests on Empty Solr Node

2017-09-28 Thread Chris Ulicny
Hi all, I've run into an issue with using the basic authentication plugin that comes with solr 6.3.0 that seems to prevent requests from being processed in certain situations. Essentially, if we have a solr node as part of a cloud but contains no replicas for any collection, it cannot process sea

RE: Modifing create_core's instanceDir attribute

2017-09-28 Thread Miller, William K - Norman, OK - Contractor
Thanks to you all. When I used the curl command (which I had forgotten to use) and put the url in quotes it worked with one exception. It did not copy the "conf" folder from my custom_configs folder that I had created under the configsets folder. I was able to just add a copy command in my sh

Re: CDCR does not work

2017-09-28 Thread Amrit Sarkar
Pretty much what Webster and Erick mentioned, else please try the pdf I attached. I followed the official documentation doing that. Amrit Sarkar Search Engineer Lucidworks, Inc. 415-589-9269 www.lucidworks.com Twitter http://twitter.com/lucidworks LinkedIn: https://www.linkedin.com/in/sarkaramrit2

Re: Filter Factory question

2017-09-28 Thread Erick Erickson
PatternCaptureGroupTokenFilter has been around since 2013 (at least that's the earliest revision in Git). I located it even in 5x so it should be there in ...lucene/analysis/common/src/java/org/apache/lucene/analysis/pattern Best, Erick On Thu, Sep 28, 2017 at 7:45 AM, Webster Homer wrote: > It'

Re: CDCR does not work

2017-09-28 Thread Erick Erickson
If Webster's idea doesn't solve it, the next thing to check is your tlogs on the source cluster. If you have a successful connection to the target and it's operative, the tlogs should be regularly pruned. If not, they'll collect updates forever. Also, your Solr logs should show messages as CDCR do

Re: Modifing create_core's instanceDir attribute

2017-09-28 Thread Shawn Heisey
On 9/27/2017 10:24 AM, Miller, William K - Norman, OK - Contractor wrote: > Thanks Erick for pointing me in this direction. Unfortunately when I try to > us this I get an error. Here is the command that I am using and the response > I get: > > https://solrserver:8983/solr/admin/cores?action=CRE

Re: how to recover from OpenSearcher called on closed core

2017-09-28 Thread Nawab Zada Asad Iqbal
Hi Are you upgrading from an earlier version? If not, I am curious why not try SolrCloud instead of Master/Slave. Is there any other error before this error in the logs? Did the core close after a crash? Regards Nawab On Thu, Sep 28, 2017 at 2:57 AM, rubi.hali wrote: > Hi > > we are using So

Re: Solr Beginner!!

2017-09-28 Thread Nawab Zada Asad Iqbal
Hi Jaya Text extraction is a step before you put data into solr. Say, you have pdf or doc type documents, you will extract the text (minus unnecessary formatting details etc.) and store in solr. Later you can query it as you said. i have not worked in extraction area, but look at this for an idea:

Re: CDCR does not work

2017-09-28 Thread Webster Homer
Check that you have autoCommit enabled in the target schema. Try sending a commit to the target collection. If you don't have autoCommit enabled then the data could be replicating but not committed so not searchable On Thu, Sep 28, 2017 at 1:57 AM, Jiani Yang wrote: > Hi, > > Recently I am tryi

Re: Solr cloud most stable version

2017-09-28 Thread Nawab Zada Asad Iqbal
Hi Lars Although, that doesn't really answer of whether 6.6.1 is the most stable one or not, but there has been a recent security fix, so definitely go to 6.6.1 . Copied the detail below:- CVE-2017-9803: Security vulnerability in kerberos delegation token functionality Severity: Important Ve

Re: Filter Factory question

2017-09-28 Thread Webster Homer
It's still buggy, so not ready to share. I keep a copy of Solr source which I use for this type of development. I don't see PatternCaptureGroupTokenFilterFactory in the Solr 6.2 code base at all. I was thinking of seeing how it treated the positions etc... My code now looks reasonable in the Anal

how to recover from OpenSearcher called on closed core

2017-09-28 Thread rubi.hali
Hi we are using Solr 6.1.0 version. We have done a Master/Slave Setup where in Slaves we have enabled replication polling after 300 seconds But after every replication poll, we are getting an error : Index Fetch Failed: opening NewSearcher called on closed core. We have enabled softcommit after

CDCR does not work

2017-09-28 Thread Jiani Yang
Hi, Recently I am trying to use CDCR to do the replication of my solr cluster. I have done exactly as what the tutorial says, the tutorial link is shown below: https://lucene.apache.org/solr/guide/6_6/cross-data-center-replication-cdcr.html But I cannot see any change on target data center even e

how to recover from OpenSearcher called on closed core

2017-09-28 Thread rubi.hali
Hi We are using solr6.1 version and have a master slave setup. We have one master and two slaves . We have enabled replication poll on slaves at an interval of 300s which results into an error and says *Index Fetch Failed : Open NewSearcher Called on closed core* And our commit strategy involve

Solr Beginner!!

2017-09-28 Thread Johnson, Jaya
Hi: I am trying to ingest a few memos - they do not have any standard format (json, xml etc etc) but just plain text however the memos all follow some template. What I would like to od post ingestion is to extract keywords and some values around it. So say for instance if the text contains the k

Solr cloud most stable version

2017-09-28 Thread Lars Karlsson
Hi, wanted to check if anyone can help guide with most stable version between 6.3 and 6.6.1 Which should I choose ? And, are there any performance tests that one can look at for each release? Regards Lars

Re: SOLR terminology

2017-09-28 Thread alessandro.benedetti
>From the Solr wiki[1] : *Logical* /Collection/ : It is a collection of documents which share the same logical domain and data structure *Physical* /Solr Node/ : It is a single instance of a Solr Server. From OS point of view it is a single Java Process ( internally it is the Solr Web App deploy

Re: SOLR terminology

2017-09-28 Thread Emir Arnautović
Hi, Let’s start from the top and introduce also Shards, Primaries and Replicas: SolrCluster is a cluster of Solr Nodes. Nodes are part of the same cluster if reading configuration from the same “folder” of the same Zookeeper ensemble (ensemble = cluster in ZK terminology). Node is the instance of

Re: SOLR terminology

2017-09-28 Thread Rick Leir
Gunalan, Solr Core (core), is one-to-one with a Solr process and its data directory. It can be a shard, or part of a replica. Collection - is one or more shards grouped together, and can be replicated for reliability, availability and performance Node - is a machine in a Zookeeper group SolrClu