Solr not starting after enabling SSL

2019-04-02 Thread Anchal Sharma2
Hi All, We recently migrated our existing solr(version 5.3.0) from AIX OS server to Linux based server.And it works fine(http solr) . RHEL version 7.6 Java version 1.8(IBM Java) But now ,when trying to enable SSL over same ,the solr doesnt start after enabling SSL. It says "Address already in

Indexing PDF files in SqlBase database

2019-04-02 Thread Arunas Spurga
Hello, I got a task to index in Solr 7.71 a PDF files which are stored in SqlBase database. I did half the job - I can to index all table fields, I can do a search in these fields except field in which is stored a pdf file content. As I am ttotally new in Solr, spent unsuccessfully a lot a time tr

Re: Slower indexing speed in Solr 8.0.0

2019-04-02 Thread Toke Eskildsen
On Wed, 2019-04-03 at 10:17 +0800, Zheng Lin Edwin Yeo wrote: > What could be the reason that causes the indexing to be slower in > Solr 8.0.0? As Aroop states there can be multiple explanations. One of them is the change to how DocValues are handled in 8.0.0. The indexing impact should be tiny, b

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-02 Thread Walter Underwood
If you have fast disk and enough RAM, indexing is CPU limited. So adjust the indexing load until the CPU is busy but not overloaded. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Apr 2, 2019, at 9:23 PM, Aroop Ganguly wrote: > > Thats an interest

Re: Slower indexing speed in Solr 8.0.0

2019-04-02 Thread Zheng Lin Edwin Yeo
I'm using external zookeeper, running on Solr Cloud with one shards and two replicas. This is a testing setup, so there is only one machine. The input data is coming from CSV file. I am indexing one CSV file at a time, and each CSV file contains 3 million records. I'm indexing using the code from t

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-02 Thread Aroop Ganguly
Thats an interesting scaling scheme you mention. I have been trying to devise a good scheme for myself for our scale. I will try to see how this works out for us. > On Apr 2, 2019, at 9:15 PM, Walter Underwood wrote: > > Yeah, that would overload it. To get good indexing speed, I configure two

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-02 Thread Walter Underwood
Yeah, that would overload it. To get good indexing speed, I configure two clients per CPU on the indexing machine. With one shard on a 16 processor machine, that would be 32 threads. With four shards on four 16 processor machines, 128 clients. Basically, one thread is waiting while the CPU proce

Re: Slower indexing speed in Solr 8.0.0

2019-04-02 Thread Aroop Ganguly
Indexing speeds are function of a lot of variables in my experience. What is your setup like? What kind of cluster you have, the number of shards you created, the number of machines etc? Where is your input data coming from? What technology do you use to indexing (simple java threads or somethi

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-02 Thread Aroop Ganguly
Mutliple threads to the same index ? And how many concurrent threads? Our case is not merely multiple threads but actually large scale spark indexer jobs that index 1B records at a time with a concurrency of 400. In this case multiple such jobs were indexing into the same index. > On Apr 2, 20

Re: Slower indexing speed in Solr 8.0.0

2019-04-02 Thread Zheng Lin Edwin Yeo
For additional info, I am still using the same version of the major components like ZooKeeper, Tika, Carrot2 and Jetty. Regards, Edwin On Wed, 3 Apr 2019 at 10:17, Zheng Lin Edwin Yeo wrote: > Hi, > > I am setting up the latest Solr 8.0.0, and I am re-indexing the data from > scratch in Solr 8.

Re: Error getting replica locations : unable to get autoscaling policy session when creating collection

2019-04-02 Thread Zheng Lin Edwin Yeo
I run the following command to allow Solr and ZooKeeper to communicate via https. Without this, they are still trying to communicate via http. zkcli.bat -zkhost localhost:2181 -cmd clusterprop -name urlScheme -val https Another issue which may cause this issue is that you have not created the SS

Slower indexing speed in Solr 8.0.0

2019-04-02 Thread Zheng Lin Edwin Yeo
Hi, I am setting up the latest Solr 8.0.0, and I am re-indexing the data from scratch in Solr 8.0.0 However, I found that the indexing speed is slower in Solr 8.0.0, as compared to the earlier version like Solr 7.7.1. I have not changed the schema.xml and solrconfig.xml yet, just did a change of

Suggestions API for system properties

2019-04-02 Thread Richard Goodman
Hi there, I have been slowly building up my cluster policies to re-produce the rules we set on our collections when they are created *(pre v7)*. One of these rules was rack awareness, which I've implemented by the following: { "replica": "#EQUAL", "shard": "#EACH", "sysprop.racklocation": "

How to configure default replication type?

2019-04-02 Thread Roger Lehmann
Hello, I'm using SolrCloud version 7.7.1 and want to try using *only* the TLOG replication type (excepting the leader of course). Where can I configure that as default? Ideally cluster-wide. Can I use the *set-cluster-policy* or *set-trigger *(for my nodeAdded trigger) API calls to define that? Or

Re: unable to find valid certification path to requested target

2019-04-02 Thread R Chander
Hi Jeremy, First of all, I want to thank you for helping me yesterday.  The issue is resolved now and I am able to index documents using Norconex Committer.  One issue that I am still running into is that I can run Solr admin using  https://localhost:8983 but when I instead try accessing through

RE: ERROR: Error CREATEing SolrCore 'nutch': Unable to create core [nutch] Caused by: invalid boolean value:

2019-04-02 Thread vishal thummala
Hi Sid, 1. Does folder/configuration actually exist (ie: Did you copy the folder to /opt/solr/server/solr/nutch/conf/ )? Yes the configuration does exist 2. I noticed you wrote that you are using Nutch 1.5. Is that a typo for Nutch 1.15? It was a typo. I am using Nutch 1.15 3. Have you tr

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-02 Thread Walter Underwood
We run multiple threads indexing to Solr all the time and have been doing so for years. How big are your documents and how big are your batches? wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Apr 1, 2019, at 10:51 PM, Aroop Ganguly wrote: > > Tur

ERROR: Error CREATEing SolrCore 'nutch': Unable to create core [nutch] Caused by: invalid boolean value:

2019-04-02 Thread vishal.thumm...@its.ny.gov
Hi, I am getting the following error while creating a core in Solr 8.0.0 "ERROR: Error CREATEing SolrCore 'nutch': Unable to create core [nutch] Caused by: invalid boolean value:" Command I am using to create the core: #/opt/solr/bin/solr create -c nutch -d /opt/solr/server/solr/nutch/conf/ -for

Re: problems with indexing documents

2019-04-02 Thread Bill Tantzen
Right, as Mark said, this is how the dates were indexed previously. However, instead of passing in the actual String, we passed a java.util.Date object which was automagically converted to the correct string. Now (the code on our end has not changed), solr throws an exception because the string it

Concurrent Updates

2019-04-02 Thread Mark Johnson
We have a SolrCloud cluster (of 3 nodes) running solr 6.4.2. Every night, we delete and recreate our whole catalog. In this process, we're simultaneously running a query which recreates the product catalog (which includes child documents of a different type) and a query that creates a third documen

Re: problems with indexing documents

2019-04-02 Thread Mark H. Wood
I'm also working on this with Bill. On Tue, Apr 02, 2019 at 09:44:16AM +0800, Zheng Lin Edwin Yeo wrote: > Previously, did you index the date in the same format as you are using now, > or in the Solr format of "-MM-DDTHH:MM:SSZ"? As may be seen from the sample code: > > doc.addField ( "date"

Solr-Docker in Prod?

2019-04-02 Thread Susheel Kumar
Hello, If you are running Solr in a docker container in Production, can you please share you experience/tips/issues you came across with performance/sharding/CDCR etc. Also I assume you might have take image from docker hub/or do you compose your own image https://hub.docker.com/_/solr Thanks,

RE: ERROR: Error CREATEing SolrCore 'nutch': Unable to create core [nutch] Caused by: invalid boolean value:

2019-04-02 Thread Sadiki Latty
Hey Vishal, 1. Does folder/configuration actually exist (ie: Did you copy the folder to /opt/solr/server/solr/nutch/conf/ )? 2. I noticed you wrote that you are using Nutch 1.5. Is that a typo for Nutch 1.15? 3. Have you tried rolling back to a 7.x version? (It is possible that the Nutch 1.15 c

Re: Error getting replica locations : unable to get autoscaling policy session when creating collection

2019-04-02 Thread ShaniZ
I encountered the same error, how did you resolve this? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: KeywordTokenizerFactory and Standard Query Parser

2019-04-02 Thread Chris Ulicny
Actually, nevermind. I found the part of the upgrade to 7 that was missed " The sow (split-on-whitespace) request param now defaults to false (true in previous versions). This affects the edismax and standard/"lucene" query parsers: if the sow param is not specified, query text will not be split o

Re: Solr 7 not removing a node completely due to too small thread pool

2019-04-02 Thread Roger Lehmann
To be more specific: I currently have 19 collections, where each node has exactly one replica per collection. A new node will automatically create new replicas on itself, one for each existing collection (see cluster-policy above). So when removing a node, all 19 collection replicas of it need to b

KeywordTokenizerFactory and Standard Query Parser

2019-04-02 Thread Chris Ulicny
Hi all, We have a multivalued field that has an integer at the beginning followed by a space, and the index analyzer chain extracts that value to search on testField:[ 34 blah blah blah 27 blah blah blah ... ] The query analyzer chain is just a keyword tokenizer factory since the clients

Re: Documentation for Apache Solr 8.0.0?

2019-04-02 Thread Jan Høydahl
There is also a *DRAFT* HTML version of the to-be 8.1 guide built by Jenkins, see https://builds.apache.org/view/L/view/Lucene/job/Solr-reference-guide-8.x/javadoc/ It may serve as a place to read up while waiti

Re: how to sort the solr suggester's result

2019-04-02 Thread akhilendrajha
Even i want to do the same thing. How did you do it? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html