Re: IndexWriter has closed

2019-03-29 Thread Aroop Ganguly
Trying again .. Any idea why this might happen? > On Mar 27, 2019, at 10:43 PM, Aroop Ganguly wrote: > > Hi Everyone > > My indexing jobs are failing with “this IndexWriter has closed” errors.. > This is a solr 7.5 setup, with an NRT index. > > In deeper logs I see, some of these exceptions,

Re: Upgrade Solr 8.0.0 issue

2019-03-29 Thread Zheng Lin Edwin Yeo
Yes, if you have changes to solrconfig.xml or schema.xml, just upconfig and reload the collection. Not necessary to restart Solr. It's not necessary to change the index directly, but you can change it in the core.properties if you want to store the index elsewhere (Eg: in another drive). Regards,

Re: Upgrade Solr 8.0.0 issue

2019-03-29 Thread vishal patel
But by mistake zoo_data version2 folder delete then upconfig and again create the collection? Sent from Outlook From: Zheng Lin Edwin Yeo Sent: Friday, March 29, 2019 1:07 PM To: vishal patel Cc: solr-user@lucene.apache.org Subject: Re:

Re: Upgrade Solr 8.0.0 issue

2019-03-29 Thread vishal patel
If I delete the product_shard1_replica_n1 folder then what about data folder? because its in this folder . It also need to delete?. Do you need to backup of data folder or change the data directory? Sent from Outlook From: Zheng Lin Edw

Re: How to implement security for solr admin page

2019-03-29 Thread Jan Høydahl
You are probably looking for authentication and authorization. The documentation has you covered: https://lucene.apache.org/solr/guide/7_7/securing-solr.html -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com

Re: Upgrade Solr 8.0.0 issue

2019-03-29 Thread Jan Høydahl
I recommend to do a CLEAN install of Solr 8. Wipe out all old stuff. Completely Empty :) Then create your collection and uploading your config at the same time: bin/solr create -c mycollection -replicationFactor 2 -d /path/to/conf/folder Then re-index your content and you're good to go. Do not b

Re: Upgrade Solr 8.0.0 issue

2019-03-29 Thread Zheng Lin Edwin Yeo
Yes, delete both the data folder and the core.properties file. When you create the collection they will be created again. If you have indexed data to the collection before, then you can backup to keep the old index if you want. Otherwise, it is not necessary. You can use back the same data directo

Re: Problem with white space or special characters in function queries

2019-03-29 Thread Yonik Seeley
On Thu, Mar 28, 2019 at 6:05 PM Jan Høydahl wrote: > Functions can never contain spaces. Spaces work fine in functions in general. The issue is the "bf" parameter as it uses whitespace to delimit multiple functions IIRC. -Yonik > Try to substitute the term with a variable, i.e. a request pa

Re: Problem with white space or special characters in function queries

2019-03-29 Thread Ahemad Ali
Do you have any suggestions for querying the indexed data with whitespaces and special charectors ? Sent from Yahoo Mail on Android On Fri, Mar 29, 2019 at 16:59, Yonik Seeley wrote: On Thu, Mar 28, 2019 at 6:05 PM Jan Høydahl wrote: > Functions can never contain spaces. Spaces work f

Re: dataimport for full-import

2019-03-29 Thread Alexandre Rafalovitch
It is probably autocommit setting in your solrconfig.xml. But you may also want to consider indexing into a new core and then doing a core swap at the end. Or re-aliasing if you are running a multiCore collection. Regards, Alex On Fri, Mar 29, 2019, 2:25 AM 黄云尧, wrote: > when I do the ful

Solr 7.5 multi-valued fields will not update with multiple values

2019-03-29 Thread Eivind Hodneland
Hi, I am running a Solr 7.5 index for a customer. I have recently discovered that none of the multivalued string/text fields are filled with more than one value each. Example of indexing (edited and abbreviated): curl -X POST -H 'Content-Type: application/json' 'http://localhost:18080/solr/cust

Solr 7 not removing a node completely due to too small thread pool

2019-03-29 Thread Roger Lehmann
Situation I'm currently trying to set up SolrCloud in an AWS Autoscaling Group, so that it can scale dynamically. I've also added the following triggers to Solr, so that each node will have 1 (and only one) replication of each collection: { "set-cluster-policy": [ {"replica": "<2", "shard": "#

Re: security.json "all" predefined permission

2019-03-29 Thread Jason Gerlowski
Thanks for the pointer Jan. I spent much of yesterday experimenting with the ordering to make sure that wasn't a factor and I was able to eventually rule it out with some debug logging that showed that the requests were being allowed because it couldn't find any governing permission rules. Apparen

Re: High CPU usage with Solr 7.7.0

2019-03-29 Thread Erick Erickson
Thanks all. I pushed changes last night, this should be fixed in 7.7.2, 8.1 and master. Meanwhile, this is a trivial change to one line, so two ways to get by would be 1> just make the change yourself locally. Building Solr from scratch is actually not hard. The “ant package” target will get yo

Re: Solr unable to start up after setting up SSL in Solr 7.4.0

2019-03-29 Thread Erick Erickson
What version of Java are you using? > On Mar 28, 2019, at 8:27 PM, Zheng Lin Edwin Yeo wrote: > > Hi, > > Regarding the issue with jetty-ssl.xml which I have mentioned previously, > seems that the issue still exists in Solr 8.0.0 if I use the jetty-ssl.xml > that comes with Solr 8.0.0. > > Reg

Re: Problem with white space or special characters in function queries

2019-03-29 Thread Erick Erickson
Ahamed: Please start a new thread. Although your question is somewhat related, it’s not the same thing at all. It’s called “thread hijacking” and makes it difficult to keep track of. > On Mar 29, 2019, at 4:46 AM, Ahemad Ali > wrote: > > Do you have any suggestions for querying the indexed d

Re: Solr 7.5 multi-valued fields will not update with multiple values

2019-03-29 Thread Erick Erickson
Separate out the author bits. Instead of "author_fullname":["Author 1","Author 2”,”Author 3”] use "author_fullname":"Author 1”, "author_fullname":"Author 2”, "author_fullname":”Author 3” > On Mar 29, 2019, at 6:16 AM, Eivind Hodneland > wrote: > > curl -X POST -H 'Content-Type: application/j

Re: Stopwords param of edismax parser not working

2019-03-29 Thread Branham, Jeremy (Experis)
Hi Ashish – Are you using v7.3? If so, I think this is the spot in code that should be executing: https://github.com/apache/lucene-solr/blob/releases/lucene-solr/7.3.0/solr/core/src/java/org/apache/solr/search/ExtendedDismaxQParser.java#L310 Haven’t dug into the logic, but I tested on my server [

Re: Solr indexing with Tika DIH local vs network share

2019-03-29 Thread neilb
Hi Erick, thanks a lot for your suggestions. I will look into it. But to answer my own query, I was little impatient and checking indexing status after every minute. What I found is after few hours, status started updating with document count and finished the indexing process in around 5Hrs. Do you

CommonTerms & slow queries

2019-03-29 Thread Erie Data Systems
Using Solr 8.0.0, single instance, single core, 50m records (38gb index) on one SSD, 96gb ram, 16 cores CPU Most queries run very very fast <1 sec however we have noticed queries containing "common" words are quite slow sometimes 10+sec , currently using edismax with 2 text_general fields,. qf, a

Re: Solr indexing with Tika DIH local vs network share

2019-03-29 Thread Erick Erickson
I suspect is that your autocommit settings in solrconfig.xml are something like hard commit: has openSearcher set to “false” soft commit: has the interval set to -1 (never) That means that until an external commit is executed, you won’t see any documents. Try setting your soft commit to somet

Re: CommonTerms & slow queries

2019-03-29 Thread Michael Gibney
Can you post the query that's actually built for some of these inputs ("parsedquery" or "parsedquery_toString" output included for requests with "debug=query" parameter)? What is performance like if you turn off pf (i.e., no implicit phrase searching)? Michael On Fri, Mar 29, 2019 at 11:53 AM Erie

Re: CommonTerms & slow queries

2019-03-29 Thread Erie Data Systems
Michael, select/?&rows=12&qf=title+description&q=once+upon+a+time+in+the+west&fl=*&hl=true&hl.field=desc&hl.fragsize=250&hl.maxAnalyzedChars=20&ps=1&qs=1&df=title&mm=2&defType=edismax&debugQuery=off&indent=on&wt=json&debug=true "rawquerystring":"once upon a time in the west", "querystr

Re: Solr indexing with Tika DIH local vs network share

2019-03-29 Thread neilb
Hi Erick, I am using solrconfig.xml from samples only and has very few entries. I have attached my config files for review along with reply. Thanks solrconfig.xml tika-data-config.xml

Re: hl.preserveMulti in Unified highlighter?

2019-03-29 Thread Walter Underwood
In testing, hl.preserveMulti=true works with the unified highlighter. But the documentation says that the parameter is only implemented in the original highlighter. Is the documentation wrong? Can we trust this to keep working with unified? wunder Walter Underwood wun...@wunderwood.org http://o

Re: hl.preserveMulti in Unified highlighter?

2019-03-29 Thread Walter Underwood
We are testing 6.6.1. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Mar 29, 2019, at 11:02 AM, Walter Underwood wrote: > > In testing, hl.preserveMulti=true works with the unified highlighter. But the > documentation says that the parameter is on

Re: CommonTerms & slow queries

2019-03-29 Thread Michael Gibney
You might take a look at CommonGramsFilter ( https://lucene.apache.org/solr/guide/6_6/filter-descriptions.html#FilterDescriptions-CommonGramsFilter), especially if you're either not using pf, or if ps=0. An absolute setting of mm=2 strikes me as unusual (though quite possibly appropriate for your u

Solr 7.7 - group faceting errors

2019-03-29 Thread Jay Potharaju
Hi, I am running into a bug when doing group faceting. This is the same error I ran into when upgrading from 5.5 to 6.x. http://lucene.472066.n3.nabble.com/solr-6-6-3-intermittent-group-faceting-errors-td4385692.html#a4385865 I had bypassed the error in solr 6.x by turning off docvalues. But in sol

Re: CommonTerms & slow queries

2019-03-29 Thread Erie Data Systems
> > All great advice thanks Michael, have an excellent weekend! Testing the > common grams > -Craig

Re: Solr indexing with Tika DIH local vs network share

2019-03-29 Thread Erick Erickson
So just try adding the autocommit and auotsoftcommit settings. All of the example configs have these entries and you can copy/paste/change > On Mar 29, 2019, at 10:35 AM, neilb wrote: > > Hi Erick, I am using solrconfig.xml from samples only and has very few > entries. I have attached my config

high cpu threads (solr 7.5) - EPollArrayWrapper.epollWait

2019-03-29 Thread Hari Nakka
Version: solr cloud 7.5 OS: CentOS 7 JDK: Oracle JDK 1.8.0_191 We are noticing high CPU utilization on below threads. Looks like a known issue with. (https://github.com/netty/netty/issues/327) But not sure if this has been addressed in any of the 1.8 releases. Please help. "qtp574568002-38217