Re: Starting optimize... Reading and rewriting the entire index! Use with care

2019-01-16 Thread Walter Underwood
ow are you calling the dataimport? As I understand it, optimize defaults >>> to true, so unless you explicitly set it to false, the optimize will occur >>> after the import. >>> >>> >>> ________ >>> From: talhanather >>> Sent: Wednesday, January 16, 2019

Re: Starting optimize... Reading and rewriting the entire index! Use with care

2019-01-16 Thread Erick Erickson
nless you explicitly set it to false, the optimize will occur > > after the import. > > > > > > > > From: talhanather > > Sent: Wednesday, January 16, 2019 7:57:29 AM > > To: solr-user@lucene.apache.org > > Subject

Re: Starting optimize... Reading and rewriting the entire index! Use with care

2019-01-16 Thread Jan Høydahl
o unless you explicitly set it to false, the optimize will occur after > the import. > > > > From: talhanather > Sent: Wednesday, January 16, 2019 7:57:29 AM > To: solr-user@lucene.apache.org > Subject: Re: Starting optimize... Reading and rew

Re: Starting optimize... Reading and rewriting the entire index! Use with care

2019-01-16 Thread Jeremy Smith
@lucene.apache.org Subject: Re: Starting optimize... Reading and rewriting the entire index! Use with care Hi Erick, PFB the solr-config.xml, Its not having optimization tag to true. Then how optimization is continuously occurring for me. ? uuid db-data-config.xml -- Sent from

Re: Starting optimize... Reading and rewriting the entire index! Use with care

2019-01-16 Thread talhanather
Hi Erick, PFB the solr-config.xml, Its not having optimization tag to true. Then how optimization is continuously occurring for me. ? uuid db-data-config.xml -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Starting optimize... Reading and rewriting the entire index! Use with care

2018-12-27 Thread Erick Erickson
1> Not sure. You can get stats after the fact if that would help. 2, 3, 4> Well, optimize is a configuration parameter in DIH that defaults to true so set it false and you'll get rid of the optimize. See: https://lucene.apache.org/solr/guide/6_6/uploading-structured-data-store-data-with-the-data-

Re: Starting optimize... Reading and rewriting the entire index! Use with care

2018-12-26 Thread talhanather
Hi Erick, My DIH is working perfectly, As I have done the full import of index from SQL Server after installation. I had 25000 records which was imported to Solr through Full import using DIH config only. But my additional requirement is to import the new records through delta import (through som

Re: Starting optimize... Reading and rewriting the entire index! Use with care

2018-12-26 Thread Erick Erickson
What is your actual question? You have two bits here: - But unfortunately this functionality is not working through my Solr Admin, But the new/updated data's are getting indexed automatically. and - I could see that the below warning messages are occurring recursively. Which are you worried a

Re: Starting optimize... Reading and rewriting the entire index! Use with care

2018-12-26 Thread Edward Ribeiro
Optimize is an expensive operation. It will cost you 2x disk space, plus CPU and RAM. It is usually advisable not to optimize unless you really need to, and do not optimize frequently. Whether this can impact the server and search depends on the index size and hardware specification. See more here