Re: is there a way to remove deleted documents from index without optimize

2017-10-16 Thread Shawn Heisey
On 10/12/2017 10:01 PM, Erick Erickson wrote: > You can use the IndexUpgradeTool that ships with each version of Solr > (well, actually Lucene) to, well, upgrade your index. So you can use > the IndexUpgradeTool that ships with 5x to upgrade from 4x. And the > one that ships with 6x to upgrade from

Re: is there a way to remove deleted documents from index without optimize

2017-10-13 Thread Harry Yoo
Thanks for the clarification. I use ${lucene.version} in the solrconfig.xml and pass -Dlucene.version when I launch solr, to keep the versions. > On Oct 12, 2017, at 11:01 PM, Erick Erickson wrote: > > You can use the IndexUpgradeTool that ships with each version of Solr > (wel

Re: is there a way to remove deleted documents from index without optimize

2017-10-12 Thread Erick Erickson
You can use the IndexUpgradeTool that ships with each version of Solr (well, actually Lucene) to, well, upgrade your index. So you can use the IndexUpgradeTool that ships with 5x to upgrade from 4x. And the one that ships with 6x to upgrade from 5x. etc. That said, none of that is necessary _if_ y

Re: is there a way to remove deleted documents from index without optimize

2017-10-12 Thread Harry Yoo
I should have read this. My project has been running from apache solr 4.x, and moved to 5.x and recently migrated to 6.6.1. Do you think solr will take care of old version indexes as well? I wanted to make sure my indexes are updated with 6.x lucence version so that it will be supported when i m

Re: is there a way to remove deleted documents from index without optimize

2015-09-22 Thread Walter Underwood
Don’t do anything. Solr will automatically clean up the deleted documents for you. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Sep 22, 2015, at 6:01 PM, CrazyDiamond wrote: > > my index is updating frequently and i need to remove unused docume

Re: is there a way to remove deleted documents from index without optimize

2015-09-22 Thread Doug Turnbull
Avoid optimize like the plague. Instead focus on tuning the segment merging process. As you commit index files, segments are created. But they're periodically merged. Merging removes remnants of the tombstoned docs. You can optimize this, tune it, etc. If you're dealing with a lot of updates, thi