so imagine i have merged the 150 Gb index into single segment, this would make a single segment of 150 GB in memory. When new docs are indexed it wouldn't alter this 150 Gb index unless i update or delete the older docs, right? will 150 Gb single segment have problem with memory swapping at OS level?
On 5 October 2012 02:28, Otis Gospodnetic <otis.gospodne...@gmail.com>wrote: > You can certainly optimize down to just 1 segment. > > Note that this is the most expensive option and that when you do that > you may actually hurt performance for a bit because Solr/Lucene may > need to re-read a bunch of data from the index for sorting and > faceting purposes. You will also invalidate the previously cached > index data in the OS cache. > > Finally, if this index is being modified, it will be de-optimized > again. Note that Lucene periodically merges segments under the hood > as documents are added to the index anyway. > > Otis > -- > Search Analytics - http://sematext.com/search-analytics/index.html > Performance Monitoring - http://sematext.com/spm/index.html > > > On Thu, Oct 4, 2012 at 4:20 PM, jame vaalet <jamevaa...@gmail.com> wrote: > > Hi, > > I was about to do optimize on my index which has got around 100 segments > > right now, but am confused about the segment size that has to be chosen. > > would it have any trouble merging all the index into one single segment ? > > thanks in advance. > > > > -- > > > > -JAME > -- -JAME
