Re: Solr Cloud reclaiming disk space from deleted documents

2015-05-04 Thread Rishi Easwaran
: Mon, May 4, 2015 9:11 am Subject: Re: Solr Cloud reclaiming disk space from deleted documents On 5/4/2015 4:55 AM, Rishi Easwaran wrote: > Sadly with the size of our complex, spiting and adding more HW is not a viable long term solution. > I guess the options we have are to run op

Re: Solr Cloud reclaiming disk space from deleted documents

2015-05-04 Thread Shawn Heisey
On 5/4/2015 4:55 AM, Rishi Easwaran wrote: > Sadly with the size of our complex, spiting and adding more HW is not a > viable long term solution. > I guess the options we have are to run optimize regularly and/or become > aggressive in our merges proactively even before solr cloud gets into thi

Re: Solr Cloud reclaiming disk space from deleted documents

2015-05-04 Thread Rishi Easwaran
. -Original Message- From: Gili Nachum To: solr-user Sent: Mon, Apr 27, 2015 4:18 pm Subject: Re: Solr Cloud reclaiming disk space from deleted documents To prevent it from re occurring you could monitor index size and once above a certain size threshold add another machine and split the shard

Re: Solr Cloud reclaiming disk space from deleted documents

2015-04-27 Thread Gili Nachum
> > > -Original Message- > From: Shawn Heisey > To: solr-user > Sent: Mon, Apr 20, 2015 11:25 am > Subject: Re: Solr Cloud reclaiming disk space from deleted documents > > > On 4/20/2015 8:44 AM, Rishi Easwaran wrote: > > Yeah I noticed that. Loo

Re: Solr Cloud reclaiming disk space from deleted documents

2015-04-20 Thread Rishi Easwaran
factor Thanks, Rishi. -Original Message- From: Shawn Heisey To: solr-user Sent: Mon, Apr 20, 2015 11:25 am Subject: Re: Solr Cloud reclaiming disk space from deleted documents On 4/20/2015 8:44 AM, Rishi Easwaran wrote: > Yeah I noticed that. Looks like optimize won't work

Re: Solr Cloud reclaiming disk space from deleted documents

2015-04-20 Thread Shawn Heisey
On 4/20/2015 8:44 AM, Rishi Easwaran wrote: > Yeah I noticed that. Looks like optimize won't work since on some disks we > are already pretty full. > Any thoughts on increasing/decreasing 10 or > ConcurrentMergeScheduler to make solr do merges faster. You don't have to do an optimize to need 2x

Re: Solr Cloud reclaiming disk space from deleted documents

2015-04-20 Thread Rishi Easwaran
pr 19, 2015 12:34 pm Subject: Re: Solr Cloud reclaiming disk space from deleted documents I assume you don't have much free space available in your disk. Notice that during optimization (merge into a single segment) your shard replica space usage may peak to 2x-3x of it's normal size unt

Re: Solr Cloud reclaiming disk space from deleted documents

2015-04-19 Thread Gili Nachum
entire solr cloud and see if we can > reclaim space. > > Thanks, > Rishi. > > > > > > > > > -Original Message- > From: Shawn Heisey > To: solr-user > Sent: Fri, Apr 17, 2015 6:22 pm > Subject: Re: Solr Cloud reclaiming disk space from deleted

Re: Solr Cloud reclaiming disk space from deleted documents

2015-04-17 Thread Rishi Easwaran
-user Sent: Fri, Apr 17, 2015 6:22 pm Subject: Re: Solr Cloud reclaiming disk space from deleted documents On 4/17/2015 2:15 PM, Rishi Easwaran wrote: > Running into an issue and wanted to see if anyone had some suggestions. > We are seeing this with both solr 4.6 and 4.10.3 code. > We ar

Re: Solr Cloud reclaiming disk space from deleted documents

2015-04-17 Thread Shawn Heisey
On 4/17/2015 2:15 PM, Rishi Easwaran wrote: > Running into an issue and wanted to see if anyone had some suggestions. > We are seeing this with both solr 4.6 and 4.10.3 code. > We are running an extremely update heavy application, with millions of writes > and deletes happening to our indexes cons