Re: Core size - distinguish between merge and deletes

2017-11-09 Thread Erick Erickson
Please don't do that ;) Unless you're willing to do it frequently. See: https://lucidworks.com/2017/10/13/segment-merging-deleted-documents-optimize-may-bad/ expungeDeletes is really a variety of optimize, so the issues outlined in that blog apply. Best, Erick On Thu, Nov 9, 2017 at 12:24 PM, S

Re: Core size - distinguish between merge and deletes

2017-11-09 Thread Shashank Pedamallu
Thanks for the response Erick. I’m deleting the documents with expungeDeletes option set as true. So, that does trigger a merge to throw away the deleted documents. On 11/9/17, 12:17 PM, "Erick Erickson" wrote: bq: Is there a way to distinguish between when size is being reduced becaus

Re: Core size - distinguish between merge and deletes

2017-11-09 Thread Erick Erickson
bq: Is there a way to distinguish between when size is being reduced because of a delete from that of during a lucene merge. Not sure what you're really looking for here. Size on disk is _never_ reduced by a delete operation, the document is only 'marked as deleted'. Only when segments are merged