Re: delay while adding document to solr index

2009-10-08 Thread Yonik Seeley
On Thu, Oct 8, 2009 at 1:58 AM, swapna_here wrote: > i don't understand why my solr index increasing daily > when i am adding and deleting the same number of documents daily A delete is just a bit flip, and does not reclaim disk space immediately. Deleted documents are squeezed out when segment m

Re: delay while adding document to solr index

2009-10-07 Thread swapna_here
thanks for your reply but sorry for the delay as you said i have removed the commit while adding single document and set the auto commit for 200 1 after setting when i run optimize() manually the size decreased to 350MB(10 docs) from 638MB(10 docs) i think this happene

Re: delay while adding document to solr index

2009-09-30 Thread Jérôme Etévé
Hi, - Try to let solr do the commits for you (setting up autocommit feature). (and stop committing after inserting one document). This should greatly improve the delays you're experiencing. - If you do not optimize, it's normal your index size only grows. Optimize once regularly when your load is

Re: delay while adding document to solr index

2009-09-30 Thread swapna_here
thanks again for your immediate response yes, i am running the commit after a document is indexed here i don't understand why my index size is increased to 625MB(for the 10 documents) which was previously 250MB is this due to i have not optimized at all my index or since i am adding documen

Re: delay while adding document to solr index

2009-09-30 Thread Pravin Paratey
Swapna While the disk space does increase during the process of optimization, it should almost always return to the original size or slightly less. This is a silly question. But off the top of my head, I can't think of any other reason why the index size would increase - Are you running a after

Re: delay while adding document to solr index

2009-09-30 Thread swapna_here
thanks for your reply i have not optimized at all my knowledge is optimize improves the query performance but it will take more disk space except that i have no idea how to use it previously for 10 documents the size occupied was around 250MB But after 2 months it is 625MB why this happened

Re: delay while adding document to solr index

2009-09-30 Thread Pravin Paratey
Also, what is your merge factor set to? Pravin 2009/9/30 Pravin Paratey : > Swapna, > > Your answers are inline. > > 2009/9/30 swapna_here : >> >> hi all, >> >> I have indexed 10 documents (daily around 5000 documents will be indexed >> one at a time to solr) >> at the same time daily few(aro

Re: delay while adding document to solr index

2009-09-30 Thread Pravin Paratey
Swapna, Your answers are inline. 2009/9/30 swapna_here : > > hi all, > > I have indexed 10 documents (daily around 5000 documents will be indexed > one at a time to solr) > at the same time daily few(around 2000) indexed documents (added 30 days > back) will be deleted using DeleteByQuery of