Re: Still too many files after running solr optimization

2011-09-28 Thread Chris Hostetter
: I was worried because when i used to use only Lucene for the same indexing, : before optimization there are many files but after optimization i always end : up with just 3 files in my index filder. Just want to find out if this was : ok. It sounds like you were most likely using the "Compound F

Re: Still too many files after running solr optimization

2011-09-28 Thread Vadim Kisselmann
we had an understanding problem:) docs are the docs in index. files are the files in the index directory (index parts). during the optimization you don't delete docs if they are don't flagged as deleted. but you merge your index und delete the files in your index directory, thats right. after an

Re: Still too many files after running solr optimization

2011-09-28 Thread Manish Bafna
We tested it so many times. 1st time we optimize, the new index file is created (merged one), but the existing index files are not deleted (because they might be still open for reading) 2nd time optimize, other than the new index file, all else gets deleted. This is happening specifically on Windo

Re: Still too many files after running solr optimization

2011-09-28 Thread Vadim Kisselmann
2011/9/28 Manish Bafna > >>Will it not merge the index? > yes > >>While merging on windows, the old index files dont get deleted. > >>(Windows has an issue where the file opened for reading cannot be > >>deleted) > >> > >>So, if you call optimize again, it will delete the older index files. >

Re: Still too many files after running solr optimization

2011-09-28 Thread Manish Bafna
Will it not merge the index? While merging on windows, the old index files dont get deleted. (Windows has an issue where the file opened for reading cannot be deleted) So, if you call optimize again, it will delete the older index files. On Wed, Sep 28, 2011 at 6:43 PM, Vadim Kisselmann wrote: >

Re: Still too many files after running solr optimization

2011-09-28 Thread Vadim Kisselmann
if numDocs und maxDocs have the same mumber of docs nothing will be deleted on optimize. You only rebuild your index. Regards Vadim 2011/9/28 Kissue Kissue > numDocs and maxDocs are same size. > > I was worried because when i used to use only Lucene for the same indexing, > before optimizati

Re: Still too many files after running solr optimization

2011-09-28 Thread Kissue Kissue
numDocs and maxDocs are same size. I was worried because when i used to use only Lucene for the same indexing, before optimization there are many files but after optimization i always end up with just 3 files in my index filder. Just want to find out if this was ok. Thanks On Wed, Sep 28, 2011 a

Re: Still too many files after running solr optimization

2011-09-28 Thread Vadim Kisselmann
why should the optimization reduce the number of files? It happens only when you indexing docs with same unique key. Have you differences in numDocs und maxDocs after optimize? If yes: how is your optimize command ? Regards Vadim 2011/9/28 Manish Bafna > Try to do optimize twice. > The 2nd o

Re: Still too many files after running solr optimization

2011-09-28 Thread Manish Bafna
Try to do optimize twice. The 2nd one will be quick and will delete lot of files. On Wed, Sep 28, 2011 at 5:26 PM, Kissue Kissue wrote: > Hi, > > I am using solr 3.3. I noticed  that after indexing about 700, 000 records > and running optimization at the end, i still have about 91 files in my ind

Still too many files after running solr optimization

2011-09-28 Thread Kissue Kissue
Hi, I am using solr 3.3. I noticed that after indexing about 700, 000 records and running optimization at the end, i still have about 91 files in my index directory. I thought that optimization was supposed to reduce the number of files. My settings are the default that came with Solr (mergefact