Re: how to make sure all the index docs flushed to the index files

2013-09-17 Thread YouPeng Yang
Hi Erick and Shawn Thanks a lot 2013/9/17 Erick Erickson > Here's a blog about tlogs and commits: > > http://searchhub.org/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/ > > And here's Mike's excellent segment merging blog > > http://blog.mikemccandless.com/20

Re: how to make sure all the index docs flushed to the index files

2013-09-17 Thread Erick Erickson
Here's a blog about tlogs and commits: http://searchhub.org/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/ And here's Mike's excellent segment merging blog http://blog.mikemccandless.com/2011/02/visualizing-lucenes-segment-merges.html Best, Erick On Tue, Sep 17, 2

Re: how to make sure all the index docs flushed to the index files

2013-09-17 Thread Shawn Heisey
On 9/17/2013 12:32 AM, YouPeng Yang wrote: > Hi >Another werid problem. >When we setup the autocommit properties, we suppose that the index > fille will created every commited.So that the size of the index files will > be large enough. We do not want to keep too many small files as [1]. >

Re: how to make sure all the index docs flushed to the index files

2013-09-16 Thread YouPeng Yang
Hi Another werid problem. When we setup the autocommit properties, we suppose that the index fille will created every commited.So that the size of the index files will be large enough. We do not want to keep too many small files as [1]. How to control the size of the index files. [1]---

Re: how to make sure all the index docs flushed to the index files

2013-09-16 Thread YouPeng Yang
Hi Shawn Thank your very much for your reponse. I lauch the full-import task on the web page of solr/admin . And I do check the commit option. The new docs would be committed after the operation. The commit option is defferent with the autocommit,right? If the import datasets are too lar

Re: how to make sure all the index docs flushed to the index files

2013-09-16 Thread Shawn Heisey
On 9/16/2013 8:26 PM, YouPeng Yang wrote: >I'm using the DIH to import data from oracle database with Solr4.4 >Finally I get 2.7GB index data and 4.1GB tlog data.And the number of > docs was 1090. > > At first, I move the 2.7GB index data to another new Solr Server in > tomcat7. A

how to make sure all the index docs flushed to the index files

2013-09-16 Thread YouPeng Yang
Hi I'm using the DIH to import data from oracle database with Solr4.4 Finally I get 2.7GB index data and 4.1GB tlog data.And the number of docs was 1090. At first, I move the 2.7GB index data to another new Solr Server in tomcat7. After I start the tomcat ,I find the total number o