Again, indexing becomes extremely slow after indexed 8m documents (about 25G of
original file size). Here is the memory usage info of my computer. Does this
have anything to do with tomcat setting? Thanks.
top - 08:09:53 up 7:22, 1 user, load average: 1.03, 1.01, 1.00
Tasks: 78 total, 2 running, 76 sleeping, 0 stopped, 0 zombie
Cpu(s): 49.9%us, 0.2%sy, 0.0%ni, 49.8%id, 0.2%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 4044776k total, 3960740k used, 84036k free, 42196k buffers
Swap: 2031608k total, 84k used, 2031524k free, 2729892k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
3322 root 21 0 1357m 1.0g 11m S 100 27.0 397:51.74 java
--- On Mon, 5/25/09, Jianbin Dai <djian...@yahoo.com> wrote:
> From: Jianbin Dai <djian...@yahoo.com>
> Subject: Is it memory leaking in solr?
> To: solr-user@lucene.apache.org, noble.p...@gmail.com
> Date: Monday, May 25, 2009, 1:27 AM
>
> I am using DIH to do indexing. After I indexed about 8M
> documents (took about 1hr40m), it used up almost all memory
> (4GB), and the indexing becomes extremely slow. If I delete
> all indexing and shutdown tomcat, it still shows over 3gb
> memory was used. Is it memory leaking? if it is, then the
> leaking is in solr indexing or DIH? Thanks.
>
>
>
>
>
