On Fri, 2011-07-08 at 07:12 +0200, Nikhil Chhaochharia wrote: > However, if I upgrade to Solr 3.3, then the Virtual Memory of the Tomcat > process increases to roughly the index size (70GB). Any ideas why > this is happening?
Maybe you switched to MMapDirectory? http://lucene.apache.org/java/3_3_0/api/core/org/apache/lucene/store/MMapDirectory.html I haven't verified this, but it seems probable that the allocated but unused address space that MMapDirectory requires is reported as part of the statistics for the Java process. It looks strange, but a large reported VM-size is not in itself a problem. If you look in /proc/pid/status, VmRSS tells you the physical memory usage and VmSwap how much is swapped. If the sum of those is around the 4GB you specified, then the load on the machine is as you requested. Caveat lector: I am not by any means a kernel hacker. I might have misunderstood the meaning of the values in proc/pid/status.
