Hi, i using solr that running on windows server 2008 32-bit. 

I add about 100 million article into solr without set store attribute. (only 
store document id) (index file size about 164 GB)
when try to get query without sort , it's return doc ids in some ms, but when 
add sort command, i get below error:

TTP Status 500 - Java heap space java.lang.OutOfMemoryError: Java heap 
space at 
org.apache.lucene.search.FieldCacheImpl$LongCache.createValue(FieldCacheImpl.java:560)
 at org.apache.lucene.search.FieldCacheImpl$Cache.get(FieldCacheImpl.java:208) 
at 
org.apache.lucene.search.FieldCacheImpl.getLongs(FieldCacheImpl.java:525) at 
org.apache.lucene.search.FieldComparator$LongComparator.setNextReader(FieldComparator.java:391)
 at 
org.apache.lucene.search.TopFieldCollector$OneComparatorNonScoringCollector.setNextReader(TopFieldCollector.java:94)
 at 
org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:245) at 
org.apache.lucene.search.Searcher.search(Searcher.java:171) at 
org.apache.solr.search.SolrIndexSearcher.getDocListNC(SolrIndexSearcher.java:988)
 at 

Note: i set max heap size to 1600MB (tomcat service not start when apply more 
heap size) but problem not solved

I check heap dump file with mat and see this info

org.apache.lucene.index.ReadOnlySegmentReader @ 0x253508e8  Shallow Size: 80 B 
Retained Size: 449,4 MB

Problem Suspect 1 
One instance of "org.apache.lucene.index.ReadOnlySegmentReader" loaded 
by "org.apache.catalina.loader.WebappClassLoader @ 0x25350c80" occupies 
471.244.848 (97,44%) bytes. The memory is accumulated in one instance of 
"org.apache.lucene.index.TermInfosReader" loaded by 
"org.apache.catalina.loader.WebappClassLoader @ 
0x25350c80".Keywords
org.apache.lucene.index.ReadOnlySegmentReader
org.apache.catalina.loader.WebappClassLoader 
@ 0x25350c80
org.apache.lucene.index.TermInfosReader
Problem Suspect 1

how to decrease segment file size for solving this problem 

Thanks in advanced 
Hamid



      

Reply via email to