It is something from internally of the snowball analyzer (stemmer). To find out more you should take a heapdump and look into it with Memory Analyzer (MAT) http://www.eclipse.org/mat/
Regards, Bernd Am 27.07.2012 09:53, schrieb roz dev: > Hi All > > I am trying to find out the reason for very high memory use and ran JMAP > -hist > > It is showing that i have too many instances of org.tartarus.snowball.Among > > Any ideas what is this for and why am I getting so many of them > > num #instances #bytes Class description > -------------------------------------------------------------------------- > *1: 46728110 1869124400 org.tartarus.snowball.Among > * > 2: 5244210 1840458960 byte[] > 3: 52651949 5969839368 char[] > 4: 10008928 864769280 int[] > 5: 10250527 410021080 > java.util.LinkedHashMap$Entry > 6: 4672811 268474232 org.tartarus.snowball.Among[] > *7: 8072312 258313984 java.util.HashMap$Entry* > 8: 466514 246319392 org.apache.lucene.util.fst.FST$Arc[] > 9: 1828542 237600432 java.util.HashMap$Entry[] > 10: 3834312 153372480 java.util.TreeMap$Entry > 11: 2684700 128865600 > org.apache.lucene.util.fst.Builder$UnCompiledNode > 12: 4712425 113098200 org.apache.lucene.util.BytesRef > 13: 3484836 111514752 java.lang.String > 14: 2636045 105441800 org.apache.lucene.index.FieldInfo > 15: 1813561 101559416 java.util.LinkedHashMap > 16: 6291619 100665904 java.lang.Integer > 17: 2684700 85910400 > org.apache.lucene.util.fst.Builder$Arc > 18: 956998 84215824 > org.apache.lucene.index.TermsHashPerField > 19: 2892957 69430968 > org.apache.lucene.util.AttributeSource$State > 20: 2684700 64432800 > org.apache.lucene.util.fst.Builder$Arc[] > 21: 685595 60332360 org.apache.lucene.util.fst.FST > 22: 933451 59210944 java.lang.Object[] > 23: 957043 53594408 org.apache.lucene.util.BytesRefHash > 24: 591463 42585336 > org.apache.lucene.codecs.BlockTreeTermsReader$FieldReader > 25: 424801 40780896 > org.tartarus.snowball.ext.EnglishStemmer > 26: 424801 40780896 > org.apache.lucene.analysis.miscellaneous.WordDelimiterFilter > 27: 1549670 37192080 org.apache.lucene.index.Term > 28: 849602 33984080 > org.apache.lucene.analysis.miscellaneous.WordDelimiterFilter$WordDelimiterConcatenation > 29: 424801 27187264 > org.apache.lucene.analysis.core.WhitespaceTokenizer > 30: 478499 26795944 > org.apache.lucene.index.FreqProxTermsWriterPerField > 31: 535521 25705008 > org.apache.lucene.index.FreqProxTermsWriterPerField$FreqProxPostingsArray > 32: 219081 24537072 > org.apache.lucene.codecs.BlockTreeTermsWriter$TermsWriter > 33: 478499 22967952 > org.apache.lucene.index.FieldInvertState > 34: 956998 22967952 > org.apache.lucene.index.TermsHashPerField$PostingsBytesStartArray > 35: 478499 22967952 > org.apache.lucene.index.TermVectorsConsumerPerField > 36: 478499 22967952 > org.apache.lucene.index.NormsConsumerPerField > 37: 316582 22793904 > org.apache.lucene.store.MMapDirectory$MMapIndexInput > 38: 906708 21760992 > org.apache.lucene.util.AttributeSource$State[] > 39: 906708 21760992 > org.apache.lucene.analysis.tokenattributes.OffsetAttributeImpl > 40: 883588 21206112 java.util.ArrayList > 41: 438192 21033216 > org.apache.lucene.store.RAMOutputStream > 42: 860601 20654424 java.lang.StringBuilder > 43: 424801 20390448 > org.apache.lucene.analysis.miscellaneous.WordDelimiterIterator > 44: 424801 20390448 > org.apache.lucene.analysis.core.StopFilter > 45: 424801 20390448 > org.apache.lucene.analysis.miscellaneous.KeywordMarkerFilter > 46: 424801 20390448 > org.apache.lucene.analysis.snowball.SnowballFilter > 47: 839390 20145360 > org.apache.lucene.index.DocumentsWriterDeleteQueue$TermNode > > > -Saroj > -- ************************************************************* Bernd Fehling Universitätsbibliothek Bielefeld Dipl.-Inform. (FH) LibTec - Bibliothekstechnologie Universitätsstr. 25 und Wissensmanagement 33615 Bielefeld Tel. +49 521 106-4060 bernd.fehling(at)uni-bielefeld.de BASE - Bielefeld Academic Search Engine - www.base-search.net *************************************************************
