On 28-Aug-07, at 6:19 AM, michael ravits wrote:
hello solrs,
i have an index with 30M records, weights ~50GB. latest trunk
version. heap size 1024mb.
queries work fine until I specify a field to sort results by. even
if the result set consists of only 2 documents, the CPU jumps high
and after about 5 minutes I get the following exception:
Sorting requires a one-time generation of a fieldCache for the field,
which occupies 1, 2, 4, or 8 bytes per doc (possibly also the sum of
the size of the unique values in the field, if it is a string
field). What is the definition of the field you are trying to sort
by, and what kinds of values are indexed therein?
-Mike
Any idea?
thanks
Java heap space
java.lang.OutOfMemoryError: Java heap space
at org.apache.lucene.index.SegmentTermEnum.termInfo
(SegmentTermEnum.java:170)
at org.apache.lucene.index.TermInfosReader.scanEnum
(TermInfosReader.java:166)
at org.apache.lucene.index.TermInfosReader.get
(TermInfosReader.java:153)
at org.apache.lucene.index.SegmentTermDocs.seek
(SegmentTermDocs.java:54)
at org.apache.lucene.index.MultiTermDocs.termDocs
(MultiReader.java:429)
at org.apache.lucene.index.MultiTermDocs.next(MultiReader.java:
380)
at org.apache.lucene.search.FieldCacheImpl$10.createValue
(FieldCacheImpl.java:383)
at org.apache.lucene.search.FieldCacheImpl$Cache.get
(FieldCacheImpl.java:72)
at org.apache.lucene.search.FieldCacheImpl.getStringIndex
(FieldCacheImpl.java:350)
at org.apache.lucene.search.FieldSortedHitQueue.comparatorString
(FieldSortedHitQueue.java:266)
at org.apache.lucene.search.FieldSortedHitQueue$1.createValue
(FieldSortedHitQueue.java:182)
at org.apache.lucene.search.FieldCacheImpl$Cache.get
(FieldCacheImpl.java:72)
at
org.apache.lucene.search.FieldSortedHitQueue.getCachedComparator
(FieldSortedHitQueue.java:155)
at org.apache.lucene.search.FieldSortedHitQueue.<init>
(FieldSortedHitQueue.java:56)
at org.apache.solr.search.SolrIndexSearcher.getDocListNC
(SolrIndexSearcher.java:862)
at org.apache.solr.search.SolrIndexSearcher.getDocListC
(SolrIndexSearcher.java:810)
at org.apache.solr.search.SolrIndexSearcher.getDocList
(SolrIndexSearcher.java:703)
at
org.apache.solr.handler.StandardRequestHandler.handleRequestBody
(StandardRequestHandler.java:125)
at org.apache.solr.handler.RequestHandlerBase.handleRequest
(RequestHandlerBase.java:78)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:723)
at org.apache.solr.servlet.SolrDispatchFilter.execute
(SolrDispatchFilter.java:193)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter
(SolrDispatchFilter.java:161)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter
(ServletHandler.java:1089)
at org.mortbay.jetty.servlet.ServletHandler.handle
(ServletHandler.java:365)
at org.mortbay.jetty.security.SecurityHandler.handle
(SecurityHandler.java:216)
at org.mortbay.jetty.servlet.SessionHandler.handle
(SessionHandler.java:181)
at org.mortbay.jetty.handler.ContextHandler.handle
(ContextHandler.java:712)
at org.mortbay.jetty.webapp.WebAppContext.handle
(WebAppContext.java:405)
at org.mortbay.jetty.handler.ContextHandlerCollection.handle
(ContextHandlerCollection.java:211)
at org.mortbay.jetty.handler.HandlerCollection.handle
(HandlerCollection.java:114)
at org.mortbay.jetty.handler.HandlerWrapper.handle
(HandlerWrapper.java:139)
at org.mortbay.jetty.Server.handle(Server.java:285)
---------------------------------
Looking for a deal? Find great prices on flights and hotels with
Yahoo! FareChase.
