Memory + WeakIdentityMap

2014-03-20 Thread Harish Agarwal 
I'm transitioning my index from a 3.x version to >4.6.  I'm running a large
heap (20G), primarily to accomodate a large facet cache (~5G), but have
been able to run it on 3.x stably.

On 4.6.0 after stress testing I'm finding that all of my shards are
spending all of their time in GC.  After taking a heap dump and analyzing,
it appears that org.apache.lucene.util.WeakIdentityMap is using many Gs of
memory.  Does anyone have any insight into which Solr component(s) use this
and whether this kind of memory consumption is to be expected?

Thank You,
-Harish

Memory Problems + java.lang.ref.Finalizer

2014-03-25 Thread Harish Agarwal 
In reference to my prior thread:

http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201403.mbox/%3ccac-cpvrzbhizomcdhkrhygqizguerntkwtkxwwx3j1rqcxe...@mail.gmail.com%3E

I followed the advice to set unmap=false on my indexes with promising
results.  Without performing any index updates I am seeing very stable
memory usage and GC performance.  However, I'm still sporadically seeing
memory problems after replicating index updates.  After performing another
heap dump, I noticed that:

java.lang.ref.Finalizer

is occupying an inordinate amount of space.  jmap reports it as an
'unreachable object', however GC was obviously not cleaning it up.

I'm really not sure how to hunt down this problem, any help would be
appreciated.

-Harish

Re: leaks in solr

2014-03-26 Thread Harish Agarwal 
Thanks for the help -- after fortuitously looking at a separate thread:

http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201403.mbox/%3CCAJYe0M4qNKzqT4gB-qib0T6%3DY1KYr7vKcNEYDHWH1MnMoCLtYw%40mail.gmail.com%3E

I upgraded to 7u25 and all is well!

On a separate note, you'd mentioned DocValues facet'ing in my prior thread
 -- is this data structure meant to replace UnInvertedFields?


On Wed, Mar 26, 2014 at 12:11 PM, Shawn Heisey  wrote:

> On 3/25/2014 4:06 PM, harish.agarwal wrote:
>
>> I'm having a very similar issue to this currently on 4.6.0 (large
>> java.lang.ref.Finalizer usage, many open file handles to long gone files)
>> --
>> were you able to make any progress diagnosing this issue?
>>
>
> A few questions:
>
> Are you using any contrib or third-party jars with Solr?
> Are you using non-default values for the Java classes seen in the config
> and schema?
> What vendor and version is your JVM?
>
> For the JVM, I'd recommend the latest Oracle Java 6 or Oracle Java 7u25.
>
> Thanks,
> Shawn
>
>

Stats Filter Exclusion Throwing Error

2014-03-27 Thread Harish Agarwal 
I'm using the latest nightly build of 4.8 and testing this patch:

https://issues.apache.org/jira/browse/SOLR-3177

using this set of fq / stats.field query params:

fq={!tag=INTEGER_4}INTEGER_4:(2)&stats.field={!ex=INTEGER_4}INTEGER_4

with Solr throwing the following error:

ERROR - 2014-03-27 16:13:12.164; org.apache.solr.common.SolrException;
org.apache.solr.common.SolrException: undefined field:
"{!ex=INTEGER_4}INTEGER_4"

at org.apache.solr.schema.IndexSchema.getField(IndexSchema.java:1172)

at
org.apache.solr.handler.component.StatsInfo.parse(StatsComponent.java:190)

at
org.apache.solr.handler.component.StatsComponent.modifyRequest(StatsComponent.java:97)

at
org.apache.solr.handler.component.ResponseBuilder.addRequest(ResponseBuilder.java:147)

at
org.apache.solr.handler.component.QueryComponent.createMainQuery(QueryComponent.java:816)

at
org.apache.solr.handler.component.QueryComponent.regularDistributedProcess(QueryComponent.java:649)

at
org.apache.solr.handler.component.QueryComponent.distributedProcess(QueryComponent.java:602)

at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:253)

at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)

at org.apache.solr.core.SolrCore.execute(SolrCore.java:1939)

at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:780)

at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)

at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:217)

at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224)

at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169)

at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)

at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)

at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)

at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)

at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987)

at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)

at
org.apache.tomcat.util.net.AprEndpoint$SocketProcessor.run(AprEndpoint.java:1805)

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

at java.lang.Thread.run(Thread.java:724)



Have I got the syntax wrong?

DocValues and StatsComponent

2014-04-03 Thread Harish Agarwal 
Is there a known issue using the StatsComponent against fields indexed with
docvalues?  My setup is currently throwing this error (against the latest
nightly build):

org.apache.solr.common.Solr*Exception*; org.apache.solr.common.Solr
*Exception*: Type mismatch: INTEGER_4 was indexed as SORTED_SET