I would guess that your code is being used. I'm not sure what you mean by it "was only referenced in the schema". That implies usage to me. Is it a new field type? What is your plugin doing?

Have you tried setting breakpoints at method entry points in your plugin and starting up Solr w/ a debugger attached.

-Grant

On Oct 28, 2009, at 4:54 PM, entdeveloper wrote:


This is an issue we experienced a while back. We once again tried to load a custom class as a plugin jar from the lib directory and began experiencing severe memory problems again. The code in our jar wasn't being used at all...the class was only referenced in the schema. I find it strange that no one else has experienced this, but we're not doing anything particularly
complex, which is still leading me to believe that there is something
strange going on with Solr's class loading for this lib directory. Perhaps
it is something specific with our environment (specs below)?

java version "1.6.0_05"
Java(TM) SE Runtime Environment (build 1.6.0_05-b13)
Java HotSpot(TM) 64-Bit Server VM (build 10.0-b19, mixed mode)

Tomcat 6.0.16

Linux 2.6.9-35.ELsmp #1 SMP Thu Jun 1 14:31:29 PDT 2006 x86_64 x86_64 x86_64
GNU/Linux

Max heap set to 1GB.

With the jars in the plugin directory, RAM usage increases by 1.5 - 2GB,
increasing at about 200MB/hr.



hossman wrote:


: I'm not entirely convinced that it's related to our code, but it could
be.
: Just trying to get a sense if other plugins have had similar problems,
just
: by the nature of using Solr's resource loading from the /lib directory.

Plugins aren't something that every Solr users -- but enough people use them that if there was a fundemental memory leak just from loading plugin
jars i'm guessing more people would be complaining.

I use plugins in several solr instances, and i've never noticed any
problems like you describe -- but i don't personally use tomcat.

Otis is right on the money: you need to use profiling tools to really look
at the heap and see what's taking up all that ram.

Alternately: a quick way to rule out the special plugin class loader would be to embed your custom handler directly into the solr.war ("The Old Way" on the SolrPlugins wiki) ... if you still have problems, then the cause
isn't the plugin classloader.





-Hoss




--
View this message in context: 
http://www.nabble.com/Plugin-Performance-Issues-tp24295010p26101741.html
Sent from the Solr - User mailing list archive at Nabble.com.


--------------------------
Grant Ingersoll
http://www.lucidimagination.com/

Search the Lucene ecosystem (Lucene/Solr/Nutch/Mahout/Tika/Droids) using Solr/Lucene:
http://www.lucidimagination.com/search

Reply via email to