Re: strange performance issue with many shards on one server

2011-09-28 Thread Federico Fissore
Frederik Kraus, il 28/09/2011 23:16, ha scritto: Yep, I'm not getting more than 50-60% CPU during those load tests. I would try reducing the number of shards. A part from the memory discussion, this really seems to me a concurrency issue: too many threads waiting for other threads to compl

Re: strange performance issue with many shards on one server

2011-09-28 Thread Federico Fissore
Jaeger, Jay - DOT, il 28/09/2011 18:40, ha scritto: That would still show up as the CPU being busy. i don't know how the program (top, htop, whatever) displays the value but when the cpu has a cache miss definitely that thread sits and waits for a number of clock cycles with 130GB of ram (

Re: strange performance issue with many shards on one server

2011-09-28 Thread Federico Fissore
Frederik Kraus, il 28/09/2011 12:58, ha scritto: Hi, I am experiencing a strange issue doing some load tests. Our setup: just because I've listened to JUG mates talking about that at the last meeting, could it be that your CPUs are spending their time getting things from RAM to CPU cache

Re: Lucene->SOLR transition

2011-09-16 Thread Federico Fissore
Hi Scott Smith, il 16/09/2011 02:30, ha scritto: I've been using lucene for a number of years. We've now decided to move to SOLR. I have a couple of questions. 1. I'm used to creating Boolean queries, filter queries, term queries, etc. for lucene. Am I right in thinking that for SOL

Re: Solr custom plugins: is it possible to have them persistent?

2011-09-01 Thread Federico Fissore
a brief question: is using an IoC framework like spring an option for you? if so, maybe this could help http://lucene.472066.n3.nabble.com/dependency-injection-in-solr-td3292685.html#a3295939

Re: Solr custom plugins: is it possible to have them persistent?

2011-09-01 Thread Federico Fissore
samuele.mattiuzzo, il 31/08/2011 18:22, ha scritto: SEVERE: org.apache.solr.common.SolrException: Error Instantiating UpdateRequestProcessorFactory, ToTheGoCustom is not a org.apache.solr.update.processor.UpdateRequestProcessorFactory btw you can't load classes in the default package from clas

Re: dependency injection in solr

2011-08-30 Thread Federico Fissore
Tomás Fernández Löbbe, il 29/08/2011 20:32, ha scritto: You can use reflection to instantiate the correct object (specify the class name on the parameter on the solrconfig and then invoke the constructor via reflection). You'll have to manage the life-cycle of your object yourself. If I understan

Re: How to send an OpenBitSet object from Solr server?

2011-08-30 Thread Federico Fissore
Satish Talim, il 30/08/2011 14:22, ha scritto: But how to throw? As a stream of bits? getBits() return a long[] add a long[] part to your response rb.rsp.add("long_array", obs.getBits()) federico

Re: How to send an OpenBitSet object from Solr server?

2011-08-30 Thread Federico Fissore
Satish Talim, il 30/08/2011 05:42, ha scritto: [...] Is there a work-around wherein I can send an OpenBitSet object? JavaBinCodec (used by default by solr) supports writing arrays. you can "getBits()" from openbitset and throw them into the binary response federico

Re: How to send an OpenBitSet object from Solr server?

2011-08-30 Thread Federico Fissore
Satish Talim, il 30/08/2011 05:42, ha scritto: [...] Is there a work-around wherein I can send an OpenBitSet object? JavaBinCodec (used by default by solr) supports writing arrays. you can "getBits()" from openbitset and throw them into the binary response federico

Re: dependency injection in solr

2011-08-29 Thread Federico Fissore
Tomás Fernández Löbbe, il 29/08/2011 17:58, ha scritto: I think I get it. Many of the objects that depend on the configuration are instantiated by using reflection, is that an option for you? yes it is what do you propose?

Re: dependency injection in solr

2011-08-29 Thread Federico Fissore
Tomás Fernández Löbbe, il 29/08/2011 17:58, ha scritto: I think I get it. Many of the objects that depend on the configuration are instantiated by using reflection, is that an option for you? yes it is what do you propose?

Re: dependency injection in solr

2011-08-29 Thread Federico Fissore
Tomás Fernández Löbbe, il 29/08/2011 16:39, ha scritto: You can do a lot of dependency injection though solrconfig.xml and schema.xml, Specify search components, update processors, filters, similarity, etc. Solr doesn't use any DI framework, everything is built-in in a pluggable manner. What kind

dependency injection in solr

2011-08-29 Thread Federico Fissore
Hello everyone I need to hack solr by adding a couple custom search components. One small inconvenience is about configuring all the stuff. AFAIK solrconfig.xml is not a place where to do dependency injection, not yet at least. Have you ever had the need to use DI on a solr configuration? How