Re: QParsePlugin not working on sharded collection

2016-08-04 Thread tedsolr
So my implementation with a DocTransformer is causing an exception (with a sharded collection): ERROR - 2016-08-04 09:41:44.247; [ShardTest1 shard1_0 core_node3 ShardTest1_shard1_0_replica1] org.apache.solr.common.SolrException; null:org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrExcep

Re: QParsePlugin not working on sharded collection

2016-08-04 Thread tedsolr
Thanks Erick, you answered my question by pointing out the aggregator. I didn't realize a merge strategy was _required_ to return stats info when there are multiple shards. I'm having trouble with my actual plugin so I've scaled back to the simplest possible example. I'm adding to it little by litt

Re: QParsePlugin not working on sharded collection

2016-08-03 Thread Erick Erickson
OK, I'm going to assume that somewhere you're keeping more complicated structures around to track all the docs coming through the collector so you can know whether they're duplicates or not. I think there are really two ways (at least) to go about it 1> use a SearchComponent to add a separate sect

Re: QParsePlugin not working on sharded collection

2016-08-03 Thread tedsolr
So I notice if I create the simplest MergeStrategy I can get my test values from the shard responses and then if I add info to the SolrQueryResponse it gets back to the caller. I still must be missing something. I wouldn't expect to have different code paths - one for single shard one for multi sha

Re: QParsePlugin not working on sharded collection

2016-08-03 Thread Erick Erickson
Right, I don't have the code in front of me right now, but I think your issue is at the "aggregation" point. You also have to put some code in the aggregation bits that pull your custom parts from the sub-request packets and puts in the final packet, "doing the right thing" in terms of assembling t