[
https://issues.apache.org/jira/browse/SOLR-10059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17221474#comment-17221474
]
Christine Poerschke commented on SOLR-10059:
--------------------------------------------
{quote}... The FacetComponent corrects this automatically by removing
duplicates. ...
{quote}
Thanks for sharing that detail!
[https://github.com/apache/lucene-solr/blob/releases/lucene-solr/8.6.3/solr/core/src/java/org/apache/solr/handler/component/FacetComponent.java#L86-L101]
looks to be the area of code where duplicate facet parameters are removed.
----
I don't know how far or close we are here w.r.t. changing the existing
behaviour for every handler that inherits from {{RequestHandlerBase}} but
complementary to any changes, if a protected (say)
{{RequestHandlerBase.prepareRequestParams}} method was factored out then that
would slightly shorten the {{handleRequest}} method –
[https://github.com/apache/lucene-solr/blob/releases/lucene-solr/8.6.3/solr/core/src/java/org/apache/solr/handler/RequestHandlerBase.java#L189-L276]
– and custom handlers could override this method e.g. to de-duplicate
parameters.
How would having a custom handler differ from locally patching the
{{RequestHandlerBase}} code itself?
* Any {{RequestHandlerBase}} change automatically applies to all handlers that
inherit from it, no configuration changes would be needed but a locally built
Solr needs to be deployed.
* A custom handler means that changes only apply to the handler being
customised but a configuration change would be needed to use the custom
handler. Build wise the custom handler could be built separately and deployed
as a plugin i.e. no need to locally build Solr itself.
----
Another approach perhaps might be to have custom search component – a bit like
[~janhoy]'s
[RequestSanitizerComponent|https://github.com/cominvent/request-sanitizer-component]
– which dedupes parameters before any other component gets to see the request
and its parameters?
> In SolrCloud, every fq added via <lst name="appends"> is computed twice.
> ------------------------------------------------------------------------
>
> Key: SOLR-10059
> URL: https://issues.apache.org/jira/browse/SOLR-10059
> Project: Solr
> Issue Type: Bug
> Components: SolrCloud
> Affects Versions: 6.4
> Reporter: Marc Morissette
> Priority: Major
> Labels: performance
> Attachments:
> SOLR-10059-RequestHandlerBase-prepareRequestParams.patch, SOLR-10059_7x.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> While researching another issue, I noticed that parameters appended to a
> query via SearchHandler's <lst name="appends"> are added to the query twice
> in SolrCloud: once on the aggregator and again on the shard.
> The FacetComponent corrects this automatically by removing duplicates. Field
> queries added in this fashion are however computed twice and that hinders
> performance on filter queries that aren't simple bitsets such as those
> produced by the CollapsingQueryParser.
> To reproduce the issue, simply test this handler on a large enough
> collection, then replace "appends" with "defaults". You'll notice significant
> performance improvements.
> {code}
> <requestHandler name="/myHandler" class="solr.SearchHandler">
> <lst name="appends">
> <str name="fq">{!collapse field=routingKey hint=top_fc}</str>
> </lst>
> </requestHandler>
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]