Re: Performance issue: distributed grouping + dense vector search

2025-04-10 Thread Yue Yu
Hi David, Yes we have migrated most of the result grouping use case to "Collapse & Expand" as the official solr doc suggested, there are just a few that we can't really migrate yet. I'll file a jira with more details and submit a PR soon Thanks, Yue On Sat, Apr 5, 2025 at 12:37 PM David Smiley

Re: Performance issue: distributed grouping + dense vector search

2025-04-05 Thread David Smiley
Maybe not a helpful response but I want to say anyway that you should consider "Collapse & Expand" before result grouping. It's generally more efficient, code details are better encapsulated (which I care about, as a maintainer). However, result grouping works on distributed search (shards) when

Performance issue: distributed grouping + dense vector search

2025-04-05 Thread Yue Yu
Hi All, When running vector search with grouping in multi-shard setting, the KnnFloatVectorQuery is executed (2+rows) times. I've observed that Qtime grows linearly when I increase "rows" number The culprit is this function call in https://github.com/apache/solr/blob/main/solr/core/src/java/org/