Hi, I have found the problem which led to this. It was due to the signature field being omitted for some of the records.
This is caused by the below line not in the solrconfig.xml /update/extract requestHandler during the indexing. <str name="update.chain">dedupe</str> Regards, Edwin On 7 November 2017 at 22:07, Amrit Sarkar <sarkaramr...@gmail.com> wrote: > Zheng, > > Usually, the number of records returned is more than what is shown in the > > ngroup. For example, I may get a ngroup of 22, but there are 25 records > > being returned. > > > Does the 25 records being returned have duplicates? Grouping is subjected > to co-location of data of same group values in same shard. Can you share > what is the architecture of the setup? > > > Amrit Sarkar > Search Engineer > Lucidworks, Inc. > 415-589-9269 > www.lucidworks.com > Twitter http://twitter.com/lucidworks > LinkedIn: https://www.linkedin.com/in/sarkaramrit2 > Medium: https://medium.com/@sarkaramrit2 > > On Tue, Nov 7, 2017 at 8:36 AM, Zheng Lin Edwin Yeo <edwinye...@gmail.com> > wrote: > > > Hi, > > > > I'm using Solr 6.5.1, and I'm facing the issue of incorrect ngroup count > > after I have group it by signature field. > > > > Usually, the number of records returned is more than what is shown in the > > ngroup. For example, I may get a ngroup of 22, but there are 25 records > > being returned. > > > > Below is the part of solrconfig.xml that does the grouping. > > > > <updateRequestProcessorChain name="dedupe"> <processor class= > > "solr.processor.SignatureUpdateProcessorFactory"> <bool > > name="enabled">true > > </bool> <str name="signatureField">signature</str> <bool name= > > "overwriteDupes">false</bool> <str name="fields">content</str> <str name= > > "signatureClass">solr.processor.Lookup3Signature</str> </processor> < > > processor class="solr.DistributedUpdateProcessorFactory" /> <processor > > class > > ="solr.LogUpdateProcessorFactory" /> <processor class= > > "solr.RunUpdateProcessorFactory" /> </updateRequestProcessorChain> > > > > > > This is where I set the grouping to true in the requestHandler > > > > <str name="group">true</str> <str name="group.field">signature</str> > <str > > name="group.main">true</str> <!--<str name="group.ngroups">true</str>--> > < > > str name="group.cache.percent">100</str> > > > > What could be the issue that causes this? > > > > Regards, > > Edwin > > >
