If someone is searching with " tshirt tshirt tshirt tshirt tshirt tshirt" we need to remove the duplicates and search with tshirt.
On Fri, 18 Sep, 2020, 12:19 am Alexandre Rafalovitch, <arafa...@gmail.com> wrote: > This is not quite enough information. > There is > https://lucene.apache.org/solr/guide/8_6/filter-descriptions.html#remove-duplicates-token-filter > but it has specific limitations. > > What is the problem that you are trying to solve that you feel is due > to duplicate tokens? Why are they duplicates? Is it about storage or > relevancy? > > Regards, > Alex. > > On Thu, 17 Sep 2020 at 14:35, Rajdeep Sahoo <rajdeepsahoo2...@gmail.com> > wrote: > > > > Hi team, > > Is there any way to remove duplicate tokens from solr. Is there any > filter > > for this. >
