This is not quite enough information. There is https://lucene.apache.org/solr/guide/8_6/filter-descriptions.html#remove-duplicates-token-filter but it has specific limitations.
What is the problem that you are trying to solve that you feel is due to duplicate tokens? Why are they duplicates? Is it about storage or relevancy? Regards, Alex. On Thu, 17 Sep 2020 at 14:35, Rajdeep Sahoo <rajdeepsahoo2...@gmail.com> wrote: > > Hi team, > Is there any way to remove duplicate tokens from solr. Is there any filter > for this.
