Hi All, Any suggestions on below observation, can i use Char Filter to retain old behavior of Standard Tokenizer ?
Thanks, Deepu On Sat, Nov 28, 2020 at 4:59 PM Deepu <kpkumar1...@gmail.com> wrote: > Hi All, > > We are in process of migrating from Solr 5 to solr 8, during testing > observed that Standard tokenizer in Solr 5 was considering emojis as > special chars and removing them apparently in Solr 8 it's considering them > as regular chars so not removing while indexing. > > We need to retain same behavior in solr 8 also, as we are using white > space tokenizer to index Emojis and standard tokenizer to remove them now > both are behaving the same. > > Please share your suggestions. > > > Thanks, > Deepu >
