Don't mean to interrupt, but out of curiosity why is ASCIIFoldingFilterFactory only in the query analyzer, not the indexer? wouldn't it need to be in both to get the desired result?
On Wed, Sep 7, 2022 at 8:59 AM Carsten Klement <[email protected]> wrote: > > > - > Hi Markus, thank you, yes i think i have another problem ;) I > tried with ASCIIFoldingFilterFactory, but analysis shows dèkor instead of > decor. I use an Solr-cluster with 3 Nodes (3 replica), i droped > collection and create a new one, but perhaps there is the problem? > <dynamicField name="*_txt" type="text_general" indexed="true" > stored="true"/> > > <fieldType name="text_general" class="solr.TextField" > positionIncrementGap="100"> > <analyzer type="index"> > <tokenizer class="solr.StandardTokenizerFactory"/> > <filter class="solr.StopFilterFactory" ignoreCase="true" > words="stopwords.txt" /> > <filter class="solr.LowerCaseFilterFactory"/> > </analyzer> > <analyzer type="query"> > <tokenizer class="solr.StandardTokenizerFactory"/> > <filter class="solr.StopFilterFactory" ignoreCase="true" > words="stopwords.txt" /> > <filter class="solr.SynonymFilterFactory" synonyms="synonyms.txt" > ignoreCase="true" expand="true"/> > <filter class="solr.LowerCaseFilterFactory"/> > <filter class="solr.ASCIIFoldingFilterFactory" > preserveOriginal="true"/> > </analyzer> > </fieldType> > regards Carsten > > -----Ursprüngliche Nachricht----- > > Von: Markus <[email protected]> > An: users <[email protected]> > Datum: Mittwoch, 7. September 2022 13:41 CEST > Betreff: Re: Search without Accent > > Hello Karsten, > > I added your config snippet, but with the ASCIIFoldingFilterFactory > replacing MappingCharFilterFactory, to one of my collections and reloaded > the collection. Using Solr's analysis page i tested if it works, and it > does. Can you test the field on your collection? Analysis should be ok, > perhaps something else is wrong. > > Regards, > Markus > > [1] http://localhost:8983/solr/#/ > <COLLECTION>/analysis?analysis.fieldvalue=th%C3%A9&analysis.query=the&analysis.fieldname=schnellsuche&verbose_output=1 > > > Op wo 7 sep. 2022 om 13:12 schreef Carsten Klement < > [email protected]>: > > > > > Hi Markus, > > > > thank you for your reply. > > > > I dropped the collection and create a new one for my tests, but now i > also > > reloaded the collection, but i doesn't change anything. > > > > search for "thé" is fine, but search for "the" didn't bring the result. > > I also testet solr.ASCIIFoldingFilterFactory, but it doesn't change > > anything. :( > > > > Regards > > Carsten > > > > > > -----Ursprüngliche Nachricht----- > > > > Von: Markus <[email protected]> > > An: users <[email protected]> > > Datum: Mittwoch, 7. September 2022 12:07 CEST > > Betreff: Re: Search without Accent > > > > Hello Karsten, > > > > The MappingCharFilterFactory should work just fine for German or French > > accents with the default ISOLatin1Accent configuration file, although we > > rarely use it. Instead, you can try the regular token filter <filter > > class="solr.ASCIIFoldingFilterFactory"/>. It does a similar job. > > > > Do not forget to reload the Solr core/collection once you uploaded or > > placed the new configuration. > > > > Regards, > > Markus > > > > Op wo 7 sep. 2022 om 09:47 schreef Carsten Klement < > > [email protected]>: > > > > > Hi, > > > > > > we use solr 6.6 and use a quicksearch on our website. For this case we > > > copy some data fields to an field called "schnellsuche", this worked > > > fine a few years. > > > > > > Now we want import french data with Accent-Keys, for example "thé". > The > > > user should find the same results, if he search for "thé" or "the". > This > > > a problem i can't resolve. > > > > > > I use charfilter, but this doesn't help > > > > > > <charFilter class="solr.MappingCharFilterFactory" > > > mapping="mapping-ISOLatin1Accent.txt"/> > > > > > > > > > <field name="schnellsuche" type="text_schnellsuche" indexed="true" > > > stored="false" multiValued="true"/> > > > > > > <copyField source="articlegroup_id" dest="schnellsuche"/> > > > <copyField source="tree_id" dest="schnellsuche"/> > > > <copyField source="tree_bezeichnung" dest="schnellsuche"/> > > > <copyField source="tree_keywords" dest="schnellsuche"/> > > > > > > <copyField source="*_txt" dest="schnellsuche"/> > > > <copyField source="*_int" dest="schnellsuche"/> > > > <copyField source="*_dec" dest="schnellsuche"/> > > > > > > <fieldType name="text_schnellsuche" class="solr.TextField" > > > positionIncrementGap="100"> > > > <analyzer> > > > <tokenizer class="solr.ClassicTokenizerFactory"/> > > > <filter class="solr.ManagedSynonymFilterFactory" > > > managed="german" /> > > > <filter class="solr.LowerCaseFilterFactory"/> > > > <charFilter class="solr.MappingCharFilterFactory" > > > mapping="mapping-ISOLatin1Accent.txt"/> > > > </analyzer> > > > </fieldType> > > > > > > Perhaps somebody can help? > > > > > > Thanks > > > Carsten > > > > > > > > >
