Re: Use of solr.ASCIIFoldingFilterFactory

[Sven Maurmann]

Hi,

you might have run into an encoding problem. If you use Tomcat as
the container for Solr you should probably consult the following
  http://wiki.apache.org/solr/SolrTomcat#URI_Charset_Config

Cheers,
    Sven


--On Freitag, 5. Februar 2010 15:41 +0100 Yann PICHOT <ypic...@gmail.com> 
wrote:

Hi,

I have define this type in my schema.xml file :

    <fieldType name="text" class="solr.TextField"
positionIncrementGap="100">
      <analyzer type="index">
        <tokenizer class="solr.WhitespaceTokenizerFactory"/>
        <filter class="solr.ASCIIFoldingFilterFactory" />
        <filter class="solr.LowerCaseFilterFactory" />
      </analyzer>
      <analyzer type="query">
        <tokenizer class="solr.WhitespaceTokenizerFactory"/>
        <filter class="solr.ASCIIFoldingFilterFactory" />
        <filter class="solr.LowerCaseFilterFactory"/>
      </analyzer>
    </fieldType>

Fields definition :

  <fields>
    <field name="id" type="string" indexed="true" stored="true"
required="true" />
    <field name="idProd" type="string" indexed="false" stored="false"
required="false" />
    <field name="description" type="text" indexed="true" stored="true"
required="false" />
    <field name="artiste" type="text" indexed="true" stored="true"
required="false" />
    <field name="collection" type="text" indexed="true" stored="true"
required="false" />
    <field name="titre" type="text" indexed="true" stored="true"
required="false" />
    <field name="all" type="text" indexed="true" stored="true"
required="false" />
  </fields>

  <copyField source="description" dest="all"/>
  <copyField source="collection" dest="all"/>
  <copyField source="artiste" dest="all"/>
  <copyField source="titre" dest="all"/>

I have import my documents with DataImportHandler (my orginals documents
are in RDBMS).

I test query this query string  on SOLR web application : all:chateau.
Results (content of the field "all")  :
  CHATEAU D'AMBOISE
  [CHATEAU EN FRANCE, BABELON]
  ope dvd rene chateau
  CHATEAU DE LA LOIRE
  DE CHATEAU EN CHATEAU ENTRE LA LOIRE ET LE CHER
  [LE CHATEAU AMBULANT, HAYAO MIYAZAKI]
  [Chambres d'hôtes au château, Moreau]
  [ARCHIMEDE, LA VIE DE CHATEAU, KRAHENBUHL]
  [NEUF, NAISSANCE D UN CHATEAU FORT, MACAULAY]
  [ARCHIMEDE, LA VIE DE CHATEAU, KRAHENBUHL]

Now i try this query string : all:château.
No result :(

I don't understand. I think the second query respond the same result of
the first query but it is not the case.

I use SOLR 1.4 (Solr Implementation Version: 1.4.0 833479 -
grantingersoll - 2009-11-06 12:33:40).
Java 32 bits : Java(TM) SE Runtime Environment (build 1.6.0_17-b04)
OS : Windows Seven 64 bits

Regards,
--
Yann