I can receive same result! Thanks! 2012/5/17 Shinichiro Abe <shinichiro.ab...@gmail.com>
> If you want to treat test.pdf as a phrase "test pdf", > it might work by setting text_sen autoGeneratePhraseQueries="true". > > Regards, > Shinichiro Abe > > On 2012/05/17, at 10:39, Katsuyoshi NOGUCHI wrote: > > > OK, I understand how those words are tokenized by different tokenizer > > factories. > > My question is that how I can have solr analyze and search for "test" AND > > "pdf". > > As Solr1.4 gives result of "test" AND "pdf", I want Solr 3.6 to do the > same. > > (Solr3.6 gives result of "test" OR "pdf"). > > > > Any idea? > > > > 2012/5/17 Jack Krupansky <j...@basetechnology.com> > > > >> The query may be the same, but your analyzers are radically different. > >> > >> Just a hunch, but maybe GosenTokenizerFactory is treating the "." as a > >> space. In 1.4 you were using SenTokenizerFactory. Or maybe > >> GosenBasicFormFilterFactory is treating the "." as a space. In any > case, my > >> hunch is that "test.pdf" gets to WDF as two separate tokens, which is > the > >> query that is generated on 3.6. > >> > >> To debug, remove the filters starting with WDF and see if the "." was > >> still there before WDF has invoked. No need to reindex, just reload Solr > >> and look at the parsed query for test.pdf . > >> > >> -- Jack Krupansky > >> > >> -----Original Message----- From: Katsuyoshi NOGUCHI > >> Sent: Wednesday, May 16, 2012 6:03 AM > >> To: solr-user@lucene.apache.org > >> Subject: Dismax query results vary on Solr1.4 and 3.6. > >> > >> Hi, guys! I need some advice. > >> > >> When sending the same dismax query to Solr 1.4 and 3.6, > >> query results of search words analized by WordDelimiterFilterFactory are > >> different as below: > >> > >> [Search Word] > >> test.pdf > >> > >> [Result] > >> Solr1.4: Search results are analized by "test" AND "pdf" > >> Solr3.6: Search results are analized by "test" OR "pdf" > >> > >> In Solr3.6, how can I recieve the same result of "test" AND "pdf" as in > >> Solr 1.4? > >> > >> [Japanese Analizer] > >> Solr1.4 -> Sen > >> Solr3.6 -> lucene-gosen > >> > >> > >> Here are some examples of debug results in solrAdmin: > >> /*solrAdmin debug result-1.4*/ > >> <lst name="debug"> > >> <str name="rawquerystring">test.**pdf</str> > >> <str name="querystring">test.pdf</**str> > >> <str name="parsedquery"> > >> +DisjunctionMaxQuery((**fcontent_tsn_is:"test pdf" | fname_tbg_is:"test > >> pdf")) () > >> </str> > >> <str name="parsedquery_toString"> > >> +(fcontent_tsn_is:"test pdf" | fname_tbg_is:"test pdf") () > >> </str> > >> … > >> <str name="QParser">DisMaxQParser</**str> > >> … > >> </lst> > >> > >> /*solrAdmin debug result-3.6*/ > >> <lst name="debug"> > >> <str name="rawquerystring">test.**pdf</str> > >> <str name="querystring">test.pdf</**str> > >> <str name="parsedquery"> > >> +DisjunctionMaxQuery(((**fcontent_tsn_is:test fcontent_tsn_is:pdf) | > >> (fname_tbg_is:test fname_tbg_is:pdf))) > >> </str> > >> <str name="parsedquery_toString"> > >> +((fcontent_tsn_is:test fcontent_tsn_is:pdf) | (fname_tbg_is:test > >> fname_tbg_is:pdf)) > >> </str> > >> ... > >> <str name="QParser">**ExtendedDismaxQParser</str> > >> … > >> </lst> > >> > >> > >> The followings are request handlers used in Solr1.4/3.6: > >> > >> /*solrconfig.xml-1.4*/ > >> <requestHandler name="dismax" class="solr.SearchHandler" > > >> <lst name="defaults"> > >> <str name="defType">dismax</str> > >> <str name="echoParams">explicit</**str> > >> <str name="q.alt">*:*</str> > >> <str name="qf">fcontent_tsn_is^1.0 fname_tbg_is^1.0 </str> > >> </lst> > >> </requestHandler> > >> > >> /*solrconfig.xml-3.6*/ > >> <requestHandler name="dismax" class="solr.SearchHandler" > > >> <lst name="defaults"> > >> <str name="defType">edismax</str> > >> <str name="echoParams">explicit</**str> > >> <str name="q.alt">*:*</str> > >> <str name="qf">content_tsn_is^1.0 name_tbg_is^1.0</str> > >> </lst> > >> </requestHandler> > >> > >> > >> The followings are schemas used in Solr1.4/3.6: > >> /*schema.xml-1.4*/ > >> <fieldType name="text_sen" class="solr.TextField"> > >> <analyzer> > >> <tokenizer class="solrbook.analysis.**SenTokenizerFactory" /> > >> <filter class="solr.StopFilterFactory" ignoreCase="true" > >> words="stopwords.txt" enablePositionIncrements="**true" /> > >> <filter class="solr.**WordDelimiterFilterFactory" generateWordParts="1" > >> generateNumberParts="1" catenateWords="1" catenateNumbers="1" > >> catenateAll="0" splitOnCaseChange="0"/> > >> <filter class="solr.**LowerCaseFilterFactory"/> > >> <filter class="solr.TrimFilterFactory" /> > >> <filter class="solr.**SynonymFilterFactory" synonyms="synonyms.txt" > >> tokenizerFactory="solrbook.**analysis.SenTokenizerFactory" > >> ignoreCase="true" > >> expand="true"/> > >> </analyzer> > >> </fieldType> > >> > >> <fields> > >> <dynamicField name="*_tsn_is" type="text_sen" indexed="true" > >> stored="true" compressed="false" termVectors="true" > termPositions="true" > >> termOffsets="true" /> > >> <dynamicField name="*_tbg_is" type="text_bigram" indexed="true" > >> stored="true" compressed="false" termVectors="true" > termPositions="true" > >> termOffsets="true" /> > >> </fields> > >> > >> <solrQueryParser defaultOperator="AND"/> > >> > >> /*schema.xml-3.6*/ > >> <fieldType name="text_sen" class="solr.TextField"> > >> <analyzer> > >> <charFilter class="solr.**MappingCharFilterFactory" > >> mapping="ja-mapping.txt"/> > >> <filter class="solr.**LowerCaseFilterFactory"/> > >> <tokenizer class="solr.**GosenTokenizerFactory"/> > >> <filter class="solr.StopFilterFactory" ignoreCase="true" > >> words="stopwords.txt" enablePositionIncrements="**true" /> > >> <filter class="solr.**GosenBasicFormFilterFactory" /> > >> <filter class="solr.**WordDelimiterFilterFactory" generateWordParts="1" > >> generateNumberParts="1" catenateWords="1" catenateNumbers="1" > >> catenateAll="0" splitOnCaseChange="0"/> > >> <filter class="solr.TrimFilterFactory" /> > >> </analyzer> > >> </fieldType> > >> > >> <fields> > >> <dynamicField name="*_tsn_is" type="text_sen" indexed="true" > >> stored="true" compressed="false" termVectors="true" > termPositions="true" > >> termOffsets="true" /> > >> <dynamicField name="*_tbg_is" type="text_bigram" indexed="true" > >> stored="true" compressed="false" termVectors="true" > termPositions="true" > >> termOffsets="true" /> > >> </fields> > >> > >> <solrQueryParser defaultOperator="AND"/> > >> > >> > >> Regards. > >> > >
