Re: n-Gram, only works with queries of 2 letters

[Norberto Meijome]

On Mon, 23 Jun 2008 05:33:49 -0700 (PDT)
Otis Gospodnetic <[EMAIL PROTECTED]> wrote:

> Hi,
> 
> 
> When you add &debugQuery=true to the request, what does your query look like 
> after parsing?

Hi Otis,
sorry, i should have sent this before too.
With minGramSize = 3 , same data, clean server start, index rebuilt. 2 cases 
shown below, one not working, one working. The 4 letter case (not working) 
seems to be parsed properly, and as expected one of the tokens generated is 
same as my 3 letter query that does work.

DOESN'T WORK AS EXPECTED CASE

−
        <response>
−
        <lst name="responseHeader">
<int name="status">0</int>
<int name="QTime">53</int>
−
        <lst name="params">
<str name="q">eche</str>
<str name="df">artist_ngram</str>
<str name="debugQuery">true</str>
</lst>
</lst>
<result name="response" numFound="0" start="0"/>
−
        <lst name="debug">
<str name="rawquerystring">eche</str>
<str name="querystring">eche</str>
<str name="parsedquery">PhraseQuery(artist_ngram:"ech che eche")</str>
<str name="parsedquery_toString">artist_ngram:"ech che eche"</str>
<lst name="explain"/>
−
        <lst name="timing">
<double name="time">52.0</double>
−
        <lst name="prepare">
<double name="time">0.0</double>
−
        <lst name="org.apache.solr.handler.component.QueryComponent">
<double name="time">0.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.FacetComponent">
<double name="time">0.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.MoreLikeThisComponent">
<double name="time">0.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.HighlightComponent">
<double name="time">0.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.DebugComponent">
<double name="time">0.0</double>
</lst>
</lst>
−
        <lst name="process">
<double name="time">52.0</double>
−
        <lst name="org.apache.solr.handler.component.QueryComponent">
<double name="time">22.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.FacetComponent">
<double name="time">0.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.MoreLikeThisComponent">
<double name="time">0.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.HighlightComponent">
<double name="time">0.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.DebugComponent">
<double name="time">30.0</double>
</lst>
</lst>
</lst>
</lst>
</response>

-------------------------------

WORKS AS EXPECTED CASE

http://localhost:8983/solr/_test_/select?q=ech&df=artist_ngram&debugQuery=true

−
        <response>
−
        <lst name="responseHeader">
<int name="status">0</int>
<int name="QTime">57</int>
−
        <lst name="params">
<str name="q">ech</str>
<str name="df">artist_ngram</str>
<str name="debugQuery">true</str>
</lst>
</lst>
−
        <result name="response" numFound="1" start="0">
−
        <doc>
<str name="artist">Depeche Mode</str>
<str name="artist_ngram">Depeche Mode</str>
<str name="artistid">Depeche Mode</str>
<date name="index_timestamp">2008-06-23T06:28:36.758Z</date>
</doc>
</result>
−
        <lst name="debug">
<str name="rawquerystring">ech</str>
<str name="querystring">ech</str>
<str name="parsedquery">artist_ngram:ech</str>
<str name="parsedquery_toString">artist_ngram:ech</str>
−
        <lst name="explain">
−
        <str name="Depeche Mode">

0.90429556 = (MATCH) fieldWeight(artist_ngram:ech in 43), product of:
  1.0 = tf(termFreq(artist_ngram:ech)=1)
  5.787492 = idf(docFreq=1, numDocs=240)
  0.15625 = fieldNorm(field=artist_ngram, doc=43)
</str>
</lst>
−
        <lst name="timing">
<double name="time">57.0</double>
−
        <lst name="prepare">
<double name="time">0.0</double>
−
        <lst name="org.apache.solr.handler.component.QueryComponent">
<double name="time">0.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.FacetComponent">
<double name="time">0.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.MoreLikeThisComponent">
<double name="time">0.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.HighlightComponent">
<double name="time">0.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.DebugComponent">
<double name="time">0.0</double>
</lst>
</lst>
−
        <lst name="process">
<double name="time">57.0</double>
−
        <lst name="org.apache.solr.handler.component.QueryComponent">
<double name="time">57.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.FacetComponent">
<double name="time">0.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.MoreLikeThisComponent">
<double name="time">0.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.HighlightComponent">
<double name="time">0.0</double>
</lst>
−
        <lst name="org.apache.solr.handler.component.DebugComponent">
<double name="time">0.0</double>
</lst>
</lst>
</lst>
</lst>
</response>

Thanks,
B
_________________________
{Beto|Norberto|Numard} Meijome

"I've dirtied my hands writing poetry, for the sake of seduction; that is,  for 
the sake of a useful cause."
   Dostoevsky

I speak for myself, not my employer. Contents may be hot. Slippery when wet. 
Reading disclaimers makes you go blind. Writing them is worse. You have been 
Warned.