Re: Question about fieldNorm

2008-06-11 Thread Brendan Grainger
Thanks so much, that explains it. Brendan On Jun 11, 2008, at 4:00 PM, Yonik Seeley wrote: Field norms have limited precision (it's encoded as an 8 bit float) so you are probably seeing rounding. -Yonik On Wed, Jun 11, 2008 at 2:13 PM, Brendan Grainger <[EMAIL PROTECTED]> wrote: Hi Yonik,

Re: Question about fieldNorm

2008-06-11 Thread Yonik Seeley
Field norms have limited precision (it's encoded as an 8 bit float) so you are probably seeing rounding. -Yonik On Wed, Jun 11, 2008 at 2:13 PM, Brendan Grainger <[EMAIL PROTECTED]> wrote: > Hi Yonik, > > I just realized that the stemmer does make a difference because of synonyms. > So on indexin

Re: Question about fieldNorm

2008-06-11 Thread Brendan Grainger
Hi Yonik, I just realized that the stemmer does make a difference because of synonyms. So on indexing using the new stemmer "converter hanger assembly replacement" gets expanded to: "converter hanger assembly assemble replacement" so there are 5 terms which gets a length norm of 0.4472136

Re: Question about fieldNorm

2008-06-11 Thread Brendan Grainger
Hi Yonik, Yes I did rebuild the index and they are the same document (just verified). The only thing that changed was the stemmer, but that makes no sense to me. Also, if the equation for the fieldNorm is: fieldBoost * lengthNorm = fieldBoost * 1 /sqrt(numTermsForField) Then that would mea

Re: Question about fieldNorm

2008-06-11 Thread Yonik Seeley
That is strange... did you re-index or change the index? If so, you might want to verify that docid=3454 still corresponds to the same document you queried earlier. -Yonik On Wed, Jun 11, 2008 at 1:09 PM, Brendan Grainger <[EMAIL PROTECTED]> wrote: > I've just changed the stemming algorithm sli

Question about fieldNorm

2008-06-11 Thread Brendan Grainger
Hi, I've just changed the stemming algorithm slightly and am running a few tests against the old stemmer versus the new stemmer. I did a query for 'hanger' and using the old stemmer I get the following scoring for a document with the title: Converter Hanger Assembly Replacement 6.4242806