Solr debug 'explain' values differ from the Solr score

2016-03-10 Thread Rick Sullivan
Hi,
I'm seeing behavior in Solr 5.5.0 where the top-level values I see in the debug 
response don't always correspond with the scores Solr assigns to the matched 
documents.

For example, here is the top-level debug information for two documents matched 
by a query:
114628: Objectdescription: "sum of:"details: Array[2]match: truevalue: 20.542768
357547: Objectdescription: "sum of:"details: Array[2]match: truevalue: 26.517654
But they have scores114628: 20.542767357547: 13.258826
I expect the second document to be the most relevant for my query, and the 
debug values seem to agree. However, in the final score I receive, that 
document's score has been adjusted down.
The relevant debug response information can be found here: 
http://apaste.info/mju
Does anyone have an idea why the Solr score may differ from the debug value?
Thanks,-Rick  

RE: Solr debug 'explain' values differ from the Solr score

2016-03-15 Thread Rick Sullivan
After some digging and experimentation, here are some more details on the issue 
I'm seeing.


1. The adjusted documents' scores are always exactly (debug_score/N), where N 
is the number of OR items in the query. 

For example, `&q=firstName:gabby~ firstName_phonetic:gabby 
firstName_tokens:(gabby)` will result in some of the documents with 
firstName==GABBY receiving a score 1/3 of the score of other GABBY documents, 
even though the debug explanation shows that they generated the same score.


2. This doesn't appear to be a brand new issue, or an issue with SolrCloud.

I've tested the problem using SolrCloud 5.5.0, Solr 5.5.0 (not cloud), and Solr 
5.4.1.


Anyone have any ideas?

Thanks,
-Rick

From: r...@ricksullivan.net
To: solr-user@lucene.apache.org
Subject: Solr debug 'explain' values differ from the Solr score
Date: Thu, 10 Mar 2016 08:34:30 -0800

Hi,

I'm seeing behavior in Solr 5.5.0 where the top-level values I see in the debug 
response don't always correspond with the scores Solr assigns to the matched 
documents.

For example, here is the top-level debug information for two documents matched 
by a query:

114628: Object
  description: "sum of:"
  details: Array[2]
  match: true
  value: 20.542768

357547: Object
  description: "sum of:"
  details: Array[2]
  match: true
  value: 26.517654

But they have scores

114628: 20.542767
357547: 13.258826

I expect the second document to be the most relevant for my query, and the 
debug values seem to agree. However, in the final score I receive, that 
document's score has been adjusted down.

The relevant debug response information can be found here: 
http://apaste.info/mju

Does anyone have an idea why the Solr score may differ from the debug value?

Thanks,
-Rick 

RE: Explain score is different from score

2016-03-19 Thread Rick Sullivan
Try adding the following to your schema just under the  tag:

 

This seems to solve the problem for me. Well I at least haven't yet found any 
cases where I see the score discrepancy.

Thanks,
-Rick


> From: r...@ricksullivan.net
> To: solr-user@lucene.apache.org
> Subject: RE: Explain score is different from score
> Date: Fri, 18 Mar 2016 07:24:34 -0700
>
> Hi Rajesh,
>
> I've been seeing the same problem you have. My debug scores seem to be what I 
> expect, but the actual scores applied by Solr are sometimes divided by an 
> integer.
>
> I raised the same question in this email distribution about a week ago, but 
> haven't yet found a solution. There's also a StackOverflow question I created 
> here:
> http://stackoverflow.com/questions/35921106/how-and-why-do-solr-explain-values-differ-from-the-solr-score
>
> Can you verify whether all of your affected scores are (1/N)*score? I think N 
> seems to be the number of OR elements in the query. For example, your case 
> below has
>
> debug_score/score
> = 1.2517526/0.41725087
> = 3
>
> Thanks,
> -Rick
>
> 
>> From: r...@cebglobal.com
>> To: solr-user@lucene.apache.org
>> Subject: RE: Explain score is different from score
>> Date: Fri, 18 Mar 2016 13:29:14 +
>>
>> Can someone help?
>>
>>
>>
>>
>> Corporate Executive Board India Private Limited. Registration No: 
>> U741040HR2004PTC035324. Registered office: 6th Floor, Tower B, DLF Building 
>> No.10 DLF Cyber City, Gurgaon, Haryana-122002, India..
>>
>>
>>
>> This e-mail and/or its attachments are intended only for the use of the 
>> addressee(s) and may contain confidential and legally privileged information 
>> belonging to CEB and/or its subsidiaries, including CEB subsidiaries that 
>> offer SHL Talent Measurement products and services. If you have received 
>> this e-mail in error, please notify the sender and immediately, destroy all 
>> copies of this email and its attachments. The publication, copying, in whole 
>> or in part, or use or dissemination in any other way of this e-mail and 
>> attachments by anyone other than the intended person(s) is prohibited.
>>
>>
>> From: G, Rajesh
>> Sent: Friday, March 18, 2016 12:56 PM
>> To: solr-user@lucene.apache.org
>> Subject: Explain score is different from score
>>
>> Mismatch in score displayed in debug and score field. Please refer attached 
>> xml.
>>
>> When I search for title_ws:(Microsoft Ofice 365). If the results are 
>> displayed by explain score order then we would have the expected result 
>> “Microsoft Office 365” then “Lync - Microsoft Office 365”
>>
>> 
>> 
>> Lync - Microsoft Office 365
>> Lync - Microsoft Office 365
>> 1722669
>> 1.0952835 Score from explain 1.0952835
>> 
>> Microsoft Office 365
>> Microsoft Office 365
>> 2043876
>> 0.41725087 Score from explain 1.2517526
>> 
>>
>> Thanks
>> Rajesh
>
  

RE: Explain score is different from score

2016-03-19 Thread Rick Sullivan
Yes it seems to be something similar, but the normalization isn't applied to 
all retrieved documents, which messes with the document rankings.

Some documents have the exact values from the 'explain' response, while others 
are normalized.

-Rick


> Date: Fri, 18 Mar 2016 16:06:19 +
> From: iori...@yahoo.com.INVALID
> To: solr-user@lucene.apache.org
> Subject: Re: Explain score is different from score
>
> Hi Rajesh,
>
> I suspect it is due to the queryNorm(q). But it is weird that relative order 
> is different in your example.
>
>
> "queryNorm(q) is a normalizing factor used to make scores between queries 
> comparable. This factor does not affect document ranking (since all ranked 
> documents are multiplied by the same factor), but rather just attempts to 
> make scores from different queries (or even different indexes) comparable." 
> [1]
>
> [1] 
> https://lucene.apache.org/core/5_5_0/core/org/apache/lucene/search/similarities/TFIDFSimilarity.html
>
> Ahmet
>
>
> On Friday, March 18, 2016 4:24 PM, Rick Sullivan  
> wrote:
> Hi Rajesh,
>
> I've been seeing the same problem you have. My debug scores seem to be what I 
> expect, but the actual scores applied by Solr are sometimes divided by an 
> integer.
>
> I raised the same question in this email distribution about a week ago, but 
> haven't yet found a solution. There's also a StackOverflow question I created 
> here:
> http://stackoverflow.com/questions/35921106/how-and-why-do-solr-explain-values-differ-from-the-solr-score
>
> Can you verify whether all of your affected scores are (1/N)*score? I think N 
> seems to be the number of OR elements in the query. For example, your case 
> below has
>
> debug_score/score
> = 1.2517526/0.41725087
> = 3
>
> Thanks,
> -Rick
>
>
> 
>> From: r...@cebglobal.com
>> To: solr-user@lucene.apache.org
>> Subject: RE: Explain score is different from score
>> Date: Fri, 18 Mar 2016 13:29:14 +
>>
>> Can someone help?
>>
>>
>>
>>
>> Corporate Executive Board India Private Limited. Registration No: 
>> U741040HR2004PTC035324. Registered office: 6th Floor, Tower B, DLF Building 
>> No.10 DLF Cyber City, Gurgaon, Haryana-122002, India..
>>
>>
>>
>> This e-mail and/or its attachments are intended only for the use of the 
>> addressee(s) and may contain confidential and legally privileged information 
>> belonging to CEB and/or its subsidiaries, including CEB subsidiaries that 
>> offer SHL Talent Measurement products and services. If you have received 
>> this e-mail in error, please notify the sender and immediately, destroy all 
>> copies of this email and its attachments. The publication, copying, in whole 
>> or in part, or use or dissemination in any other way of this e-mail and 
>> attachments by anyone other than the intended person(s) is prohibited.
>>
>>
>> From: G, Rajesh
>> Sent: Friday, March 18, 2016 12:56 PM
>> To: solr-user@lucene.apache.org
>> Subject: Explain score is different from score
>>
>> Mismatch in score displayed in debug and score field. Please refer attached 
>> xml.
>>
>> When I search for title_ws:(Microsoft Ofice 365). If the results are 
>> displayed by explain score order then we would have the expected result 
>> “Microsoft Office 365” then “Lync - Microsoft Office 365”
>>
>> 
>> 
>> Lync - Microsoft Office 365
>> Lync - Microsoft Office 365
>> 1722669
>> 1.0952835 Score from explain 1.0952835
>> 
>> Microsoft Office 365
>> Microsoft Office 365
>> 2043876
>> 0.41725087 Score from explain 1.2517526
>> 
>>
>> Thanks
>> Rajesh
  

RE: Explain score is different from score

2016-03-19 Thread Rick Sullivan
I'm not. I only have query boosts.


> Date: Fri, 18 Mar 2016 16:42:36 +
> From: iori...@yahoo.com.INVALID
> To: solr-user@lucene.apache.org
> Subject: Re: Explain score is different from score
>
> Hi Rick,
>
> This could be a bug I think. Do you guys use index time boosts?
>
> Ahmet
>
>
>
> On Friday, March 18, 2016 6:15 PM, Rick Sullivan  
> wrote:
> Yes it seems to be something similar, but the normalization isn't applied to 
> all retrieved documents, which messes with the document rankings.
>
> Some documents have the exact values from the 'explain' response, while 
> others are normalized.
>
> -Rick
>
>
> 
>> Date: Fri, 18 Mar 2016 16:06:19 +
>> From: iori...@yahoo.com.INVALID
>> To: solr-user@lucene.apache.org
>> Subject: Re: Explain score is different from score
>>
>> Hi Rajesh,
>>
>> I suspect it is due to the queryNorm(q). But it is weird that relative order 
>> is different in your example.
>>
>>
>> "queryNorm(q) is a normalizing factor used to make scores between queries 
>> comparable. This factor does not affect document ranking (since all ranked 
>> documents are multiplied by the same factor), but rather just attempts to 
>> make scores from different queries (or even different indexes) comparable." 
>> [1]
>>
>> [1] 
>> https://lucene.apache.org/core/5_5_0/core/org/apache/lucene/search/similarities/TFIDFSimilarity.html
>>
>> Ahmet
>>
>>
>> On Friday, March 18, 2016 4:24 PM, Rick Sullivan  
>> wrote:
>> Hi Rajesh,
>>
>> I've been seeing the same problem you have. My debug scores seem to be what 
>> I expect, but the actual scores applied by Solr are sometimes divided by an 
>> integer.
>>
>> I raised the same question in this email distribution about a week ago, but 
>> haven't yet found a solution. There's also a StackOverflow question I 
>> created here:
>> http://stackoverflow.com/questions/35921106/how-and-why-do-solr-explain-values-differ-from-the-solr-score
>>
>> Can you verify whether all of your affected scores are (1/N)*score? I think 
>> N seems to be the number of OR elements in the query. For example, your case 
>> below has
>>
>> debug_score/score
>> = 1.2517526/0.41725087
>> = 3
>>
>> Thanks,
>> -Rick
>>
>>
>> 
>>> From: r...@cebglobal.com
>>> To: solr-user@lucene.apache.org
>>> Subject: RE: Explain score is different from score
>>> Date: Fri, 18 Mar 2016 13:29:14 +
>>>
>>> Can someone help?
>>>
>>>
>>>
>>>
>>> Corporate Executive Board India Private Limited. Registration No: 
>>> U741040HR2004PTC035324. Registered office: 6th Floor, Tower B, DLF Building 
>>> No.10 DLF Cyber City, Gurgaon, Haryana-122002, India..
>>>
>>>
>>>
>>> This e-mail and/or its attachments are intended only for the use of the 
>>> addressee(s) and may contain confidential and legally privileged 
>>> information belonging to CEB and/or its subsidiaries, including CEB 
>>> subsidiaries that offer SHL Talent Measurement products and services. If 
>>> you have received this e-mail in error, please notify the sender and 
>>> immediately, destroy all copies of this email and its attachments. The 
>>> publication, copying, in whole or in part, or use or dissemination in any 
>>> other way of this e-mail and attachments by anyone other than the intended 
>>> person(s) is prohibited.
>>>
>>>
>>> From: G, Rajesh
>>> Sent: Friday, March 18, 2016 12:56 PM
>>> To: solr-user@lucene.apache.org
>>> Subject: Explain score is different from score
>>>
>>> Mismatch in score displayed in debug and score field. Please refer attached 
>>> xml.
>>>
>>> When I search for title_ws:(Microsoft Ofice 365). If the results are 
>>> displayed by explain score order then we would have the expected result 
>>> “Microsoft Office 365” then “Lync - Microsoft Office 365”
>>>
>>> 
>>> 
>>> Lync - Microsoft Office 365
>>> Lync - Microsoft Office 365
>>> 1722669
>>> 1.0952835 Score from explain 1.0952835
>>> 
>>> Microsoft Office 365
>>> Microsoft Office 365
>>> 2043876
>>> 0.41725087 Score from explain 1.2517526
>>> 
>>>
>>> Thanks
>>> Rajesh
  

RE: Explain score is different from score

2016-03-19 Thread Rick Sullivan
Hi Rajesh,

I've been seeing the same problem you have. My debug scores seem to be what I 
expect, but the actual scores applied by Solr are sometimes divided by an 
integer.

I raised the same question in this email distribution about a week ago, but 
haven't yet found a solution. There's also a StackOverflow question I created 
here: 
http://stackoverflow.com/questions/35921106/how-and-why-do-solr-explain-values-differ-from-the-solr-score

Can you verify whether all of your affected scores are (1/N)*score? I think N 
seems to be the number of OR elements in the query. For example, your case 
below has 

   debug_score/score
= 1.2517526/0.41725087
= 3

Thanks,
-Rick


> From: r...@cebglobal.com
> To: solr-user@lucene.apache.org
> Subject: RE: Explain score is different from score
> Date: Fri, 18 Mar 2016 13:29:14 +
>
> Can someone help?
>
>
>
>
> Corporate Executive Board India Private Limited. Registration No: 
> U741040HR2004PTC035324. Registered office: 6th Floor, Tower B, DLF Building 
> No.10 DLF Cyber City, Gurgaon, Haryana-122002, India..
>
>
>
> This e-mail and/or its attachments are intended only for the use of the 
> addressee(s) and may contain confidential and legally privileged information 
> belonging to CEB and/or its subsidiaries, including CEB subsidiaries that 
> offer SHL Talent Measurement products and services. If you have received this 
> e-mail in error, please notify the sender and immediately, destroy all copies 
> of this email and its attachments. The publication, copying, in whole or in 
> part, or use or dissemination in any other way of this e-mail and attachments 
> by anyone other than the intended person(s) is prohibited.
>
>
> From: G, Rajesh
> Sent: Friday, March 18, 2016 12:56 PM
> To: solr-user@lucene.apache.org
> Subject: Explain score is different from score
>
> Mismatch in score displayed in debug and score field. Please refer attached 
> xml.
>
> When I search for title_ws:(Microsoft Ofice 365). If the results are 
> displayed by explain score order then we would have the expected result 
> “Microsoft Office 365” then “Lync - Microsoft Office 365”
>
> 
> 
> Lync - Microsoft Office 365
> Lync - Microsoft Office 365
> 1722669
> 1.0952835 Score from explain 1.0952835
> 
> Microsoft Office 365
> Microsoft Office 365
> 2043876
> 0.41725087 Score from explain 1.2517526
> 
>
> Thanks
> Rajesh
  

RE: Solr debug 'explain' values differ from the Solr score

2016-03-20 Thread Rick Sullivan
I still have the problem even without using the phonetic field. 

For example, the following query will result in some exact name matches having 
scores of 4.64, while others get 2.32. All debug info has final values of 4.64.

    &q=( ( (firstName:john~)^0.5 (firstName:john) )^4)

I expect all exact matches to score the same, as the debug response seems to 
indicate they should be. 

I'm not having success reproducing the issue on a small amount of exported data 
indexed using post.jar. The issue still appears when I reduced the data pulled 
by the DIH to only the first 1,000,000 first names, however. Could this be due 
to some indexing issue with the DIH?

Thanks,
-Rick


> Date: Tue, 15 Mar 2016 15:40:18 -0700
> From: hossman_luc...@fucit.org
> To: solr-user@lucene.apache.org
> Subject: RE: Solr debug 'explain' values differ from the Solr score
>
>
> Sounds like a mismatch in the way the BooleanQuery explanation generation
> code is handling situations where there is/isn't a coord factor involved
> in computing the score itself. (the bug is almost certainly in the
> "explain" code, since that is less rigorously tested in most cases, and
> the score itself is probably correct)
>
> I tried to trivially reproduce the symptoms you described using the
> techproducts example and was unable to generate a discrepency using a
> simple boolean query w/a fuzzy clause...
>
> http://localhost:8983/solr/techproducts/query?q=ipod~%20belkin&fl=id,name,score&debug=query&debug=results&debug.explain.structured=true
>
> ...can you distill one of your problematic queries down to a
> shorter/simpler reproducible example, and/or provide us with the field &
> fieldType details for all of the fields used in your example?
>
> (i'm guessing it probably relates to your firstName_phonetic field?)
>
>
>
> : Date: Tue, 15 Mar 2016 13:17:04 -0700
> : From: Rick Sullivan 
> : Reply-To: solr-user@lucene.apache.org
> : To: "solr-user@lucene.apache.org" 
> : Subject: RE: Solr debug 'explain' values differ from the Solr score
> :
> : After some digging and experimentation, here are some more details on the 
> issue I'm seeing.
> :
> :
> : 1. The adjusted documents' scores are always exactly (debug_score/N), where 
> N is the number of OR items in the query.
> :
> : For example, `&q=firstName:gabby~ firstName_phonetic:gabby 
> firstName_tokens:(gabby)` will result in some of the documents with 
> firstName==GABBY receiving a score 1/3 of the score of other GABBY documents, 
> even though the debug explanation shows that they generated the same score.
> :
> :
> : 2. This doesn't appear to be a brand new issue, or an issue with SolrCloud.
> :
> : I've tested the problem using SolrCloud 5.5.0, Solr 5.5.0 (not cloud), and 
> Solr 5.4.1.
> :
> :
> : Anyone have any ideas?
> :
> : Thanks,
> : -Rick
> :
> : From: r...@ricksullivan.net
> : To: solr-user@lucene.apache.org
> : Subject: Solr debug 'explain' values differ from the Solr score
> : Date: Thu, 10 Mar 2016 08:34:30 -0800
> :
> : Hi,
> :
> : I'm seeing behavior in Solr 5.5.0 where the top-level values I see in the 
> debug response don't always correspond with the scores Solr assigns to the 
> matched documents.
> :
> : For example, here is the top-level debug information for two documents 
> matched by a query:
> :
> : 114628: Object
> : description: "sum of:"
> : details: Array[2]
> : match: true
> : value: 20.542768
> :
> : 357547: Object
> : description: "sum of:"
> : details: Array[2]
> : match: true
> : value: 26.517654
> :
> : But they have scores
> :
> : 114628: 20.542767
> : 357547: 13.258826
> :
> : I expect the second document to be the most relevant for my query, and the 
> debug values seem to agree. However, in the final score I receive, that 
> document's score has been adjusted down.
> :
> : The relevant debug response information can be found here: 
> http://apaste.info/mju
> :
> : Does anyone have an idea why the Solr score may differ from the debug value?
> :
> : Thanks,
> : -Rick
>
> -Hoss
> http://www.lucidworks.com/
  

RE: Explain score is different from score

2016-03-21 Thread Rick Sullivan
I haven't checked this thread since Friday, but here are my responses to the 
questions that have come up.

1. How is ranking affected?

Some documents have their scores divided by an integer value in the response 
documents.

2. Do you see the proper ranking in the explain section?

Yes, the explain section always seems to have consistent values and proper 
rankings.

3. What about the results?

No, these are ranked according to the sometimes incorrect score.

4. What version of Solr are you using?

I've produced the problem on SolrCloud 5.5.0 (2 shards on 2 nodes on the same 
machine), Solr 5.5.0 (no sharding), and Solr 5.4.1 (no sharding).
I've also had trouble reproducing the problem on test data.

Thanks,
-Rick


> Date: Mon, 21 Mar 2016 14:14:44 +
> From: iori...@yahoo.com.INVALID
> To: solr-user@lucene.apache.org
> Subject: Re: Explain score is different from score
>
>
>
> Hi Alessandro,
>
> OP have different ranking: fl=score and explain's score would have retrieve 
> different orders.
> I wrote test cases using ClassicSimilarity, but it won't re-produce.
> This is really weird. I wonder what is triggering this.
>
> aHmet
>
>
> On Monday, March 21, 2016 2:08 PM, Alessandro Benedetti 
>  wrote:
>
>
>
> I would like to add a question, how the ranking is affected ?
> Do you see the proper ranking in the explain section ?
> And what about the results ? Are they ranked accordingly the correct score,
> or they are ranked by the wrong score ?
> I got a similar issue, which I am not able to reproduce yet, but it was
> really really weird ( in my case I got also the ranking messed up_
>
> Cheers
>
>
> On Mon, Mar 21, 2016 at 7:30 AM, G, Rajesh  wrote:
>
>> Hi Ahmet,
>>
>> I am using solr 5.5.0. I am running single instance with single core. No
>> shards
>>
>> I have added  to my schema
>> as suggested by Rick Sullivan. Now the scores are same between explain and
>> score field.
>>
>> But instead of previous results "Lync - Microsoft Office 365" and
>> "Microsoft Office 365" I am getting
>>
>> {
>> "title":"Office 365",
>> "score":7.471676
>> },
>> {
>> "title":"Office 365",
>> "score":7.471676
>> },
>>
>> If I try NGram title:(Microsoft Ofice 365)
>>
>> The scores are same for top 10 results even though they are differing by
>> min of 3 characters. I have attached my schema.xml so it can help
>>
>> 
>> Lync - Microsoft Office 365
>> 52.056263
>> 
>> Microsoft Office 365
>> 52.056263
>> 
>> Microsoft Office 365 1.0
>> 52.056263
>> 
>> Microsoft Office 365 14.0
>> 52.056263
>> 
>> Microsoft Office 365 14.3
>> 52.056263
>> 
>> Microsoft Office 365 14.4
>> 52.056263
>> 
>> Microsoft Office 365 14.5(Mac)
>> 52.056263
>> 
>> Microsoft Office 365 15.0
>> 52.056263
>> 
>> Microsoft Office 365 16.0
>> 52.056263
>> 
>> Microsoft Office 365 4.0
>> 52.056263
>> 
>> Microsoft Office 365 E4
>> 52.056263
>> 
>> Microsoft Mail Protection Reports for Office 365
>> 15.0
>> 50.215454
>>
>> Thanks
>> Rajesh
>>
>>
>>
>> Corporate Executive Board India Private Limited. Registration No:
>> U741040HR2004PTC035324. Registered office: 6th Floor, Tower B, DLF Building
>> No.10 DLF Cyber City, Gurgaon, Haryana-122002, India.
>>
>> This e-mail and/or its attachments are intended only for the use of the
>> addressee(s) and may contain confidential and legally privileged
>> information belonging to CEB and/or its subsidiaries, including CEB
>> subsidiaries that offer SHL Talent Measurement products and services. If
>> you have received this e-mail in error, please notify the sender and
>> immediately, destroy all copies of this email and its attachments. The
>> publication, copying, in whole or in part, or use or dissemination in any
>> other way of this e-mail and attachments by anyone other than the intended
>> person(s) is prohibited.
>>
>> -Original Message-
>> From: Ahmet Arslan [mailto:iori...@yahoo.com]
>> Sent: Sunday, March 20, 2016 2:10 AM
>> To: solr-user@lucene.apache.org; G, Rajesh ;
>> r...@ricksullivan.net
>> Subject: Re: Explain score is different from score
>>
>> Hi Rick and Rajesh,
>>
>> I wasn't able re-produce this neither with lucene nor solr.
>> What version of solr is this?
>> Are

RE: Explain score is different from score

2016-03-23 Thread Rick Sullivan
Thanks for proving that this bug exists Ahmet! I couldn't for the life of me 
find a reproducible case.

-Rick


> Date: Wed, 23 Mar 2016 18:31:56 +
> From: iori...@yahoo.com
> To: solr-user@lucene.apache.org; abenede...@apache.org; 
> r...@ricksullivan.net; r...@cebglobal.com
> Subject: Re: Explain score is different from score
>
> Hi Rajesh,
>
> This is truly a Lucene level bug. I attached a failing Lucene test case with 
> the data you provided.
>
> Please see: https://issues.apache.org/jira/browse/SOLR-8884 and
> reproduce with: ant test -Dtestcase=TestExplain -Dtests.method=testRajeshData 
> -Dtests.seed=FEABDC2CA354130E
>
>
> The ticked needs to be moved to Lucene.
>
> Thanks Rajesh for the data!
>
> P.S. I didn't finish solr test case after the Lucene failure. Currently it 
> just prints. It can be clearly seen that scores are different.
>
> 
> 7614
> Microsoft Office 365
> 0.41190073
> 1.2357022 = product of ... 
> 
> 
> 7615
> Microsoft Office 365 1.0
> 0.41190073
> 1.2357022 = product of ... 
> 
>
>
> Ahmet
>
>
> On Wednesday, March 23, 2016 9:26 AM, "G, Rajesh"  wrote:
>
>
>
> Hi Ahmet,
>
> I reproduced this issue again so thought the attached files would help.
> Attached file has config[schema,solrconfig,data-imort...] , data I have 
> indexed and the result [debug.xml]
> From the debug.xml I can see the difference in fl=score vs explain score. 
> maxScore is not assigned the real max[hope this is related to score diff 
> issue]
>
> Thanks
> Rajesh
>
>
>
> Corporate Executive Board India Private Limited. Registration No: 
> U741040HR2004PTC035324. Registered office: 6th Floor, Tower B, DLF Building 
> No.10 DLF Cyber City, Gurgaon, Haryana-122002, India.
>
> This e-mail and/or its attachments are intended only for the use of the 
> addressee(s) and may contain confidential and legally privileged information 
> belonging to CEB and/or its subsidiaries, including CEB subsidiaries that 
> offer SHL Talent Measurement products and services. If you have received this 
> e-mail in error, please notify the sender and immediately, destroy all copies 
> of this email and its attachments. The publication, copying, in whole or in 
> part, or use or dissemination in any other way of this e-mail and attachments 
> by anyone other than the intended person(s) is prohibited.
>
> -Original Message-
> From: Ahmet Arslan [mailto:iori...@yahoo.com]
> Sent: Tuesday, March 22, 2016 9:35 PM
> To: solr-user@lucene.apache.org; abenede...@apache.org; 
> r...@ricksullivan.net; G, Rajesh 
> Subject: Re: Explain score is different from score
>
>
>
> Hi all,
>
> May be it is better to move the discussion into a jira ticket.
> I created SOLR-8884 for this.
>
> aHmet
>
> On Tuesday, March 22, 2016 1:59 PM, Alessandro Benedetti 
>  wrote:
>
>
>
> I got this problem re-ranking.
> But in my short experience I was not able to reproduce nor fix the bug.
> Can I ask you the query aprser used and all the components involved in the 
> query ?
>
> Cheers
>
> On Mon, Mar 21, 2016 at 8:40 PM, Rick Sullivan 
> wrote:
>
>> I haven't checked this thread since Friday, but here are my responses
>> to the questions that have come up.
>>
>> 1. How is ranking affected?
>>
>> Some documents have their scores divided by an integer value in the
>> response documents.
>>
>> 2. Do you see the proper ranking in the explain section?
>>
>> Yes, the explain section always seems to have consistent values and
>> proper rankings.
>>
>> 3. What about the results?
>>
>> No, these are ranked according to the sometimes incorrect score.
>>
>> 4. What version of Solr are you using?
>>
>> I've produced the problem on SolrCloud 5.5.0 (2 shards on 2 nodes on
>> the same machine), Solr 5.5.0 (no sharding), and Solr 5.4.1 (no sharding).
>> I've also had trouble reproducing the problem on test data.
>>
>> Thanks,
>> -Rick
>>
>> 
>>> Date: Mon, 21 Mar 2016 14:14:44 +
>>> From: iori...@yahoo.com.INVALID
>>> To: solr-user@lucene.apache.org
>>> Subject: Re: Explain score is different from score
>>>
>>>
>>>
>>> Hi Alessandro,
>>>
>>> OP have different ranking: fl=score and explain's score would have
>> retrieve different orders.
>>> I wrote test cases using ClassicSimilarity, but it won't re-produce.
>>> This is really weird. I wonder what is triggering this.