are given 0s) / total suggestions displayed ?
>
> If the above is true, wouldn't Selection to Display be binary? I.e. it's
> either 1/# of suggestions displayed (assuming this is a constant) or 0?
>
> Best,
> Audrey
>
>
> __
suggestions displayed (assuming this is a constant) or 0?
>
> Best,
> Audrey
>
>
>
> From: Paras Lehana
> Sent: Thursday, February 27, 2020 2:58:25 AM
> To: solr-user@lucene.apache.org
> Subject: [EXTERNAL] Re: Re: Re: Query Autocomplete Eval
, wouldn't Selection to Display be binary? I.e. it's either
1/# of suggestions displayed (assuming this is a constant) or 0?
Best,
Audrey
From: Paras Lehana
Sent: Thursday, February 27, 2020 2:58:25 AM
To: solr-user@lucene.apache.org
Subject: [EXTERNA
Hi Audrey,
For MRR, we assume that if a suggestion is selected, it's relevant. It's
also assumed that the user will always click the highest relevant
suggestion. Thus, we calculate position selection for each selection. If
still, I'm not understanding your question correctly, feel free to contact
This article http://wwwconference.org/proceedings/www2011/proceedings/p107.pdf
also indicates that MRR needs binary relevance labels, p. 114: "To this end, we
selected a random sample of 198 (query, context) pairs from the set of 7,311
pairs, and manually tagged each of them as related (i.e., th
