Re: Re: Re: Re: Re: Query Autocomplete Evaluation

2020-02-28 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
Paras, Thank you! This is all very helpful __ I'm going to read through your answer a couple more times and follow up if I have any more questions! Best, Audrey On 2/28/20, 8:08 AM, "Paras Lehana" wrote: Hey Audrey, Users often skip results and go straight to vanilla search even

Re: Re: Re: Re: Query Autocomplete Evaluation

2020-02-28 Thread Paras Lehana
Hey Audrey, Users often skip results and go straight to vanilla search even though > their query is displayed in the top of the suggestions list Yes, we do track this in another metric. This behaviour is more prevalent for shorter terms like "tea" and "bag". But, anyways, we measure MRR for quan

Re: Re: Re: Re: Query Autocomplete Evaluation

2020-02-27 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
Paras, Thank you for this response! Yes, you are being clear __ Regarding the assumptions you make for MRR, do you have any research papers to confirm that these user behaviors have been observed? I only ask because this paper http://yichang-cs.com/yahoo/sigir14_SearchAssist.pdf talks about how