Hi Roman, We use our own Search Analytics service. It's free and open to anyone - see http://sematext.com/search-analytics/index.html
And this post talks exactly about the topic you are asking about: http://blog.sematext.com/2012/01/06/relevance-tuning-and-competitive-advantage-via-search-analytics It includes a screenshot with MRR (Mean Reciprocal Rank) that Markus mentioned. Otis Solr & ElasticSearch Support http://sematext.com/ On Feb 12, 2013 5:04 PM, "Roman Chyla" <roman.ch...@gmail.com> wrote: > Hi, > I do realize this is a very broad question, but still I need to ask it. > Suppose you make a change into the scoring formula. How do you > test/know/see what impact it had? Any framework out there? > > It seems like people are writing their own tools to measure relevancy. > > Thanks for any pointers, > > roman >