If you are serving cached queries to the bot, what would be the benefit of suppressing those queries from figuring into the cache statistics page?
On Mon, Sep 1, 2008 at 2:46 PM, Tobias Hill <[EMAIL PROTECTED]> wrote: > Hi all, > > Is there any way to suppress that a certain query gets added to the > caches (or is allowed to affect cache statistics) in Solr? > > *Reason:* We have a very search oriented website. The SEO-aspects > of the site is also important why almost the entire search-space is > traversable for indexing bots (googlebot for instance). These bots > are a substantial part of the traffic on the site*. Needless to say, the > usage pattern of a bot is very different from a human being ... and > in short the bots are filling the caches with "corner-data" from the > search-space. As a consequence human initiated searches suffer > a lot and are far from *as cached as they could be*. > > I have no problem with serving a bot a cached page, the only problem > is that the bots are allowed to be part of the cache-statistics. > > Is there any way to easily suppress this? > > Best regards, > Tobias > > > *) Actually this is not rare, see "Release It!: Design and Deploy > Production-Ready Software"-book for more details on this reality. > -- Regards, Shalin Shekhar Mangar.
