All,
thanks for good feedback.
Letting the load-balancer route bots to a specific slaves
and humans to others seems like the way forward this
time.
Thanks,
Tobias
2008/9/1 Walter Underwood <[EMAIL PROTECTED]>
> How many documents do you have in your index? How many unique
> queries per day,
How many documents do you have in your index? How many unique
queries per day, bot and human? What are your cache hit ratios?
Maybe you can increase the size of the caches and not worry about
it. Search engine position is important. Have marketing pay for
the extra memory (I'm not kidding).
Sendi
Apart from hacking the internals, there's nothing inside Solr which will let
you do that. EHCache is for application layer caches, Solr is an external
server so it can't know about your application. I think that over a period
of time, the caches will be back to normal (through user-generated reques
I get what you are trying to do yes, googlebot essentially fills
up the cache with edge cases.
There is nothing in solr to prevent using the cache for some queries
and not others -- given the way parts of solr works, it is a bad idea
to turn off caching completly (a Document my be retr
Maybe I was a bit unclear, let me try with other words.
I didn't have the statistic-page in mind. All I care about is that I don't
want a massive amount of bot-generated queries affect the internal
statistics of the caches in Solr. If caching would be possible to switch
off for bot-queries the cac
If you are serving cached queries to the bot, what would be the benefit of
suppressing those queries from figuring into the cache statistics page?
On Mon, Sep 1, 2008 at 2:46 PM, Tobias Hill <[EMAIL PROTECTED]> wrote:
> Hi all,
>
> Is there any way to suppress that a certain query gets added to t
