On Wed, 25 Aug 2010 19:58:36 -0700 Amit Nithian <anith...@gmail.com> wrote:
> i recommend JMeter. We use that to do load testing on a search > server. [...] JMeter is certainly good, but we have also found Apache bench to also be of much use. Maybe it is just us, and what we are familiar with, but Apache bench seemed easier to automate. Also, much easier to get up and running with, at least IMHO. > Be careful though.. as silly as this may sound.. do NOT just > issue random queries because that won't exercise your caches... [...] Conversely, we are still trying to figure out how to make real-life measurements, without having the Solr cache coming into the picture. For querying on a known keyword, every hit after the first, with Apache bench, is strongly affected by the Solr cache. We tried using random strings, but at least with Apache bench, the query string is fixed for each invocation of Apache bench. Have to investigate whether one can do otherwise with JMeter plugins. Also, a query that returns no result (as a random query string typically would) seems to be significantly faster than a real query. So, I think that in the long run, the best way is to build information about *typical* queries that your users run; using the Solr logs, and then use a set of such queries for benchmarking. Regards, Gora