Benchmarking Solr Query performance

2018-02-09 Thread Diego Ceccarelli (BLOOMBERG/ LONDON)
Hi all, We would like to perform a benchmark of https://issues.apache.org/jira/browse/SOLR-11831 The patch improves the performance of grouped queries asking only for one result per group (aka. group.limit=1). I remember seeing a page showing a benchmark of the query performance on Wikipedia,

Re: Planning and benchmarking Solr: resource consumption (RAM, disk, CPU, number of nodes)

2016-05-11 Thread Shawn Heisey
On 5/11/2016 6:06 AM, Horváth Péter Gergely wrote: > If there is no such research document available, I would be much obliged if > you could give some hints on what and how to measure in Solr / Solr cloud > world. (E.g. what the optimal resource utilization of a Solr instance is, > how to recognize

Planning and benchmarking Solr: resource consumption (RAM, disk, CPU, number of nodes)

2016-05-11 Thread Horváth Péter Gergely
Hi All, I am wondering if there is any recommendation or convention regarding planning and benchmarking a Solr node / Solr Cloud cluster infrastructure. I am looking for a somewhat more structured approach than trying with our forecast data volumes and keep adding more resources (CPU, RAM, disk et

Re: Benchmarking Solr

2013-05-27 Thread Otis Gospodnetic
Hi Benson, We typically use https://github.com/sematext/ActionGenerator As a matter of fact, we are using it right now to test one of our search clusters... Otis -- Solr & ElasticSearch Support http://sematext.com/ On Sun, May 26, 2013 at 10:38 AM, Benson Margulies wrote: > I'd like to run

Re: Benchmarking Solr

2013-05-26 Thread Upayavira
SolrMeter? Upayavira On Sun, May 26, 2013, at 03:38 PM, Benson Margulies wrote: > I'd like to run a repeatable test of having Solr ingest a corpus of > docs on disk, to measure the speed of some alternative things plugged > in. > > Anyone have some advice to share? One approach would be a quick

Benchmarking Solr

2013-05-26 Thread Benson Margulies
I'd like to run a repeatable test of having Solr ingest a corpus of docs on disk, to measure the speed of some alternative things plugged in. Anyone have some advice to share? One approach would be a quick SolrJ program that pushed the entire stack as one giant collection with a commit at the end.

Re: Benchmarking Solr 3.3 vs. 4.0

2012-11-30 Thread Daniel Exner
Shawn Heisey wrote: [..] For best results, you'll want to ensure that Solr4 is working completely from scratch, that it has never seen a 3.3 index, so that it will use its own native format. That's why I did in the second run. Thanks for clarifying that this is in fact better. :) It may be a

Re: Benchmarking Solr 3.3 vs. 4.0

2012-11-29 Thread Shawn Heisey
On 11/29/2012 8:29 AM, Daniel Exner wrote: I'll answer both your mails in one. Shawn Heisey wrote: On 11/29/2012 3:15 AM, Daniel Exner wrote: I'm currently doing some benchmarking of a real Solr 3.3 instance vs the same ported to Solr 4.0. [..] In the graph you can see high CPU load, all the

Re: Benchmarking Solr 3.3 vs. 4.0

2012-11-29 Thread Daniel Exner
I'll answer both your mails in one. Shawn Heisey wrote: On 11/29/2012 3:15 AM, Daniel Exner wrote: I'm currently doing some benchmarking of a real Solr 3.3 instance vs the same ported to Solr 4.0. [..] In the graph you can see high CPU load, all the time. This is even the case if I reduce the

Re: Benchmarking Solr 3.3 vs. 4.0

2012-11-29 Thread Shawn Heisey
On 11/29/2012 3:15 AM, Daniel Exner wrote: I'm currently doing some benchmarking of a real Solr 3.3 instance vs the same ported to Solr 4.0. Another note specifically related to this part: Have you used the same configuration and done the minimal changes required to make it run, or have you t

Re: Benchmarking Solr 3.3 vs. 4.0

2012-11-29 Thread Shawn Heisey
On 11/29/2012 3:15 AM, Daniel Exner wrote: I'm currently doing some benchmarking of a real Solr 3.3 instance vs the same ported to Solr 4.0. Benchmarking is done using JMeter from localhost. Test scenario is a constant stream of queries from a log file out of production, at targeted 50 QPS. Af

Benchmarking Solr 3.3 vs. 4.0

2012-11-29 Thread Daniel Exner
Hi Solr community, I'm currently doing some benchmarking of a real Solr 3.3 instance vs the same ported to Solr 4.0. Benchmarking is done using JMeter from localhost. Test scenario is a constant stream of queries from a log file out of production, at targeted 50 QPS. After some time (marked i

RE: Benchmarking Solr

2010-04-14 Thread Lesyshyn, Erica
.vac...@videotron.ca] Sent: Saturday, April 10, 2010 11:04 PM To: solr-user@lucene.apache.org Subject: Re: Benchmarking Solr Hi, why don't you use JMeter? It would give you greater control over the tests you wish to make. It has many different samplers that will let you run different scena

Re: Benchmarking Solr

2010-04-14 Thread Shawn Heisey
On 4/12/2010 9:57 AM, Shawn Heisey wrote: On 4/12/2010 8:51 AM, Paolo Castagna wrote: There are already two related pages: - http://wiki.apache.org/solr/SolrPerformanceFactors - http://wiki.apache.org/solr/SolrPerformanceData Why not to create a new page? - http://wiki.apache.org/solr/Benc

Re: Benchmarking Solr

2010-04-12 Thread Shawn Heisey
On 4/12/2010 8:51 AM, Paolo Castagna wrote: There are already two related pages: - http://wiki.apache.org/solr/SolrPerformanceFactors - http://wiki.apache.org/solr/SolrPerformanceData Why not to create a new page? - http://wiki.apache.org/solr/BenchmarkingSolr (?) Done. I hope you like i

Re: Benchmarking Solr

2010-04-12 Thread Paolo Castagna
Shawn Heisey wrote: Anyone got a recommendation about where to put it on the wiki? There are already two related pages: - http://wiki.apache.org/solr/SolrPerformanceFactors - http://wiki.apache.org/solr/SolrPerformanceData Why not to create a new page? - http://wiki.apache.org/solr/Benchm

Re: Benchmarking Solr

2010-04-12 Thread Paolo Castagna
Paolo Castagna wrote: I do not have an answer to your questions. But, I have the same issue/problem you have. Some related threads: - http://markmail.org/message/pns4dtfvt54mu3vs - http://markmail.org/message/7on6lvabsosvj7bc - http://markmail.org/message/ftz7tkd7ekhnk4bc - http://markmail

RE: Benchmarking Solr

2010-04-12 Thread Nagelberg, Kallin
-Original Message- From: Blargy [mailto:zman...@hotmail.com] Sent: Friday, April 09, 2010 9:47 PM To: solr-user@lucene.apache.org Subject: Benchmarking Solr I am about to deploy Solr into our production environment and I would like to do some benchmarking to determine how many slaves I will need to

Re: Benchmarking Solr

2010-04-12 Thread Shawn Heisey
I've got a very simple perl script (most of the work is done with modules) that I wrote which forks off multiple processes and throws requests at Solr, then gives a little bit of statistical analysis at the end. I have planned on sharing it from the beginning, I just have to clean it up for pu

Re: Benchmarking Solr

2010-04-12 Thread Markus Jelsma
Hi, You can use Siege [1] in a similar manner as AB and it can support newline separated URL files and pick random URL's. [1]:http://freshmeat.net/projects/siege/ Cheers, On Saturday 10 April 2010 03:46:56 Blargy wrote: > I am about to deploy Solr into our production environment and I woul

Re: Benchmarking Solr

2010-04-12 Thread Paolo Castagna
Hi, I do not have an answer to your questions. But, I have the same issue/problem you have. It would be good if Solr community would agree and share their approach for benchmarking Solr. Indeed, it would be good to have a benchmark for "information retrieval" systems. AFIK there

Re: Benchmarking Solr

2010-04-10 Thread Jean-Sebastien Vachon
load. But other than this, I don`t see much use to it. JMeter offers many more options once you get to know it a little. good luck - Original Message - From: "Blargy" To: Sent: Friday, April 09, 2010 9:46 PM Subject: Benchmarking Solr I am about to deploy Solr into

Benchmarking Solr

2010-04-09 Thread Blargy
average requests per/day is ~2m. We will be running RHEL with about 8-12g ram. Any idea how many slaves might be required to handle our load? Thanks -- View this message in context: http://n3.nabble.com/Benchmarking-Solr-tp709561p709561.html Sent from the Solr - User mailing list archive at

Re: problem during benchmarking solr query

2010-03-16 Thread Lance Norskog
arse error in solr. > > Can any one suggest me how do i handle this?so that entire query is > considered as uri  and also solr respond with appropriate reply. > thank you. > > > -- > View this message in context: > http://old.nabble.com/problem-during-benchmark

problem during benchmarking solr query

2010-03-16 Thread KshamaPai
http://old.nabble.com/problem-during-benchmarking-solr-query-tp27926801p27926801.html Sent from the Solr - User mailing list archive at Nabble.com.