Re: need help in understating solr cloud stats data

2014-02-05 Thread Ramkumar R. Aiyengar
We have had success with starting up Jolokia in the same servlet container as Solr, and then using its REST/Bulk API to JMX from the application of choice. On 4 Feb 2014 17:16, "Walter Underwood" wrote: > I agree that sorting and filtering stats in Solr is not a good idea. There > is certainly so

Re: need help in understating solr cloud stats data

2014-02-04 Thread Walter Underwood
I agree that sorting and filtering stats in Solr is not a good idea. There is certainly some use in aggregation, though. One request to /admin/mbeans replaces about 50 JMX requests. Is anybody working on https://issues.apache.org/jira/browse/SOLR-4735? wunder On Feb 4, 2014, at 8:13 AM, Otis G

Re: need help in understating solr cloud stats data

2014-02-04 Thread Otis Gospodnetic
+101 for more stats. Was just saying that trying to pre-aggregate them along multiple dimensions is probably best left out of Solr. Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr & Elasticsearch Support * http://sematext.com/ On Tue, Feb 4, 2014 at 10:49 AM, Mark Miller

Re: need help in understating solr cloud stats data

2014-02-04 Thread Mark Miller
I think that is silly. We can still offer per shard stats *and* let a user easily see stats for a collection without requiring they jump hoops or use a specific monitoring solution where someone else has already jumped hoops for them. You don’t have to guess what ops people really want - *every

Re: need help in understating solr cloud stats data

2014-02-03 Thread Otis Gospodnetic
Hi, Oh, I just saw Greg's email on dev@ about this. IMHO aggregating in the search engine is not the way to do. Leave that to external tools, which are likely to be more flexible when it comes to this. For example, our SPM for Solr can do all kinds of aggregations and filtering by a number of So

Re: need help in understating solr cloud stats data

2014-02-03 Thread Erick Erickson
See: http://wiki.apache.org/solr/HowToContribute It outlines how to get the code, how to work with patches, how to set up IntelliJ and Eclipse IDEs (links near the bottom?). There are formatting files for both IntelliJ and Eclipse that'll do the right thing in terms of indents and such. Legal is

Re: need help in understating solr cloud stats data

2014-02-03 Thread David Santamauro
Zabbix 2.2 has a jmx client built in as well as a few JVM templates. I wrote my own templates for my solr instance and monitoring and graphing is wonderful. David On 02/03/2014 12:55 PM, Joel Cohen wrote: I had to come up with some Solr stats monitoring for my Zabbix instance. I found that

Re: need help in understating solr cloud stats data

2014-02-03 Thread Joel Cohen
I had to come up with some Solr stats monitoring for my Zabbix instance. I found that using JMX was the easiest way for us. There is a command line jmx client that works quite well for me. http://crawler.archive.org/cmdline-jmxclient/ I wrote a shell script to wrap around that and shove the data

Re: need help in understating solr cloud stats data

2014-02-03 Thread Greg Walters
The code I wrote is currently a bit of an ugly hack so I'm a bit reluctant to share it and there's some legal concerns with open-sourcing code within my company. That being said, I wouldn't mind rewriting it on my own time. Where can I find a starter kit for contributors with coding guidelines a

Re: need help in understating solr cloud stats data

2014-02-03 Thread Mark Miller
You should contribute that and spread the dev load with others :) We need something like that at some point, it’s just no one has done it. We currently expect you to aggregate in the monitoring layer and it’s a lot to ask IMO. - Mark http://about.me/markrmiller On Feb 3, 2014, at 10:49 AM, Gr

Re: need help in understating solr cloud stats data

2014-02-03 Thread Greg Walters
I've had some issues monitoring Solr with the per-core mbeans and ended up writing a custom "request handler" that gets loaded then registers itself as an mbean. When called it polls all the per-core mbeans then adds or averages them where appropriate before returning the requested value. I'm no