We are very much interested in 3.4.
On Thu, Apr 25, 2013 at 12:55 PM, Alan Woodward <a...@flax.co.uk> wrote: > This is on top of trunk at the moment, but would be back ported to 4.4 if > there was interest. > > Alan Woodward > www.flax.co.uk > > > On 25 Apr 2013, at 10:32, Dmitry Kan wrote: > > > Hi Alan, > > > > Great! What is the solr version you are patching? > > > > Speaking of graphite, we have set it up recently to monitor our shard > farm. > > So far since the RAM usage has been most important metric we were fine > with > > pidstat command and a little script generating stats for carbon. > > Having some additional stats from SOLR itself would certainly be great to > > have. > > > > Dmitry > > > > On Thu, Apr 25, 2013 at 12:01 PM, Alan Woodward <a...@flax.co.uk> wrote: > > > >> Hi Walter, Dmitry, > >> > >> I opened https://issues.apache.org/jira/browse/SOLR-4735 for this, with > >> some work-in-progress. Have a look! > >> > >> Alan Woodward > >> www.flax.co.uk > >> > >> > >> On 23 Apr 2013, at 07:40, Dmitry Kan wrote: > >> > >>> Hello Walter, > >>> > >>> Have you had a chance to get something working with graphite, codahale > >> and > >>> solr? > >>> > >>> Has anyone else tried these tools with Solr 3.x family? How much work > is > >> it > >>> to set things up? > >>> > >>> We have tried zabbix in the past. Even though it required lots of up > >> front > >>> investment on configuration, it looks like a compelling option. > >>> In the meantime, we are looking into something more "solr-tailed" yet > >>> simple. Even without metrics persistence. Tried: jconsole and viewing > >> stats > >>> via jmx. Main point for us now is to gather the RAM usage. > >>> > >>> Dmitry > >>> > >>> > >>> On Tue, Apr 9, 2013 at 9:43 PM, Walter Underwood < > wun...@wunderwood.org > >>> wrote: > >>> > >>>> If it isn't obvious, I'm glad to help test a patch for this. We can > run > >> a > >>>> simulated production load in dev and report to our metrics server. > >>>> > >>>> wunder > >>>> > >>>> On Apr 8, 2013, at 1:07 PM, Walter Underwood wrote: > >>>> > >>>>> That approach sounds great. --wunder > >>>>> > >>>>> On Apr 7, 2013, at 9:40 AM, Alan Woodward wrote: > >>>>> > >>>>>> I've been thinking about how to improve this reporting, especially > now > >>>> that metrics-3 (which removes all of the funky thread issues we ran > into > >>>> last time I tried to add it to Solr) is close to release. I think we > >> could > >>>> go about it as follows: > >>>>>> > >>>>>> * refactor the existing JMX reporting to use metrics-3. This would > >>>> mean replacing the SolrCore.infoRegistry map with a MetricsRegistry, > and > >>>> adding a JmxReporter, keeping the existing config logic to determine > >> which > >>>> JMX server to use. PluginInfoHandler and SolrMBeanInfoHandler > translate > >>>> the metrics-3 data back into SolrMBean format to keep the reporting > >>>> backwards-compatible. This seems like a lot of work for no visible > >>>> benefit, but… > >>>>>> * we can then add the ability to define other metrics reporters in > >>>> solrconfig.xml. There are already reporters for Ganglia and Graphite > - > >> you > >>>> just add then to the Solr lib/ directory, configure them in > solrconfig, > >> and > >>>> voila - Solr can be monitored using the same devops tools you use to > >>>> monitor everything else. > >>>>>> > >>>>>> Does this sound sane? > >>>>>> > >>>>>> Alan Woodward > >>>>>> www.flax.co.uk > >>>>>> > >>>>>> > >>>>>> On 6 Apr 2013, at 20:49, Walter Underwood wrote: > >>>>>> > >>>>>>> Wow, that really doesn't help at all, since these seem to only be > >>>> reported in the stats page. > >>>>>>> > >>>>>>> I don't need another non-standard app-specific set of metrics, > >>>> especially one that needs polling. I need metrics delivered to the > >> common > >>>> system that we use for all our servers. > >>>>>>> > >>>>>>> This is also why SPM is not useful for us, sorry Otis. > >>>>>>> > >>>>>>> Also, there is no time period on these stats. How do you graph the > >>>> 95th percentile? I know there was a lot of work on these, but they > seem > >>>> really useless to me. I'm picky about metrics, working at Netflix does > >> that > >>>> to you. > >>>>>>> > >>>>>>> wunder > >>>>>>> > >>>>>>> On Apr 3, 2013, at 4:01 PM, Walter Underwood wrote: > >>>>>>> > >>>>>>>> In the Jira, but not in the docs. > >>>>>>>> > >>>>>>>> It would be nice to have VM stats like GC, too, so we can have > >> common > >>>> monitoring and alerting on all our services. > >>>>>>>> > >>>>>>>> wunder > >>>>>>>> > >>>>>>>> On Apr 3, 2013, at 3:31 PM, Otis Gospodnetic wrote: > >>>>>>>> > >>>>>>>>> It's there! :) > >>>>>>>>> > >> http://search-lucene.com/?q=percentile&fc_project=Solr&fc_type=issue > >>>>>>>>> > >>>>>>>>> Otis > >>>>>>>>> -- > >>>>>>>>> Solr & ElasticSearch Support > >>>>>>>>> http://sematext.com/ > >>>>>>>>> > >>>>>>>>> On Wed, Apr 3, 2013 at 6:29 PM, Walter Underwood < > >>>> wun...@wunderwood.org> wrote: > >>>>>>>>>> That sounds great. I'll check out the bug, I didn't see anything > >> in > >>>> the docs about this. And if I can't find it with a search engine, it > >>>> probably isn't there. --wunder > >>>>>>>>>> > >>>>>>>>>> On Apr 3, 2013, at 6:39 AM, Shawn Heisey wrote: > >>>>>>>>>> > >>>>>>>>>>> On 3/29/2013 12:07 PM, Walter Underwood wrote: > >>>>>>>>>>>> What are folks using for this? > >>>>>>>>>>> > >>>>>>>>>>> I don't know that this really answers your question, but Solr > 4.1 > >>>> and > >>>>>>>>>>> later includes a big chunk of codahale metrics internally for > >>>> request > >>>>>>>>>>> handler statistics - see SOLR-1972. First we tried including > the > >>>> jar > >>>>>>>>>>> and using the API, but that created thread leak problems, so > the > >>>> source > >>>>>>>>>>> code was added. > >>>>>>>>>>> > >>>>>>>>>>> Thanks, > >>>>>>>>>>> Shawn > >>>>>>> > >>>>>>> > >>>>>>> > >>>>>>> > >>>>>> > >>>>> > >>>>> -- > >>>>> Walter Underwood > >>>>> wun...@wunderwood.org > >>>>> > >>>>> > >>>>> > >>>> > >>>> -- > >>>> Walter Underwood > >>>> wun...@wunderwood.org > >>>> > >>>> > >>>> > >>>> > >> > >> > >
