Hi, We are collecting jmx metrics from the web api, and pushing it to prometheus, but for yarn applications its very difficult to collect data and push, same issue with oozie.
Is anybody collecting application level or job level YARN and OOZIE metrics for prometheus? Regards -Sanjeev On Wed, 3 Jun 2020 at 06:26, ravi kanth <[email protected]> wrote: > Hi Everyone, > > We have a production-ready cluster with 35 nodes that we are currently > using. We are currently using System metrics using Prometheus + Grafana to > visualize server. However, we are more interested in visualizing the Hadoop > & Yarn service level metrics. > > I came across hadoop JMX port which exposes all the needed metrics from > the service. However, I remained unsuccessful in tagging these metrics to > prometheus jmx agent. > > Is there anyone who successfully got the JMX monitoring of Hadoop > components work with Prometheus? Any help is greatly appreciated. > > Currently, we have scripts to parse the meaningful values out of JMX end > point of the namenode & datanodes. > > Thanks In advance, > > Ravi > >
