Last one was from Prometheius server's status. But here is my actual file.
global:
scrape_interval: 1m # By default, scrape targets every 1 minute.
scrape_timeout: 1m
evaluation_interval: 5m # How frequently to evaluate rules
# Alertmanager configuration
alerting:
alertmanagers:
- scheme: https
static_configs:
- targets:
- "${NFM_ALERT_MANAGER_URL}"
# Load rules once and periodically evaluate them according to the global
'evaluation_interval'.
rule_files:
- "/etc/prometheus/rules/kafka/confluent.yml"
- "/etc/prometheus/rules/kafka/connect.yml"
- "/etc/prometheus/rules/kafka/uptime.yml"
- "/etc/prometheus/rules/observability/uptime.yml"
# A scrape configuration containing exactly one endpoint to scrape:
# Here it's Prometheus itself.
scrape_configs:
# have prometheus scrape itself to gather internal metrics
- job_name: 'prometheus'
scrape_interval: 1m
scheme: http
static_configs:
- targets:
- 'localhost:9090'
- job_name: 'alertmanager'
scrape_interval: 1m
metrics_path: /metrics
scheme: https
static_configs:
- targets:
- "${NFM_ALERT_MANAGER_URL}"
On Wed, Aug 21, 2024 at 3:10 PM Jay <[email protected]> wrote:
> Greetings Team
> Yes Sure. Please see below.
>
> name: Dev-NotEqualtoBoolZero
> <https://app-prometheus2-d.ase-appintd.appserviceenvironment.net/graph?g0.expr=ALERTS%7Balertname%3D%22Dev-NotEqualtoBoolZero%22%7D&g0.tab=1&g0.display_mode=lines&g0.show_exemplars=0.g0.range_input=1h.>
> expr: confluent_kafka_server_consumer_lag_offsets{job="confluent-cloud"} >
> 100
> <https://app-prometheus2-d.ase-appintd.appserviceenvironment.net/graph?g0.expr=confluent_kafka_server_consumer_lag_offsets%7Bjob%3D%22confluent-cloud%22%7D%20%3E%20100&g0.tab=1&g0.display_mode=lines&g0.show_exemplars=0.g0.range_input=1h.>
> labels:
> severity: critical
> annotations:
> description: The consumer lags for Dev client`
>
>
> global:
> scrape_interval: 1m
> scrape_timeout: 1m
> scrape_protocols:
> - OpenMetricsText1.0.0
> - OpenMetricsText0.0.1
> - PrometheusText0.0.4
> evaluation_interval: 5m
> alerting:
> alertmanagers:
> - follow_redirects: true
> enable_http2: true
> scheme: https
> timeout: 10s
> api_version: v2
> static_configs:
> - targets:
> - app-promalertmanager2-d.ase-appintd.appserviceenvironment.net:443
> rule_files:
> - /etc/prometheus/rules/kafka/confluent.yml
>
> - job_name: confluent-cloud
> honor_timestamps: true
> track_timestamps_staleness: false
> params:
> resource.kafka.id:
> - lkc-xxx
> - lkc-xxx
> - lkc-xxx
> resource.schema_registry.id:
> - lsrc-xxx
> - lsrc-xxx
> - lsrc-xxx
> scrape_interval: 1m
> scrape_timeout: 1m
> scrape_protocols:
> - OpenMetricsText1.0.0
> - OpenMetricsText0.0.1
> - PrometheusText0.0.4
> metrics_path: /v2/metrics/cloud/export
> scheme: https
> enable_compression: true
> basic_auth:
> username: XXXXXXX
> password: <secret>
> follow_redirects: true
> enable_http2: true
> static_configs:
> - targets:
> - api.telemetry.confluent.cloud
>
> On Wed, Aug 21, 2024 at 1:51 PM Daz Wilkin <[email protected]> wrote:
>
>> Please include the rule.
>>
>> You've shown that the query returns results which is necessary but
>> insufficient.
>>
>> On Wednesday, August 21, 2024 at 8:19:34 AM UTC-7 Jay P wrote:
>>
>>> I am not new to Prometheus however, I wrote the following rules which
>>> never fires. (Alertmanger and all other settings are fine since I get
>>> Alarms for other rules except this one)
>>>
>>> Attached here it he screenshot and i am copy pasting here as well.
>>>
>>> confluent_kafka_server_consumer_lag_offsets{job="confluent-cloud"} > 1
>>>
>>> Results:
>>> confluent_kafka_server_consumer_lag_offsets{consumer_group_id="XXX",
>>> instance="api.telemetry.confluent.cloud:443", job="confluent-cloud",
>>> kafka_id="XXX", topic="XXX"}
>>> 2
>>> confluent_kafka_server_consumer_lag_offsets{consumer_group_id="XXX",
>>> instance="api.telemetry.confluent.cloud:443", job="confluent-cloud",
>>> kafka_id="XXX", topic="XXX"}
>>> 3
>>>
>>> Any help is greatly appreciated. Thank you
>>>
>> --
>> You received this message because you are subscribed to a topic in the
>> Google Groups "Prometheus Users" group.
>> To unsubscribe from this topic, visit
>> https://groups.google.com/d/topic/prometheus-users/pBEqCDIUFug/unsubscribe
>> .
>> To unsubscribe from this group and all its topics, send an email to
>> [email protected].
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/prometheus-users/e8007886-5a85-4fdb-938e-36373409498cn%40googlegroups.com
>> <https://groups.google.com/d/msgid/prometheus-users/e8007886-5a85-4fdb-938e-36373409498cn%40googlegroups.com?utm_medium=email&utm_source=footer>
>> .
>>
>
--
You received this message because you are subscribed to the Google Groups
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/prometheus-users/CAN3oSLQVUhybFopq5pQLKyjt0sNz8jhp8HCm1GqWwyBU3AHB2w%40mail.gmail.com.
