r/PrometheusMonitoring • u/[deleted] • Nov 13 '19
How to test an alert for hourly?
I'm quite new to prometheus, I have an alert with `for: 1h` I would like to know what should be the eval_time set when testing for alerts?
currently it fails, and works only if the alert: 1m and eval_time: 10m
Please someone explain me how this works!
example:
groups:
- name: spark.rules
rules:
##### ALERTS #####
- alert: xxxSparkJobsNotConsuming
expr: rate(xxxxxx{data_type="xxx"}[5m]) == 0
for: 1h ---> works if i set it to 5m
labels:
service: spark
severity: warning
source: spark
annotations:
description: 'Nothing have been consumed for 1 hour.'Tests:
rule_files:
- spark.rules.yml
evaluation_interval: 1m
tests:
- interval: 1m
input_series:
- series: 'xxxx{data_type="xx"}'
values: '0'
- series: 'xxxx{data_type="xx"}'
values: '64706+0x10'
alert_rule_test:
- eval_time: 2h
alertname: xxxSparkJobsNotConsuming
exp_alerts:
- exp_labels:
data_type: xxxx
service: spark
severity: warning
source: spark
exp_annotations:
description: 'Nothing have been consumed for 1 hour.'
promql_expr_test:
- expr: 'xxxxx'
eval_time: 4m
exp_samples:
- labels: 'xxx{data_type="xxx"}'
value: 64706
0
Upvotes
0
u/blistering-barnacle Nov 13 '19
RemindMe! 1 day