Skip to content

Mixin: Add and update alerts #2644

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
SuperQ merged 19 commits into from
Jul 4, 2023
Merged

Mixin: Add and update alerts #2644

Changes from 1 commit
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
fc967aa
Add mountpoint to NodeFilesystem alerts
v-zhuravlev Mar 27, 2023
0e0399d
Decrease NodeFilesystem pending time to 15m
v-zhuravlev Mar 27, 2023
fd2d62a
Add CPU and memory alerts
v-zhuravlev Mar 27, 2023
7479418
Add failed systemd service alert
v-zhuravlev Mar 27, 2023
3d8075d
Decrease NodeNetwork*Errs pending period
v-zhuravlev Mar 27, 2023
614030b
Set 'at' everywhere as preposition for instance
v-zhuravlev Mar 27, 2023
94fc82e
Add NodeDiskIOSaturation alert
v-zhuravlev Mar 27, 2023
962de6c
Add %(nodeExporterSelector)s to Network and conntrack alerts
v-zhuravlev Mar 27, 2023
c3ec6e8
Add diskDevice selector
v-zhuravlev Mar 27, 2023
e15e7d6
Fix NodeMemoryHighUtilization alert
v-zhuravlev Mar 27, 2023
580c497
Add NodeSystemSaturation and NodeMemoryMajorPagesFaults
v-zhuravlev Mar 27, 2023
da32f8d
Decrease NodeSystemdServiceFailed severity to warning
v-zhuravlev Mar 29, 2023
e48e790
Extend alert description
v-zhuravlev Apr 5, 2023
2111e70
Add comma after 'mounted on'
v-zhuravlev Apr 5, 2023
77ae769
Add thresholds for memory alerts
v-zhuravlev Apr 5, 2023
6bdc1d9
Add thresholds for memory, disk and system alerts
v-zhuravlev Apr 5, 2023
b7dfb32
Set severity to NodeCPUHighUsage to info
v-zhuravlev Apr 5, 2023
3e250a9
Update NodeSystemSaturation severity
v-zhuravlev Apr 26, 2023
e8d7f4e
Revert alerts pending durtions
v-zhuravlev Jun 29, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Add diskDevice selector 
Signed-off-by: Vitaly Zhuravlev <[email protected]>
  • Loading branch information
@v-zhuravlev
v-zhuravlev committed Jun 29, 2023
commit c3ec6e8af12efe28e3d9f6087a6f4e7d0b58ee24
4 changes: 2 additions & 2 deletions docs/node-mixin/alerts/alerts.libsonnet
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -340,7 +340,7 @@
{
alert: 'NodeDiskIOSaturation',
expr: |||
rate(node_disk_io_time_weighted_seconds_total{%(nodeExporterSelector)s}[5m]) > 10
rate(node_disk_io_time_weighted_seconds_total{%(nodeExporterSelector)s, %(diskDeviceSelector)s}[5m]) > 10
||| % $._config,
'for': '30m',
labels: {
Expand All @@ -349,7 +349,7 @@
annotations: {
summary: 'Disk IO queue is high.',
description: |||
Disk IO queue (aqu-sq) is high on {{ $labels.device }} at {{ $labels.instance }}, has been above 10 for the last 15 minutes, is currently at {{ printf "%.2f" $value }}%.
Disk IO queue (aqu-sq) is high on {{ $labels.device }} at {{ $labels.instance }}, has been above 10 for the last 15 minutes, is currently at {{ printf "%.2f" $value }}.
This symptom might indicate disk saturation.,
|||,
},
Expand Down