Skip to content

Mixin: Add and update alerts #2644

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
SuperQ merged 19 commits into from
Jul 4, 2023
Merged

Mixin: Add and update alerts #2644

Changes from 1 commit
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
fc967aa
Add mountpoint to NodeFilesystem alerts
v-zhuravlev Mar 27, 2023
0e0399d
Decrease NodeFilesystem pending time to 15m
v-zhuravlev Mar 27, 2023
fd2d62a
Add CPU and memory alerts
v-zhuravlev Mar 27, 2023
7479418
Add failed systemd service alert
v-zhuravlev Mar 27, 2023
3d8075d
Decrease NodeNetwork*Errs pending period
v-zhuravlev Mar 27, 2023
614030b
Set 'at' everywhere as preposition for instance
v-zhuravlev Mar 27, 2023
94fc82e
Add NodeDiskIOSaturation alert
v-zhuravlev Mar 27, 2023
962de6c
Add %(nodeExporterSelector)s to Network and conntrack alerts
v-zhuravlev Mar 27, 2023
c3ec6e8
Add diskDevice selector
v-zhuravlev Mar 27, 2023
e15e7d6
Fix NodeMemoryHighUtilization alert
v-zhuravlev Mar 27, 2023
580c497
Add NodeSystemSaturation and NodeMemoryMajorPagesFaults
v-zhuravlev Mar 27, 2023
da32f8d
Decrease NodeSystemdServiceFailed severity to warning
v-zhuravlev Mar 29, 2023
e48e790
Extend alert description
v-zhuravlev Apr 5, 2023
2111e70
Add comma after 'mounted on'
v-zhuravlev Apr 5, 2023
77ae769
Add thresholds for memory alerts
v-zhuravlev Apr 5, 2023
6bdc1d9
Add thresholds for memory, disk and system alerts
v-zhuravlev Apr 5, 2023
b7dfb32
Set severity to NodeCPUHighUsage to info
v-zhuravlev Apr 5, 2023
3e250a9
Update NodeSystemSaturation severity
v-zhuravlev Apr 26, 2023
e8d7f4e
Revert alerts pending durtions
v-zhuravlev Jun 29, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Set 'at' everywhere as preposition for instance 
Signed-off-by: Vitaly Zhuravlev <[email protected]>
  • Loading branch information
@v-zhuravlev
v-zhuravlev committed Jun 29, 2023
commit 614030bb8027e9cbe7e39aec4bf7e1db3290b1fe
14 changes: 7 additions & 7 deletions docs/node-mixin/alerts/alerts.libsonnet
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -231,7 +231,7 @@
},
annotations: {
summary: 'Clock skew detected.',
description: 'Clock on {{ $labels.instance }} is out of sync by more than 0.05s. Ensure NTP is configured correctly on this host.',
description: 'Clock at {{ $labels.instance }} is out of sync by more than 0.05s. Ensure NTP is configured correctly on this host.',
},
},
{
Expand All @@ -247,7 +247,7 @@
},
annotations: {
summary: 'Clock not synchronising.',
description: 'Clock on {{ $labels.instance }} is not synchronising. Ensure NTP is configured on this host.',
description: 'Clock at {{ $labels.instance }} is not synchronising. Ensure NTP is configured on this host.',
},
},
{
Expand All @@ -261,7 +261,7 @@
},
annotations: {
summary: 'RAID Array is degraded',
description: "RAID array '{{ $labels.device }}' on {{ $labels.instance }} is in degraded state due to one or more disks failures. Number of spare drives is insufficient to fix issue automatically.",
description: "RAID array '{{ $labels.device }}' at {{ $labels.instance }} is in degraded state due to one or more disks failures. Number of spare drives is insufficient to fix issue automatically.",
},
},
{
Expand All @@ -274,7 +274,7 @@
},
annotations: {
summary: 'Failed device in RAID array',
description: "At least one device in RAID array on {{ $labels.instance }} failed. Array '{{ $labels.device }}' needs attention and possibly a disk swap.",
description: "At least one device in RAID array at {{ $labels.instance }} failed. Array '{{ $labels.device }}' needs attention and possibly a disk swap.",
},
},
{
Expand Down Expand Up @@ -320,7 +320,7 @@
},
annotations: {
summary: 'High CPU usage.',
description: 'CPU usage on {{ $labels.instance }} has been above 80% for the last 15 minutes, is currently at {{ printf "%.2f" $value }}%.',
description: 'CPU usage at {{ $labels.instance }} has been above 80% for the last 15 minutes, is currently at {{ printf "%.2f" $value }}%.',
},
},
{
Expand All @@ -334,7 +334,7 @@
},
annotations: {
summary: 'Host is running out of memory',
description: 'Memory is filling up on {{ $labels.instance }}, has been above 90% for the last 15 minutes, is currently at {{ printf "%.2f" $value }}%.',
description: 'Memory is filling up at {{ $labels.instance }}, has been above 90% for the last 15 minutes, is currently at {{ printf "%.2f" $value }}%.',
},
},
{
Expand All @@ -348,7 +348,7 @@
},
annotations: {
summary: 'Systemd service has entered failed state.',
description: 'Systemd service {{ $labels.name }} has entered failed state on {{ $labels.instance }}',
description: 'Systemd service {{ $labels.name }} has entered failed state at {{ $labels.instance }}',
},
},
],
Expand Down