Skip to content

ROX-34459: add alert for container restart over 48h period - #349

Merged
johannes94 merged 1 commit into
masterfrom
jmalsam/alert-on-restart-rate
Aug 31, 2026
Merged

johannes94 merged 1 commit into
masterfrom
jmalsam/alert-on-restart-rate

Conversation

@johannes94

Copy link
Copy Markdown
Contributor

Adds an alert that warns for a restart rate of >3 per day and pages for a restart rate of >5 per day over 48h period.

This was done to catch containers restarting multiple times a day, but spread far enough so that it wouldn't trigger the frequently restarting alerts.

Some examples of issues we didn't catch because we're missing a extended window:

  • scanner-v4-db of a tenant was crashing due to OOM for 30 times in 7d without an alert
  • scanner-v4-matcher were crashing every 2h after the 4.11.2 migration without an alert
  • scanner-v4-db of another tenant crashing 3 times a day

@johannes94
johannes94 requested a review from a team as a code owner August 27, 2026 11:56
@johannes94
johannes94 requested review from GrimmiMeloni and removed request for a team August 27, 2026 11:56
@coderabbitai

coderabbitai Bot commented Aug 27, 2026

Copy link
Copy Markdown

Important

  • 🔍 Trigger review

This repository does not receive automatic reviews because it has fewer than 10 stars.

⚙️ Run configuration

Configuration used: Central YAML (base), Organization UI (inherited)

Review profile: CHILL

Plan: Pro Plus

Run ID: 221676c7-0029-4de9-897b-61cfe6ac0b55


Comment @coderabbitai help to get the list of available commands.

@johannes94
johannes94 merged commit 7ecc3a3 into master Aug 31, 2026
2 checks passed
@johannes94
johannes94 deleted the jmalsam/alert-on-restart-rate branch August 31, 2026 08:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants