Skip to content

feat: automated backup verification and recovery testing#444

Open
ocheeluma wants to merge 1 commit into
devEunicee:mainfrom
ocheeluma:feat/356-automated-backup-verification
Open

feat: automated backup verification and recovery testing#444
ocheeluma wants to merge 1 commit into
devEunicee:mainfrom
ocheeluma:feat/356-automated-backup-verification

Conversation

@ocheeluma

Copy link
Copy Markdown

Summary

Implements automated backup verification and restore drills, resolving #356.

Changes

  • .github/workflows/backup-verification.yml — daily workflow (04:00 UTC) that:
    • Resolves and downloads the latest backup from S3
    • Verifies backup integrity with pg_restore --list
    • Restores to an ephemeral PostgreSQL instance
    • Validates row counts for merchants and payments tables
    • Asserts RTO ≤ 5 minutes
    • Opens a GitHub issue automatically on any failure
    • Supports workflow_dispatch with an optional backup_key input
  • docs/backup-verification.md — documents RTO/RPO targets, required secrets, and manual restore procedure

Acceptance Criteria

  • Automated backup verification jobs
  • Recovery testing from backups (ephemeral restore drill)
  • RTO/RPO validation (5 min RTO, 24 h RPO)
  • Alert on backup failures (auto GitHub issue)
  • Regular restore drills (daily schedule)
  • Documentation of procedures

Closes #356

)

- Add backup-verification.yml: daily workflow that downloads latest S3
  backup, verifies integrity via pg_restore --list, restores to an
  ephemeral PostgreSQL instance, validates row counts, and asserts RTO
  ≤ 5 minutes
- Auto-opens a GitHub issue (labelled bug + reliability) on failure
- Supports workflow_dispatch with optional backup_key for ad-hoc drills
- Add docs/backup-verification.md with procedure, RTO/RPO targets,
  required secrets, and manual restore steps

Closes devEunicee#356
@drips-wave

drips-wave Bot commented Jun 27, 2026

Copy link
Copy Markdown

@ocheeluma Great news! 🎉 Based on an automated assessment of this PR, the linked Wave issue(s) no longer count against your application limits.

You can now already apply to more issues while waiting for a review of this PR. Keep up the great work! 🚀

Learn more about application limits

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

#356 - Create Automated Backup Verification

1 participant