add reconnection logic to event watcher thread

[tulioz]

the event watcher thread crashes silently when the redis connection drops, causing the healthz check to fail and k8s to restart the pod every ~20 minutes

[aviator-app]

Current Aviator status

Aviator will automatically update this comment as the status of the PR changes.
Comment /aviator refresh to force Aviator to re-examine your PR (or learn about other /aviator commands).

This PR was merged using Aviator.

Stack

1. 👉 #20 add reconnection logic to event watcher thread 👈 (this pr)

---

See the real-time status of this PR on the Aviator webapp.

Use the Aviator Chrome Extension to see the status of your PR within GitHub.

[tulioz]

/gemini review

[gemini-code-assist]

Code Review

This pull request implements a reconnection loop with exponential backoff for the Celery event watcher and updates numerous project dependencies in the lock file. Review feedback suggests refining the backoff reset logic to prevent potential log spam during rapid connection failures and ensuring the RepeatTimer is daemonized to match the watcher thread for consistent process termination.

[tulioz]

/gemini review

[gemini-code-assist]

Code Review

This pull request enhances the EventWatcher by implementing a reconnection loop with exponential backoff for the event receiver and configuring the watcher and timer threads as daemon threads. A review comment suggests further improving the system's resilience by adding error handling to the periodic event enablement timer to prevent the thread from crashing permanently during connection failures.