All bot recordings that were left unprocessed due to the outage have been recovered.
Posted Oct 21, 2026 - 23:03 UTC
Update
The team is manually reprocessing all dangling completed recordings as they become available. All new recordings are processing correctly.
Posted Oct 20, 2026 - 18:33 UTC
Monitoring
The team has deployed a rollback and webhooks are correctly process. The team is determining if any recording process needs manual intervention.
Posted Oct 20, 2026 - 18:05 UTC
Investigating
The team is actively rolling back a failed update for its webhook consumers. Webhooks are currently failing to process leading to UI to fail to update for bots and recording processing. No data loss has occurred.
Posted Oct 20, 2026 - 17:38 UTC
This incident affected: Recording Processing and Grain Recorder.