Increased error rates from Amazon Web Services

Incident Report for Grain

Resolved

This incident has been resolved.
Posted Dec 08, 2021 - 15:38 UTC

Monitoring

It appears AWS has resolved the majority of the outage and we are seeing functionality return to normal. We will continue to monitor until AWS has marked the incident as fully resolved.
Posted Dec 07, 2021 - 23:38 UTC

Identified

The AWS outage is on-going. We are unable to launch new Grain recorders so we recommend falling back to Zoom Cloud Recordings for now. Additionally processing of recording imports and uploads is failing.
Posted Dec 07, 2021 - 17:47 UTC

Update

AWS has updated it's status page to reflect the on-going outage: https://status.aws.amazon.com
Posted Dec 07, 2021 - 17:07 UTC

Investigating

We are receiving increased error rates from hosted AWS services that are causing cascading failures within Grain. We are investigating any potential mitigations.
Posted Dec 07, 2021 - 16:29 UTC
This incident affected: Grain Desktop App, Recording Processing, Grain Recorder, and Grain Web App.