On July 21 2021, a set of infrastructure configuration updates produced unexpected results from internal testing. This impacted our internal authentication application to become unavailable (client requests were responded with a 503 Service Unavailable error). All Spreedly APIs and services that rely on the authentication service were also impacted.
Spreedly engineers corrected the automated configuration deployment errors manually. This incident lasted for ~18 minutes from outage to implementing a fix.
Spreedly is investigating approaches to improve its infrastructure configuration testing and deployment processes.