Spreedly API Errors
Incident
Report for Spreedly
Postmortem
September 30, 2021 — Intermittent 500 error responses from Core API Service
On September 30th, in a 20-minute period between 15:24 and 15:44 UTC, a rolling restart caused 6,299 5XX errors served to 25 customers. The rolling restart was self-healing and did not require developer intervention.
What Happened
In an effort to problem-solve an unrelated concern, a service in the Spreedly Production Environment was restarted. The rolling restart cause intermittent 5XX errors to be returned as the Core API Service attempted to authenticate transactions against the restarting servers.
Next Steps
Spreedly will investigate and implement strategies for better application resiliency during temporary service outages.
Resolved
A restart of the Spreedly Id service resulted in intermittent 500 errors on Spreedly's Core API.
This impacted a small percentage of transactions and requests to Spreedly's API.
After deploying a fix, all systems appear to be stabilized and functioning. The incident is being considered resolved.
We apologize for any inconvenience and disruption to service.
This impacted a small percentage of transactions and requests to Spreedly's API.
After deploying a fix, all systems appear to be stabilized and functioning. The incident is being considered resolved.
We apologize for any inconvenience and disruption to service.
This incident affected: Core Transactional API.