Performance degradation for Forge app invocations

Incident Report for Compass

Resolved

At around 4am UTC, about 40 percent of Forge app invocations experienced high latency, with a portion of the requests failing, during a 15 minute time window.

The scaling of the instances was misconfigured following a new deployment of the service, which needed manual intervention which took a few minutes to resolve the issue.

Timeline:
- 2024-01-31 04:00 UTC: impact started
- 2024-01-31 04:03 UTC: incident detected
- 2024-01-31 04:15 UTC: the incident was resolved and the impact ended

This issue is now resolved and Forge is fully operational. We apologize for any inconveniences this may have caused to our customers, partners, and our developer community.

Posted Jan 31, 2024 - 06:03 UTC