Resolved -
This incident has been resolved.
Mar 20, 14:42 PDT
Update -
We are still working with our upstream database provider to resolve the elevated p99 latency on the Content API. We will share another update as soon as information is available.
Mar 20, 13:49 PDT
Identified -
We have determined that the elevated p99 latency on the Content API is caused by an issue with our upstream database provider. We are actively working with them to resolve the issue and will provide another update as soon as we have more information.
Mar 20, 11:49 PDT
Monitoring -
We have identified that the elevated p99 latency on the Content API was caused by latency introduced by our upstream database provider. We are actively monitoring performance and will provide another update as soon as we have more information.
Mar 20, 09:53 PDT
Identified -
We have identified a likely cause of the elevated p99 latency affecting the Content API. Customers may be experiencing slow API responses and timeouts/errors. Our team is actively investigating and working on a fix. We will provide another update as soon as we have more information.
Mar 20, 08:14 PDT
Investigating -
p99 latency is elevated across the Content API
Mar 20, 06:42 PDT
Resolved -
This incident has been resolved. The issue affecting the creation of new branches and Projects, along with Projects that have been inactive for more than 2 hours, is no longer impacting users. All Projects and branches are functioning as expected.
We apologize for any inconvenience this may have caused. If you continue to experience any issues, please reach out to our support team.
Mar 17, 13:20 PDT
Update -
We are continuing to monitor for any further issues.
Mar 17, 13:07 PDT
Monitoring -
A fix has been deployed for the issue affecting the creation of new branches and Projects, along with Projects that have been inactive for more than 2 hours. We are seeing Projects and branches functioning as expected and are actively monitoring the results.
If you are still experiencing issues, please try again in a few minutes. We will provide a final update once the incident is fully resolved.
Mar 17, 13:02 PDT
Identified -
We have identified the root cause of the issue affecting the creation of new branches and Projects, along with Projects that have been inactive for more than 2 hours.
Our engineering team is actively working on a fix. We will continue to provide updates as progress is made.
Mar 17, 12:54 PDT
Investigating -
We are currently investigating an issue affecting the initialization of new branches and Projects, as well as Projects that have not been active in the past 2 hours. Affected users may experience delays or failures when attempting to load or run these Projects.
Our engineering team is actively investigating the root cause.
Mar 17, 12:17 PDT