Thank you for your patience whilst we resolved these issues.

We have just released a new CLI, v5.10.0 to address urgent security issues due to this incident and we strongly recommend updating immediately.

All systems are green and we're back to capacity.

An incident report will be released later today.

Jobs are running smoothly with minor issues on the API and console. We expect to be all normal over the next hour or so.

We're also preparing a post-mortem to be published later today.

The Console and API are recovering and should be back to normal shortly. Tests are beginning to flow again.

cpu1 is recovering and we're starting to see throughput again. We'll update as soon as we have more.

As part of the incident, our hosting provider (Railway) has advised us to rotate our env keys. As a result, systems may take longer to recover as we work through our stack.

Services are beginning to recover.

This incident is now causing downtime.

One of our upstream providers (railway.com) has declared an incident. We're investigating.