Railway - Control plane instability – Incident details

All systems operational

Control plane instability

Resolved
Major outage
Started about 5 hours agoLasted about 2 hours

Affected

Deployments (Railway Metal)

Partial outage from 11:48 AM to 12:25 PM, Major outage from 12:25 PM to 2:01 PM

US West (Metal / California, USA)

Partial outage from 11:48 AM to 12:25 PM, Major outage from 12:25 PM to 2:01 PM

US East (Metal / Virginia, USA)

Partial outage from 11:48 AM to 12:25 PM, Major outage from 12:25 PM to 2:01 PM

EU West (Metal / Amsterdam, Netherlands)

Partial outage from 11:48 AM to 12:25 PM, Major outage from 12:25 PM to 2:01 PM

Southeast Asia (Metal / SIngapore)

Partial outage from 11:48 AM to 12:25 PM, Major outage from 12:25 PM to 2:01 PM

Updates
  • Resolved
    Resolved

    This incident has been resolved. We will be publishing a post-mortem on this incident shortly.

  • Update
    Update

    We are pausing Free, Trial, and Hobby deployments while we implement a fix.

  • Monitoring
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Update
    Update

    We have identified some issues and are working to address them. Deployments have been re-enabled for Pro users.

  • Update
    Update
    We are experiencing instability with our control plane at the moment and will be pausing all deployments on the platform until we can stabilize it.
  • Identified
    Identified
    We are continuing to work on a fix for this incident.
  • Investigating
    Investigating

    We are currently investigating this incident. Non-Pro deployments are temporarily paused while we fix the underlying issue.