Railway - Notice history

All systems operational

Dashboard (railway.com) - Operational

100% - uptime
Feb 2025 · 100.0%Mar · 100.0%Apr · 99.86%

Previous page

Next page

Feb 2025
Mar 2025
Apr 2025
100% - uptime

DNS - Operational

100% - uptime
Feb 2025 · 100.0%Mar · 100.0%Apr · 99.93%

Previous page

Next page

Feb 2025
Mar 2025
Apr 2025

Traffic - Operational

100% - uptime
Feb 2025 · 100.0%Mar · 100.0%Apr · 99.93%

Previous page

Next page

Feb 2025
Mar 2025
Apr 2025

Central Station (station.railway.com) - Operational

100% - uptime
Feb 2025 · 100.0%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 2025
Mar 2025
Apr 2025

Notice history

Apr 2025

Elevated latency US East edge proxies
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    We are seeing full recovery, and we are continuing to monitor.

  • Investigating
    Investigating
    We are currently investigating this incident.
Dashboard is experiencing degraded performance. You may notice occassional latency spikes or 503s
  • Resolved
    Resolved

    This incident has been resolved. A full incident report is available at https://blog.railway.com/p/incident-report-april-30-2025.

  • Update
    Update

    We have implemented a fix and are monitoring the results.

  • Monitoring
    Monitoring

    We have implemented a fix and are monitoring the results.

  • Identified
    Identified

    We are continuing to work on a fix for this Issue.

  • Investigating
    Investigating

    The dashboard is experiencing degraded performance. You may notice occasional latency spikes or 503s.

  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    We have implemented a fix and are monitoring the results.

  • Update
    Update

    We are continuing to work on a fix for this Issue.

  • Update
    Update

    The Dashboard is currently inaccessible. We are continuing to work on a fix for the issue.

  • Update
    Update

    We are continuing to work on a fix for the issue.

  • Update
    Update

    We are continuing to work on a fix for the issue.

  • Update
    Update

    We are continuing to work on a fix for the issue.

  • Update
    Update
    Dashboard may be inaccessible for some users
  • Identified
    Identified

    We have identified the issue and are working on a fix

  • Investigating
    Investigating
    Dashboard is experiencing degraded performance. You may notice occassional latency spikes or 503s
US-East delayed placements
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    We have fixed a bug preventing new deployments from landing on the newly provisioned hosts.

  • Investigating
    Investigating

    We are continuing to investigate a subset of deploys that are delayed in the creating container step.

  • Monitoring
    Monitoring

    We have finished adding capacity and are monitoring the process of deployments that were stuck in the queue.

  • Identified
    Identified

    We are scaling up capacity in US-East

A single host on Railway GCP US-West has rebooted
  • Resolved
    Resolved

    All applications are operational. A host was rebooted at 17:48 UTC. Most applications recovered by 18:06 UTC and ALL applications recovered by 18:13 UTC.

  • Monitoring
    Monitoring

    Most applications are operational. We're monitoring for ALL applications to become operational before resolving.

  • Identified
    Identified

    Affected deploys are coming back online. Impacted users may see their services re-deployed by Railway.

  • Investigating
    Investigating

    We are failing over deploys from the host to a different host. Impacted users may see their services re-deployed by Railway.

A single host on Railway GCP US-West has rebooted
  • Resolved
    Resolved

    All applications are operational. A host was rebooted at 13:53 UTC. Most applications recovered by 14:03 UTC and ALL applications recovered by 14:10 UTC.

  • Identified
    Identified

    Affected deploys are coming back online. Impacted users may see their services re-deployed by Railway.

  • Investigating
    Investigating

    We are failing over deploys from the host to a different host. Impacted users may see their services re-deployed by Railway.

Mar 2025

Some TCP proxy endpoints may be experiencing connectivity issues
  • Resolved
    Resolved

    This incident has been resolved and we're seeing full recovery and have successfully rolled out the revert.

  • Identified
    Identified

    We're reverting a change that has interrupted TCP proxy connectivity to a small subset of workloads still on Runtime V1. Workloads on Runtime V2 are unaffected.

  • Investigating
    Investigating
    Some TCP proxy endpoints may be experiencing connectivity issues
Potential upstream issue causing delayed login via Magic emails. Login via GitHub may be used as a workaround.
  • Resolved
    Resolved
    Login via Magic emails are being delivered timely
  • Investigating
    Investigating
    Potential upstream issue causing delayed login via Magic emails. Login via GitHub may be used as a workaround.
A singular google cloud host is failing over
  • Resolved
    Resolved
    Failover completed
  • Investigating
    Investigating
    A singular google cloud host is failing over
A single host in US West was rebooted due to a kernel failure
  • Resolved
    Resolved
    All workloads have now recovered
  • Monitoring
    Monitoring
    We are monitoring as workloads come back online
  • Investigating
    Investigating
    A single host in US West was rebooted due to a kernel failure
Potential upstream GitHub issue with "Failed to clone" for small subset of builds. We're looking into it
  • Resolved
    Resolved
    We've deployed a permanent fix and consider the issue resolved.
  • Monitoring
    Monitoring
    We have rolled out a temporary fix and are working on a permanent one.
  • Update
    Update
    We continue to investigate the incident. It occurs on a very small % of builds and retries resolve
  • Investigating
    Investigating
    Potential upstream GitHub issue with "Failed to clone" for small subset of builds. We're looking into it

Feb 2025

GitHub Single Sign-On Temporarily Unavailable
  • Resolved
    Resolved

    GitHub Single Sign-On is working as intended again.

  • Monitoring
    Monitoring

    We have merged a fix and are monitoring the result.

  • Identified
    Identified

    We have identified the issue and are working on getting a fix out.

    Loging in via GitHub may not work at this time.

  • Investigating
    Investigating

    We are currently investigating this incident.

    Loging in via GitHub may not work at this time.

All regions may be experiencing increased deploy times
  • Resolved
    Resolved

    We have resolved the incident and all deployments are going out on time.

  • Monitoring
    Monitoring

    We implemented a fix and are currently monitoring the result.

    New Trial and Hobby user deployments have been re-enabled.

  • Update
    Update

    We are continuing to work on a fix for this incident.

    We have paused deployments for customers on Trial and Hobby. We have a lot of new customers joining us and to protect the experience for Pro, we are pausing signups until we provision more resources.

  • Update
    Update
    We are continuing to work on a fix for this incident.
  • Identified
    Identified
    We are continuing to work on a fix for this incident.
  • Monitoring
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Investigating
    Investigating

    We are currently investigating this incident.

We are seeing some deploys failing to go through in US-West Oregon
  • Resolved
    Resolved

    This specific incident for the US-West region has been resolved.

  • Update
    Update
    We are continuing to work on a fix for this incident.
  • Identified
    Identified

    We have identified the cause and we are working on a resolution.

  • Investigating
    Investigating

    We are currently investigating this incident.

    The US-West metal region is recommended for stateless workloads that do not communicate with stateful workloads.

A single host in US West has restarted
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Investigating
    Investigating
    We are currently investigating this incident.
A single Google Cloud host in US West was rebooted
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Investigating
    Investigating
    We are currently investigating this incident.

Feb 2025 to Apr 2025

Next