Railway - Intermittent Network Access to Domains on Railway – Incident details

All systems operational

Intermittent Network Access to Domains on Railway

Resolved
Operational
Started 3 months agoLasted 18 minutes

Affected

Edge Network (Legacy)

Degraded performance from 3:59 PM to 4:07 PM, Operational from 3:59 PM to 4:17 PM

US West (GCP / Oregon, USA)

Operational from 3:59 PM to 4:17 PM

US East (GCP / Virginia, USA)

Degraded performance from 3:59 PM to 4:07 PM, Operational from 4:07 PM to 4:17 PM

EU West (GCP / Amsterdam, Netherlands)

Operational from 3:59 PM to 4:17 PM

Southeast Asia (GCP / Singapore)

Operational from 3:59 PM to 4:17 PM

TCP Proxy (GCP)

Operational from 3:59 PM to 4:17 PM

Updates
  • Resolved
    Resolved

    The Platform team resolved the issue. We found that a single proxy was failing to serve requests affecting a small subset of traffic despite baseline metrics passing. We are implementing improvements to the health check mechanisms to enhance reliability.

  • Monitoring
    Monitoring

    We have remediated the issue with access to workloads. We found that only certain customers on US-East were affected. A small percentage of traffic was affected. We are monitoring the remediation.

  • Investigating
    Investigating

    Some requests may not be reaching services hosted on Railway, leading to degraded availability for affected applications. This issue appears to impact network connectivity, causing intermittent failures or timeouts when attempting to access deployed services.