Railway - Elevated latency on Europe West & US East edge proxies – Incident details

Registry - Dockerhub experiencing partial outage

Elevated latency on Europe West & US East edge proxies

Resolved
Degraded performance
Started 2 months agoLasted 22 minutes

Affected

Edge Network (Legacy)

Degraded performance from 9:11 PM to 9:21 PM, Operational from 9:11 PM to 9:33 PM

US West (GCP / Oregon, USA)

Operational from 9:11 PM to 9:33 PM

US East (GCP / Virginia, USA)

Degraded performance from 9:11 PM to 9:21 PM, Operational from 9:21 PM to 9:33 PM

EU West (GCP / Amsterdam, Netherlands)

Degraded performance from 9:11 PM to 9:21 PM, Operational from 9:21 PM to 9:33 PM

Southeast Asia (GCP / Singapore)

Operational from 9:11 PM to 9:33 PM

TCP Proxy (GCP)

Operational from 9:11 PM to 9:33 PM

Updates
  • Resolved
    Resolved

    This incident has been resolved. We successfully mitigated a DDoS attack between 21:02 UTC ~ 21:09 UTC, largely impacting US East. A small subset of users connecting to Railway-hosted workloads from Europe or US East may have experienced dropped requests or increased latency during this period.

  • Monitoring
    Monitoring

    The DDoS attack has been mitigated. We are seeing full recovery across Europe West & US East, and are continuing to monitor the situation.

  • Investigating
    Investigating

    We are currently investigating a potential DDoS attack on our edge network. Latency may be increased for users connecting to Railway-hosted workloads from Europe and US East.