Platform Status

Service unavailable

Major incident Global CH-GVA-2 API Compute Managed Kubernetes SKS Network Load Balancer NLB CH-DK-2 API DE-FRA-1 API DE-MUC-1 API AT-VIE-1 API AT-VIE-2 API BG-SOF-1 API Portal
2023-11-16 16:17 CET · 3 hours, 20 minutes



The incident has been resolved.

The root cause is related to a configuration change rollout against our CH-GVA-2 hypervisor fleet which unexpectedly impacted the host private networking related configuration.

Many of our components and services rely on the availability of the private networking and therefore were impacted by this outage.

The extended recovery time is due the fact that the incident cut us off some access to key systems for which we had to make use of alternate ways to revert to a working configuration across the whole fleet.

We are sorry for the inconvenience caused by this incident.

November 16, 2023 · 19:37 CET

Services are back to nominal. We are monitoring the situation

November 16, 2023 · 18:29 CET

Compute API has been restarted. We are monitoring the situation

November 16, 2023 · 18:20 CET

We are performing a stop and start of the compute API. All current pending jobs will go into error state

November 16, 2023 · 18:00 CET

We are still working on mitigating the latency on the compute API

November 16, 2023 · 17:59 CET

We are still experiencing and working on increased latency with the compute API to process jobs

November 16, 2023 · 17:37 CET

Services have been recovered, we are monitoring the situation

November 16, 2023 · 17:32 CET

Service recovery is still ongoing

November 16, 2023 · 17:20 CET

Services are currently recovering. Private networking should now be back available

November 16, 2023 · 17:12 CET

Mitigation are currently applied. Service should be restored in a matter of minutes

November 16, 2023 · 17:09 CET

At least the following services are currently impacted:

  • Compute API globally
  • Portal
  • Compute private networking CH-GVA-2
  • NLB CH-GVA-2
November 16, 2023 · 16:51 CET

Compute private networking is also impacted by this outage

November 16, 2023 · 16:48 CET

Our Support ticketing system is also impacted by this outage therefore.

We are actively working on restoring the service ASAP

November 16, 2023 · 16:39 CET

The root caused has been identified. We are working on restoring the impacted services. No service recovery ETA is available at the moment.

November 16, 2023 · 16:32 CET

We are investigating several service being unavailable. Impacted service list has been extended

November 16, 2023 · 16:31 CET

Under investigation

November 16, 2023 · 16:17 CET

← Back