The incident is resolved.

Unfortunately this incident led to data loss. All objects created or modified between 2024-02-13T23:58 UTC to 2024-02-14T16:11 UTC are lost and we have no way to recover them. Also all objects that were deleted during this time window are back to life.

We will communicate towards all impacted customers with additional details once a full assessment of the incident and situation has been performed.

The service is back available to all customers. We continue to monitor the situation and performing additional sanity checks.

Unfortunately this incident led to data loss. All objects created or modified between 2024-02-13T23:58 UTC to 2024-02-14T16:11 UTC are lost and we have no way to recover them. Also all objects that were deleted during this window are back to life.

We are expecting to bring back the service available within minutes

All components have been started. We are performing sanity checks. Service remain closed during that time.

Metadata restore has been completed. We are starting back the service components. Service remain unavailable.

The restore is still in progress, ETA 2 hours

Restore is ongoing. We’ll make a next update around 6AM CET. We don’t expect the service to be recovered before that time

Current ETA for service restore is around 10 hours. We are working to improve the recovery timing

The restore is still in progress. We expect it takes several hours. We will post a more detailed estimation once available

The metadata restore process has started. No ETA available at this moment

New instance deployment on compute should be back available. Snapshots and custom template creation remain unavailable until the SOS service is fully restored.

We continue working towards SOS service restoration. ETA currently unknown

Compute is impacted as well - Creation of new instances might not work.

Our Metadata storage has been lost. We are working on restoring the system and its data. ETA unknown

SOS service is currently unavailable. We are working on restoring the service. An update will be provided once more information is available