Historical record of incidents for UpCloud
Report: "[US-CHI1]: Managed Kubernetes Deployment"
Last updateWe are currently investigating an issue affecting the Managed Kubernetes service in our US-CHI1 data center. During this time, users may experience new Managed Kubernetes service deployment failing. We are actively working on identifying the root cause of the issue and will post further updates as more information becomes available. Our sincere apologies for any inconvenience caused.
Report: "[UK-LON1] Networking Maintenance"
Last updateScheduled maintenance is currently in progress. We will provide updates as necessary.
We will be undergoing scheduled maintenance during this time.
We will be performing network maintenance to improve our data center network in UK-LON1. The maintenance window will commence on June 3, 2025, at 9:00 PM UTC and will be completed by June 4, 2025, at 5:00 AM UTC.For the duration of the main maintenance period, customers might experience brief interruptions to network connections and service management in the London data center. There could be one or more short breaks to public and private networks (SDN private networks and Utility network) in both public cloud and private cloud environments. While no larger disruptions are anticipated, network connectivity issues may occur due to the nature of the maintenance work.If you have any questions or concerns regarding this maintenance, please reach out to us via 24/7 live chat on the Control Panel or by email (support@upcloud.com).We will update this status as the maintenance proceeds.
Report: "Managed Load Balancer"
Last updateThis incident has been resolved. If you have any questions about this, we have our 24/7 support team available via live chat in the control panel or via email at support@upcloud.com.
The deployed fix has successfully resolved the issues affecting our Managed Load Balancer service. We will continue to closely monitor the service to ensure continued stability.
We've deployed a fix we believe has resolved the issues with our Managed Load Balancer service. We will continue to monitor the situation closely.
We are continuing to work on a fix for this issue. You may experience intermittent issues fetching load balancer details and timeouts accessing the Managed Load Balancer page from the Dashboard. Deployed Managed Load Balancers may have intermittent timeouts as we work on the underlying problem.
We have identified an issue with our Managed Load Balancer service across all data centres. Our team is actively investigating the root cause and working on a resolution.
Report: "Managed Load Balancer"
Last updateWe have identified an issue with our Managed Load Balancer service across all data centres. Our team is actively investigating the root cause and working on a resolution.
Report: "[US-1] Object Storage Maintenance"
Last updateWe will be performing an Object Storage maintenance in our US-1 region on 15th May, 2025 between 09:00 - 15:00 UTC.During this maintenance, short blips to Object Storage data traffic are to be expected. Object Storage service management actions (such as creations and modifications) might face some latency, but will eventually be processed.The maintenance window will only affect instances under the US-1 region.If you have any questions or concerns regarding this maintenance, please reach out to us via Live Chat on the Control Panel or email (support@upcloud.com).""
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Report: "[Europe-2] Object Storage Maintenance"
Last updateWe will be performing an Object Storage maintenance in our Europe-2 region on 14th May, 2025 between 09:00 - 15:00 UTC.During this maintenance, short blips to Object Storage data traffic are to be expected. Object Storage service management actions (such as creations and modifications) might face some latency, but will eventually be processed.The maintenance window will only affect instances under the Europe-2 region.If you have any questions or concerns regarding this maintenance, please reach out to us via Live Chat on the Control Panel or email (support@upcloud.com).
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Report: "[APAC-1] Object Storage Maintenance"
Last updateWe will be performing an Object Storage maintenance in our APAC-1 region on 13th May, 2025 between 09:00 - 15:00 UTC.During this maintenance, short blips to Object Storage data traffic are to be expected. Object Storage service management actions (such as creations and modifications) might face some latency, but will eventually be processed.The maintenance window will only affect instances under the APAC-1 region.If you have any questions or concerns regarding this maintenance, please reach out to us via Live Chat on the Control Panel or email (support@upcloud.com).
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Report: "[Europe-1] Emergency Object Storage Maintenance"
Last updateWe will be performing an emergency Object Storage maintenance in our Europe-1 region on 2nd May, 2025 between 09:00 UTC to 15:00 UTC.During this emergency maintenance short blips to Object Storage data traffic are to be expected. Object Storage service management actions (such as creations and modifications) might face some latency, but will eventually be processed.The maintenance window will only affect instances under the Europe-1 region.If you have any questions or concerns regarding this maintenance, please reach out to us via Live Chat on the Control Panel or email (support@upcloud.com).
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Report: "[SG-SIN1] Emergency Storage Network Maintenance"
Last updateWe will be performing an emergency storage network maintenance in SG-SIN1 on 15th April, 2025 between 0800 UTC to 1200 UTC.The emergency maintenance will involve replacing a faulty cable detected in our network topology. Our redundant storage system component is still in place and we aim to complete the emergency maintenance with minimal impact.If you have any questions or concerns regarding this maintenance, please reach out to us via Live Chat on the Control Panel or email (support@upcloud.com).
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Report: "[NL-AMS1] Storage Maintenance"
Last updateScheduled maintenance is currently in progress. We will provide updates as necessary.
We will be performing a storage network maintenance to update the topology between the nodes and storage backends in NL-AMS1. The maintenance will take place on the 8th of April 2025 between 20:00 UTC and 06:00 UTC.During the maintenance our infrastructure redundancy is lowered, but customer impact is expected to be minimal. For the duration of the main maintenance period, customers might experience longer launch times for new cloud servers and other services.If you have any questions or concerns regarding this maintenance, please reach out to us via live chat on the Control Panel or email (support@upcloud.com).
Report: "Issue with our public website"
Last updateThis incident has been resolved.
We have implemented a fix and are monitoring the website. If you have any questions or concerns, please reach out to our Support team via email (support@upcloud.com) or live chat.
We are currently experiencing issues with our public website. We are investigating the issue further and will report back as soon as possible. The UpCloud dashboard and all resources are unaffected. If you have any questions or concerns, please reach out to our Support team via email (support@upcloud.com) or live chat.
Report: "Issue with our public website"
Last updateThis incident has been resolved.
We have implemented a fix and are monitoring the website.If you have any questions or concerns, please reach out to our Support team via email (support@upcloud.com) or live chat.
We are currently experiencing issues with our public website. We are investigating the issue further and will report back as soon as possible. The UpCloud dashboard and all resources are unaffected. If you have any questions or concerns, please reach out to our Support team via email (support@upcloud.com) or live chat.
Report: "Issue with the UpCloud Control Panel"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
We are currently experiencing issues with login access to the UpCloud Control Panel. We are investigating the issue further and will report back as soon as possible. Please note that no customer resources are affected by this issue.
Report: "Issue with the UpCloud Control Panel"
Last updateWe are currently experiencing issues with login access to the UpCloud Control Panel. We are investigating the issue further and will report back as soon as possible. Please note that no customer resources are affected by this issue.
Report: "[UK-LON1]: Storage backend issue"
Last updateOur team has resolved the issue and all affected services are now working as expected. If you continue to experience any further issues, please contact our Support team via Live Chat or email support@upcloud.com Pleae accept our sincere apologise again for any inconvenience caused.
Our team has implemented a fix to resolve the storage backend issue in our UK-LON1 data centre and all affected services should be operational again. We thank you for your continued patience throughout this recovery process and sincerely apologize for any inconvenience caused. If you continue to experience any further issues, please contact our Support team via Live Chat or email support@upcloud.com
We are continuing to work on a fix for this storage backend issue. More affected services have been restored. Some Object Storage EOL services experienced temporary disruptions during this restoration process.
We are continuing to work on a fix for this storage backend issue. Most remaining affected services have been restored.
We are continuing to work on a fix for this storage backend issue. A majority of affected services have been brought back online, though some instances in UK-LON1 remain impacted and will need to be restarted.
We have identified some compute nodes that may be affected by this storage backend issue.
We have identified an issue with one of our storage backend nodes in our UK-LON1 data centre. Some servers with Standard tier storage are affected. We are working to restore the service and resolve the situation as soon as possible. We recommend avoiding stopping or starting these server(s) at this time. If you have any questions or concerns regarding this maintenance, please reach out to us via live chat on the Control Panel or email (support@upcloud.com).
Report: "Managed Load Balancer Issue"
Last updateThank you for your continued patience throughout this process and our sincere apologies for any inconvenience caused. The incident is now resolved, and all affected services should be operational. Please contact our Support team via live chat or email support@upcloud.com if you require further assistance
Thank you for your continued patience throughout this process and our sincere apologies for any inconvenience caused. The incident is now resolved, and all affected services should be operational. Please contact our Support team via live chat or email support@upcloud.com if you require further assistance
We have successfully resolved the issues affecting the Managed Load Balancer service across all data centers and are monitoring the situation to ensure they do not reoccur. We apologize for any inconvenience this incident may have caused and thank you for your patience during the resolution. If you experience any further issues, please contact our support team via Live Chat or email support@upcloud.com
We are experiencing issues with Managed Load Balancer service across all data centres. Our team is actively investigating the root cause and working on a resolution. Impact Details: - New load balancer deployments are affected. - Existing load balancers continue to function normally. - Some existing load balancer services may be missing from the dashboard. - All load balancer management operations via the API and dashboard are currently unavailable. We apologize for the inconvenience caused and appreciate your patience as we work to resolve the issue. If you have any questions please contact our support via our Live Chat or email support@upcloud.com
We have successfully resolved the issues affecting managed load balancers across all data centres. All services have been restored and are functioning normally. Our team will continue to monitor the system closely to ensure stability. We apologize for any inconvenience this incident may have caused and thank you for your patience during the resolution. If you experience any issues, please contact our support team via email (support@upcloud.com) or live chat.
We are experiencing issues with managed load balancer operations across all data centres. Our teams are actively investigating the root cause and working on a resolution. Impact Details - New load balancer deployments are affected. - Existing load balancers continue to function normally. - Some existing load balancers may be missing from the dashboard. - All load balancer management operations via the API and dashboard are currently unavailable. We apologize for the inconvenience caused and appreciate your patience as we work to resolve the issue. If you have any questions please contact our support via email (support@upcloud.com) or via our live chat.
Report: "[FI-HEL1]: Compute node issue"
Last updateThis incident has been resolved. If you have any questions about this, we have our 24/7 support team available via live chat in the control panel or via email support@upcloud.com.
We are continuing to monitor for any further issues.
All affected cloud servers are now back online. We will continue to monitor the situation closely. If you continue to experience problems, please contact our 24/7 support team for assistance via live chat or support@upcloud.com.
We're nearing the end of restoring the remaining affected cloud servers. We expect all services to be fully restored within the next hour. We apologise for the continued disruption and will provide another update within the hour, or sooner if available. If you have any questions about this, we have our 24/7 support team available via live chat in the control panel or via email support@upcloud.com.
We're making progress in restoring the remaining affected cloud servers. We expect all cloud servers to be back online within the next hour. We apologise for the ongoing disruption and will provide another update in one hour or sooner. If you have any questions about this, we have our 24/7 support team available via live chat in the control panel or via email support@upcloud.com.
We have brought the majority of affected cloud servers back online. Unfortunately, we encountered some unforeseen challenge with the remaining cloud servers, but we are working to bring them online as quickly as possible. We apologise for the continued disruption. The next update will be in one hour. If you have any questions for this, we have our 24 / 7 support team available via live chat in the control panel or via email support@upcloud.com.
We are making progress bringing the affected cloud servers back online. The issue is contained, and we expect most cloud servers to be available within one to two hours. We apologize for any inconvenience caused. The next update will be in 60 minutes or earlier. If you have any questions for this, we have our 24/7 support team available via live chat in the control panel or via email support@upcloud.com.
We have identified the root cause of the issue affecting some compute hosts in our FI-HEL1 data center. Our team is actively working to bring the impacted cloud servers back online. We anticipate that most servers will be available within the next two hours, though we are aiming for a faster recovery. We will share another update at 14:00 UTC.
We have identified an issue with one of the compute nodes in our Helsinki 1 data centre. The problem may cause affected cloud servers to become slow or unresponsive. We are working to bring all affected servers back online and resolve the situation as soon as possible. We will give another update in 30 minutes.
We are investigating a compute node issue that is affecting some cloud servers in our Helsinki 1 data centre.
Report: "Emergency maintenance - US-SJO1 Storage issue"
Last updateThis incident has been resolved.
We have restored storage access on all affected cloud servers to normal operating status and continue to monitor the situation. If your server is still not fully functional, please contact our support at support@upcloud.com. We apologise for the incident.
The issue has been identified and a fix is being implemented.
We have identified the cause and are working on it. We will provide further updates soon. If you have any questions don't hesitate to contact our support via email (support@upcloud.com or via live chat
We are continuing to investigate this issue.
We are investigating an issue with our Storage equipment in our US-SJO1 data centre.
Report: "Issue with our Support Live Chat"
Last updateThis issue with our Support live chat is now resolved.
We have implemented a fix to resolve the issue with our Support Live Chat. You should now be able to reach our Support via Live Chat, web form or email (support@upcloud.com) We are monitoring the situation closely and will post an update as soon as we confirm the issue is fully resolved.
We have identified and are currently investigating an issue with our Support Live Chat. Unfortunately, we are unable to receive any Support tickets submitted via Live Chat, web form or email (support@upcloud.com) during this time. We apologize for the inconvenience and will share an update as soon as we have more information.
Report: "[DE-FRA1] Managed Object Storage Issue"
Last updateWe have resolved a connectivity issue with our Managed Object Storage, in which uploading files to buckets and accessing buckets returns an intermittent 503 Error for the Europe-2 region. If you are still encountering issues, or have any questions or concerns, please feel free to contact our 24/7 live Support team in our control panel or by emailing support@upcloud.com.
We have identified the cause of a connectivity issue with our Managed Object Storage, in which uploading files to buckets and accessing buckets returns an intermittent 503 Error for the Europe-2 region. A fix has been implemented, and we are closely monitoring the issue. If you have any questions or concerns, please feel free to contact our 24/7 live Support team in our control panel or by emailing support@upcloud.com.
We are investigating a connectivity issue with our Managed Object Storage, in which uploading files to buckets and accessing buckets returns an intermittent 503 Error for the Europe-2 region. We are actively working to resolve this issue as swiftly as possible. We regret any inconvenience this might be causing and thank you for your patience as we work to address this. If you have any questions or concerns, please feel free to contact our 24/7 live Support team in our control panel or by emailing support@upcloud.com.
Report: "Managed Object Storage - Issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are investigating an issue with our Managed Object Storage service that prevents the deployment of new instances in the EUROPE-1 and APAC-1 zones. Existing Managed Object Storage instances are not affected.
Report: "[NL-AMS1]: Storage backends issue"
Last updateThis incident has been resolved
We thank you for your continued patience throughout this process and apologise for any impact. The incident is now resolved, and all affected services should be operational. For any further issues please contact our Support team via live chat or email at support@upcloud.com We are compiling a detailed post-mortem to outline the sequence of events, the steps taken to rectify the situation, and the measures we are implementing to prevent such occurrences in the future. We understand the gravity of this disruption and extend our sincerest apologies to all affected customers.
Update: Our restoration efforts are in the last stretches and majority of the affected services in the NL-AMS1 data centre are now fully operational. A small number of individual customers services remain in an error state, and our engineering and support teams are diligently working to bring these services back online. We expect full recovery very soon and appreciate your continued patience during this process. We are committed to maintaining transparent communication and will provide the next comprehensive update at 16:00 UTC or as soon as the all customer services are fully operational - whichever is sooner.
Update: We’re making strong progress in bringing the affected services back online in the NL-AMS1 datacentre, and our efforts are focused on restoring the remaining services as quickly as possible. We recognise the critical nature of these services and are doing everything necessary to restore full functionality as soon as possible. We’ll provide the next update by 15:00 UTC or as soon as all services are fully restored, whichever comes first. Thank you for your continued patience.
Update: We are making good progress with restoring the remaining affected services in NL-AMS1 data centre. Our team is fully engaged in the recovery process, and we want to assure you that we are taking this situation very seriously. We are also committed to maintaining transparent communication and will provide the next update by 14:00 UTC or as soon as the services are fully available - whichever is sooner.
Update: Our team has identified the root cause of the issue at the NL-AMS1 datacentre and has made significant progress in the recovery process. Many affected services are now back online, but there is still work to be done to bring the rest back to full operational status. We’re continuing our efforts to restore the remaining impacted services and expect further recovery in the coming hours. We understand the gravity of the situation and are taking every measure to restore full service swiftly. The next update will be provided at 13:05 UTC. If you have any immediate concerns, our 24/7 live support team is available through the control panel.
We are currently investigating a storage backend issue affecting the NL-AMS1 datacentre. This may impact Cloud Servers, Managed Kubernetes, Managed Databases and Object Storage. We recommend avoiding stopping/starting your server(s) at this time. We are actively working to resolve this issue as swiftly as possible. We regret any inconvenience this might be causing and thank you for your patience as we work to address this. If you have any questions or concerns, please feel free to contact our 24/7 live support in our control panel.
Report: "[NL-AMS1]: Storage backends issue"
Last updateThis incident has been resolved.
We thank you for your continued patience throughout this process and apologise for the inconvenience this has caused. We are currently compiling a detailed post-mortem to outline the sequence of events, the steps taken to rectify the situation, and the measures we are implementing to prevent such occurrences in the future. This post-mortem report will be made available to the customers in the coming days. We understand the gravity of this disruption and extend our sincerest apologies to all affected customers. Furthermore, we acknowledge the fact that we didn't meet our customers expectations on the reliability and vow to do better.
Our restoration efforts to bring affected services online are now in the final stages, with nearly all remaining customer services operational. Our team is conducting thorough checks to ensure stability across all systems to complete the recovery of services. We thank you for your continued support and understanding during this period. We are committed to maintaining transparent communication and will provide the next comprehensive update at 22:00 UTC or as soon as the services are fully available - whichever is sooner.
We are making significant headway and remain committed to resolving the remaining issues as swiftly as possible. Our technical team is diligently working to bring the remaining systems back online. We appreciate your patience and understanding as we push towards fully recovering services. The next update will be provided at 20:15 UTC
Update: We are making steady progress in resolving the storage backend issue at our NL-AMS1 data centre. Our team is working tirelessly to restore all affected services. We anticipate performing emergency maintenance to parts of the infrastructure, which may result in brief downtime for some customers. Affected customers will be notified individually. We appreciate your patience and understanding as we push towards recovering all services. Our team remains all hands on deck, ensuring swift recovery of the affected customers services. The next update will be shared at 18:15 UTC
We continue to make progress in resolving the storage backend issue at our NL-AMS1 datacentre. Our engineering team is fully engaged, with all hands on deck, diligently working to restore all services. While we have successfully reinstated several affected services, some VMs remain offline. We estimate that it may take a few more hours to bring the remaining servers back online. We appreciate your continued patience and understanding during this recovery phase. If you require immediate assistance or have further inquiries, please do not hesitate to reach out to our 24/7 live support via the UpCloud Hub. Thank you for your continued patience and trust in us as we work to resolve this matter.
Update: We are still working on the incident and we have brought back some of the affected services, we are still working on getting the rest of the affected VMs back online as soon as possible.
Update: we understand the cause of the problem and we have isolated the issue. We are working bring the affected services back online as soon as possible.
We have identified the cause of the problem and we are working to rectify it.
We are currently investigating a storage backend issue affecting multiple products within the NL-AMS1 datacentre. This may impact Cloud Servers and EOL Object Storage. We recommend avoiding stopping/starting your server(s) at this time. We are actively working to resolve this issue as swiftly as possible. We regret any inconvenience this might be causing and thank you for your patience as we work to address this. If you have any questions or concerns, please feel free to contact our 24/74 live support in our control panel.
Report: "[FI-HEL2]: Managed Object Storage Issue"
Last updateThis incident has been resolved.
Our team has implemented a fix to resolve the issue affecting Managed Object Storage in FI-HEL2 region and is monitoring the situation. We will post an update when the issue is fully resolved
We are investigating a connectivity issue with our Managed Object Storage, in which uploading of files to buckets and accessing buckets returns a 503 Error.
Report: "[FI-HEL2]: General issues affecting VMs, Load Balancers, Gateways, and Databases."
Last updateThis incident has now been resolved.
The issue has been identified, a fix has been implemented and we are currently monitoring.
We are investigating a general issue that has caused some VMs, Load Balancers, Gateways, and Databases to have problems, within the FI-HEL2 data centre. The affected services may experience slow connections, become unreachable or go into error state. We are working to resolve the situation as soon as possible.
Report: "[US-SJO1]: Compute nodes issue"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
All affected services are back online. If you have any issues please reach out to our Support team via email or live chat.
All affected services are back online. If you have any issues please reach out to our Support team via email or live chat.
We have implemented a fix and have brought most servers back online. We are working on bringing the rest of the servers online now. If you have any issues please reach out to our Support team via email or live chat.
The root cause of the issue has been identified. A portion of the San Jose data centre was affected and other services remain operational. We are working to bring all affected servers back online and resolve the situation as soon as possible. If you have any issues please reach out to our Support team via email or live chat.
We have identified an issue with certain compute nodes in our San Jose data centre. The problem may cause affected cloud servers to become slow or unresponsive. We are working to bring all affected servers back online and resolve the situation as soon as possible.
Report: "API/HUB Connectivity Issue"
Last updateConnectivity has been restored. If you are still experiencing issues reach out to our support at support@upcloud.com.
We are investigating connectivity issues to the UpCloud Hub and API.
Report: "Issue with API affecting the control panel and server configurations and deployments"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
Deployed servers prior to today should have no impact and continues to operate. However server actions such as shutdown or resizing will be not possible at the moment.
We are currently experiencing issues with our API and this is affecting server related actions globally, this have also affected the Control Panel. We are investigating the issue further and will report back as soon as possible.
Report: "Managed Database service issue in control panel and API"
Last updateThis incident has been resolved.
A fix has been implemented, and we are monitoring the results.
We are investigating an issue affecting new Managed Database deployments through the control panel and API. Currently, these deployments are experiencing delays and may become queued without fully completing. While our team is working towards a resolution, we have identified a temporary workaround: you can navigate to the database overview page of the affected deployment and toggle the public connection option off and then on again. This action should help to complete the deployment process. Please note that existing Managed Database instances are operating as normal. This issue only affects deploying new Managed Database instances via the Control Panel and API. If you have any questions, please contact our support team via live chat or email us: support@upcloud.com We apologise for the inconvenience.
Report: "Managed Database service issue in control panel and API"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring results.
Managed database available again in HUB and API We are now working to enable the creation of new database instances.
We have identified an issue with our Managed Database in relation to a control panel and API connections. Some of our users are unable to view/modify their Managed Databases in our control panel. We are working on this incident and trying to restore the Managed databases to control panel as soon as possible. Managed Database instances are functioning normally. This only affects the Control Panel and API. If you have any questions, please feel free to contact our support team via live chat or email us: support@upcloud.com We apologise for inconvenience.
Report: "Issue with our Control Panel"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently experiencing issues with our Control Panel. We are investigating the issue further and will report back as soon as possible.
Report: "Issue with our Support Live Chat"
Last updateThis incident has been resolved.
We are currently monitoring the situation with Support Live Chat. You should now be able to reach out to us using our live chats on the UpCloud hub or via email at support@upcloud.com
We have identified and are currently investigating an issue with our Support Live Chat via Control Panel Please feel free to reach us via email at support@upcloud.com should you experience any issues.
Report: "Managed LBaaS Degraded Performance"
Last updateBetween 11:55 - 12:40 UTC We experienced an issue that impacted the Managed Loadbalancer-service, causing degraded functionality. Some service API queries, along with service modifications could have been discarded during this time period. Already existing service instances continued working without issues. As of 12:40 UTC aprox all known issues have now been resolved. If you're still experiencing any issues please contact our technical support team via the UpCloud dashboard.
Report: "Managed Database service issue"
Last updateThis incident has been resolved.
We have mitigated the issue affecting Managed Database API service. And and will continue to monitor the affected components.
We have identified an issue that is impacting our Managed Database service. During this time, users may expect to experience issues when accessing their Managed Database service from the Control Panel and API. Our sincere apologies for any inconvenience caused and we will provide an update as soon as additional information is available.
Report: "Issue with Control Panel and API affecting new server deployments and configurations"
Last updateThe incident has now been resolved. We apologise for the inconvenience and the disruption with API / deployments in our FI-HEL1 data centre. If you still experience issues with API / deployments in FI-HEL1, please contact us via live chat or email at support@upcloud.com
We have implemented the fix to resolve the issue and will continue to monitor the affected components.
Our team has identified the cause of the issue impacting the Control Panel and API and has implemented a fix. During this time, we are seeing connectivity to affected services recovering. Thank you for bearing with us and we will share more updates as soon as it becomes available.
We are currently experiencing issues with our Control Panel and API and this is affecting server-related actions for new deployments globally. We are investigating the issue further and will report back as soon as possible.
Report: "[UK-LON1] Storage backends issue"
Last updateThe incident has now been resolved. We apologize for the inconvenience and the disruption you have experienced. If you still experience issues, please contact us via live chat or email at support@upcloud.com.
Most of the affected servers are back online and we are still working with a few remaining ones, and if any issues please contact our 24/7 support via our control panel, or via email at support@upcloud.com
We have identified the problem and we're working to bring affected servers back online as soon as possible.
We have identified an issue with certain parts of our storage backend system in UK-LON1. Impact will affect some storage performance and it will show as slowness or short hiccup. We don't recommend that you stop and start your server(s) at this time in UK-LON1 data centre. We are actively working to resolve this issue as swiftly as possible. We regret any inconvenience this might be causing and thank you for your patience as we work to address this. If you have any questions or concerns, please feel free to contact our 24/74 live support in our control panel.
Report: "[US-CHI1]: Object Storage Issue"
Last updateThis incident has been resolved.
We have implemented a fix and are monitoring the situation now.
We have identified an issue with our Object Storage instances within the US-CHI1 data centre. We sincerely apologise for the inconvenience this has caused and are working to restore the services and resolve the situation as soon as possible.
We are continuing to investigate this issue.
We have identified an issue with our Object Storage instances within the US-CHI1 data centre. We sincerely apologise for the inconvenience this has caused and are working to restore the services and resolve the situation as soon as possible.
Report: "[US-NYC1 and US-CHI1]: 3rd-party Networking Issue"
Last updateThis incident is now resolved.
We have restored normal network connectivity to all affected cloud servers and continue to monitor the situation. If you are still unable to connect to your server, please contact our support at support@upcloud.com. We apologise for the incident.
We have identified an ongoing 3rd-party network issue that may impact your connection to servers hosted in our New York and Chicago data center. The affected cloud servers or traffic routed here may experience instances of slow connections or become inaccessible. We are working to restore connectivity and resolve the situation as soon as possible.
Report: "[AU-SYD1] Object Storage Issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We have identified an issue with our Object Storage nodes in our Sydney data centre. We are working to restore the services and resolve the situation as soon as possible.
Report: "[AU-SYD1] Object Storage Issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We have identified an issue with our Object Storage nodes in our Sydney data centre. We are working to restore the services and resolve the situation as soon as possible.
Report: "SG-SIN1: Storage Backends working at a reduced performance"
Last updateThis incident has been resolved.
The issue has been resolved but we continue to closely monitor the situation to ensure the systems are fully operational.
We have identified the issue and have started to implement a fix, and we are continuing to bring all affected servers online.
We have identified an issue with one of the storage backends in our sg-sin1 datacenter. This problem may cause affected cloud servers to become slow or unresponsive. We are working to bring all affected servers back online and resolve the situation as soon as possible.
Report: "[SG-SIN1] Object Storage Deployment Issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We have identified an issue which prevents the deployment of new object storages and are working on implementing a fix.
Report: "[ES-MAD1] Object Storage Issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We have identified an issue with one of our Object Storage nodes in our Madrid data centre. This issue may cause the Object Storage performance to be slow or timeout. We are working to restore the services and resolve the situation as soon as possible.
Report: "[SG-SIN1]: Storage Backends issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results. We’ve restarted a small number of individual servers and are making strides towards fully restoring storage redundancy. You might notice some additional, temporary slowdowns during this period. We also recognize that there could be a slight impact on server and storage maintenance operations. We greatly appreciate your patience and understanding as we work to bring everything back to optimal conditions. If you have any questions, please contact our 24/7 support team via email at support@upcloud.com or our live chat at https://hub.upcloud.com/.
We have identified a solution to this issue and are currently working to restore the affected servers. This process may take some time.
We have identified an issue with management operations, which will impact the functionality of startup, shutdown, and restart operations, rendering them currently non-functional. We are actively working to resolve this issue as swiftly as possible. We regret any inconvenience this might be causing and thank you for your patience as we work to address this situation.
We have identified an issue with management operations. This issue is impacting the functionality of startup, shutdown, and restart operations, rendering them currently non-functional. We are actively working to resolve it as swiftly as possible. We regret any inconvenience this might be causing and thank you for your patience as we work to address this situation.
A fix has been implemented and we are monitoring the results.
We have identified an issue with network connectivity in our Singapore data centre. The affected cloud servers may experience slow connections or become unreachable. We are working to restore connectivity and resolve the situation as soon as possible.
Report: "[SG-SIN1, US-CHI1] Host Deployment and Startup Issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are continuing to work on a fix for this issue.
We have identified a host issue that is impacting our services. This issue affects starting servers and new deployments. Already started services are unaffected. We are working to restore the services and resolve the situation as soon as possible.
Report: "[US-SJO1] Host Deployment and Startup Issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We have identified a host issue that is impacting our services. This issue affects starting servers and new deployments. Already started services are unaffected. We are working to restore the services and resolve the situation as soon as possible.
Report: "[US-NYC1]: Storage backend issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring results.
We have identified an issue with some of our backend storage nodes in our US-NYC1 data centre. This issue may cause the server performance to be slow or unresponsive and deploying new servers may fail or take longer than usual. We are working to restore the services and resolve the situation as soon as possible.
Report: "[FI-HEL2]: Object Storage issue"
Last updateThis has now been resolved. Please accept our apologies for any inconvenience this may have caused.
We have identified an issue with one of our Object Storage nodes in our Helsinki data centre. This issue may cause the Object Storage performance to be slow or timeout. We are working to restore the services and resolve the situation as soon as possible.
Report: "[FI-HEL2] Object Storage Issue"
Last updateThis incident has been resolved.
We have applied a fix to restore the affected Object Storage to normal operating status and are continuing to monitor the situation. If your Object Storage is still not fully functional, please contact our support at support@upcloud.com. We apologize for any inconvenience that this incident may have caused.
We are still working to resolve this issue. Unfortunately, we expect this to take a few more hours to be fully resolved. Once again we apologise for any inconvenience this has caused and are working towards resolving the issue as soon as possible.
We have identified degraded performance on some object storage instances within the FI-HEL2 datacentre. We apologize for any inconvenience that this may cause and are working towards resolving the issue as soon as possible.
We have applied a fix to restore the affected Object Storage to normal operating status and are continuing to monitor the situation. If your Object Storage is still not fully functional, please contact our support at support@upcloud.com. We apologize for any inconvenience that this incident may have caused.
We have identified degraded performance on some object storage instances within the FI-HEL2 datacentre. We apologize for any inconvenience that this may cause and are working towards resolving the issue as soon as possible.
Report: "[SG-SIN1] Networking issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented. We apologize for the network disruptions, the situation has stablized, however, routing to external networks may not be optimal. We are working to fully resolve the situation.
We are currently investigating this issue.
Report: "[DE-FRA1]: Storage backend issue"
Last updateThis incident has been resolved, but if you are still encountering any issues pertaining to this, please contact our support through the live chat or support@upcloud.com. Our sincere apologies for any inconvenience that this may have caused.
A fix has been implemented and we are monitoring the results.
We have identified an issue with one of our backend storage nodes in our DE-FRA1 data centre. This issue may cause the server performance to be slow or unresponsive. We are working to restore the services and resolve the situation as soon as possible.
Report: "UK-LON1 Object Storage - Degraded Performance"
Last updateThe issue with object storage instances in UK-LON1 datacenter has been resolved. If your server is still not fully functional, please contact our support at support@upcloud.com. We apologize for the incident.
We have applied a fix to restore the affected object storage to normal operating status and continue to monitor the situation. If your server is still not fully functional, please contact our support at support@upcloud.com. We apologise for the incident.
We've noticed degraded performance on some object storage instances within the UK-LON1 Datacentre, We apologise for the inconvenience this has caused and are working towards implementing a resolution for this.
Report: "[NL-AMS1]: Networking issue"
Last updateWe want to elaborate on the challenges we had with networking in our Amsterdam data centre last weekend. We unfortunately were the victim of multiple, extremely large distributed denial of service \(DDoS\) attacks which affected networking availability in the NL-AMS1 data centre. This attack began on Friday afternoon UTC and lasted until Monday morning with intermittent pauses. This attack was unprecendented in size and breadth as it targeted hundreds of different IPv4 addresses in the data centre. We monitored and mitigated this attack with our upstream connectivity providers. We worked through the weekend in mitigating these attacks, as our previous approaches were ineffective due to sheer size and breadth of the attack. While we can’t publicly comment on the exact size, we can say it was in the hundreds of Gbps. We have communicated in detail to the customers in the NL-AMS1 data centre about the incident, but do not want to highlight specific details in public. Please note, we take these attacks as a form of cyber terrorism and we will also be reporting them to the Dutch and Finnish cyber security officials. We are taking more steps with our partners in building resilience to mitigate these attacks in a technical manner. We sincerely apologise for the issues in network connectivity and thank you for your understanding.
This incident has been resolved.
We have identified an issue with network connectivity in our NL-AMS1 data centre. The affected cloud servers may experience slow connections or become unreachable. We are working to restore connectivity and resolve the situation as soon as possible.
We have restored normal network connectivity to all affected cloud servers and will continue to monitor the situation. If you are still unable to connect to your server(s), please contact our support via live chat or email support@upcloud.com. We sincerely apologise for any inconveniences caused as a result of this incident.
We have identified an issue with network connectivity in our NL-AMS data centre. The affected cloud servers may experience slow connections or become unreachable. We are working to restore connectivity and resolve the situation as soon as possible.
We have restored normal network connectivity to all affected cloud servers and will continue to monitor the situation. If you are still unable to connect to your server, please contact our support via live chat or email at support@upcloud.com. We deeply regret and sincerely apologise for any inconveniences caused as a result of this incident.
We have identified an issue with network connectivity in our Amsterdam data centre. The affected cloud servers may experience slow connections or become unreachable. We are working to restore connectivity and resolve the situation as soon as possible.
We have restored normal network connectivity to all affected cloud servers and continue to monitor the situation. If you are still unable to connect to your server, please contact our support at support@upcloud.com. We apologise for the incident.
We have identified an issue with network connectivity in our Amsterdam data centre. The affected cloud servers may experience slow connections or become unreachable. We are working to restore connectivity and resolve the situation as soon as possible.
Report: "NL-AMS1: Networking issue"
Last updateThis incident has now been resolved. If you are still unable to connect to your server or notice any further issues, please contact our support via live chat or email support@upcloud.com
We have restored normal network connectivity to all affected cloud servers and are continuing to monitor the situation. If you are still unable to connect to your server, please contact our support at support@upcloud.com. We sincerely apologise for any inconveniences caused as result of this incident.
We have identified an issue with network connectivity in our NL-AMS data centre. The affected cloud servers may experience slow connections or become unreachable. We are working to restore connectivity and resolve the situation as soon as possible.
Report: "Issue with our payment gateway"
Last updateThis incident has been resolved.
The issue with our payment gateway has been resolved, but if you are still encountering any issues pertaining to this, please contact our support through the live chat or support@upcloud.com. Our sincere apologies for any inconveniences that this may have caused.
The issue with our payment gateway has been resolved, but if you are still encountering any issues pertaining to this, please contact our support through the live chat or support@upcloud.com. Our sincere apologies for any inconveniences that this may have caused.
Report: "Issue with our payment processor"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently experiencing issues with our payment processor which may be affecting multiple payment options (Automated, Manual and PayPal). Users may experience issues when making a payment. We are investigating the issue further and will report back as soon as possible.
Report: "Issue with API affecting server configurations and deployments"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The log-in control pannel is also affected. We are continuing to investigate.
We are currently experiencing issues with our API and this is affecting server related actions globally. We are investigating the issue further and will report back as soon as possible.
Report: "[FI-HEL1]: Compute node issue"
Last updateThis incident has been resolved.
We have restored all the affected systems and are closely monitoring the situation.
Affected customer servers have been brought back online. However, we have identified another issue with our API and control panel.
We have identified an issue with one of the compute nodes in our Helsinki 1 data centre. The problem may cause affected cloud servers to become slow or unresponsive. We are working to bring all affected servers back online and resolve the situation as soon as possible.
Report: "[ES-MAD1]: Networking issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are investigating a networking issue that is affecting some cloud servers in our Madrid data centre. The problem may prevent users from deploying new cloud servers in the affected region, and cloud servers in the affected region may experience slow connections or become unreachable. We are working to resolve the situation as soon as possible.
Report: "[US-NYC1]: Compute node issue"
Last updateThis incident has been resolved.
We have restored all affected cloud servers to normal operating status and continue to monitor the situation. If your server is still not fully functional, please contact our support at support@upcloud.com. We apologise for the incident.
We have identified an issue with one of the compute nodes in our New York data centre. The problem may cause affected cloud servers to become slow or unresponsive. We are working to bring all affected servers back online and resolve the situation as soon as possible.
Report: "US-SJO1: Compute node issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are continuing to work on a fix for this issue.
We have identified issue with our San Jose data center. The problem may cause cloud servers to become slow or unresponsive. We are working to bring all affected servers back online and resolve the situation as soon as possible.