Historical record of incidents for Glesys
Report: "Reduced backup power in Falkenberg"
Last updateWe are currently investigating the issue.
Report: "Planned maintenance of Kubernetes Management Platform (Stockholm)"
Last updateWe will be performing maintenance on the Kubernetes management platform in Stockholm. No service impact is expected, but there will be a system-initiated rolling update of all Kubernetes nodes as part of the maintenance. Please note, the version of Kubernetes will remain on the same for all managed clusters/nodes.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Report: "Network issues in Oulu"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified, and we're working on establishing normal operations.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Network issues in Oulu"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified, and we're working on establishing normal operations.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "VMware virtual servers in Stockholm cannot reach underlying storage."
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results. If you keep experiencing issues, there is a risk that your server has entered read-only mode. If that is the case please restart your server.
We are currently investigating this issue.
Report: "Power outage in Stockholm"
Last updateRead the Incident Report regarding our power outage in VBDC, Stockholm. [Download RFO report](https://static.glesys.com/Incident-Report-GleSYS-2024-08-12-Datacenter.pdf) \(added 2024-08-14\) [Download follow-up report](https://static.glesys.com/Incident-Report-GleSYS-2024-08-12-VBDC-Follow-up.pdf) \(added 2024-12-04\)
This incident has been resolved. An Incident Report will be posted here within 48 hours.
A fix has been implemented and we are monitoring the results.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
VMware verified ok.
Following the power failure collateral outages has been recorded and are being worked on. VMware, servers and storage should work but management was intermittent unavailable. Object storage, some storage nodes offline. Leaf switches without power.
Power was restored at 20:56 CEST.
We are currently investigating the issue, it affects multiple services.
Report: "Timeouts in Email Service"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We have identified an issue where we see timeouts from our spam filter service resulting in timeouts in email delivery, emails will most likely be queued on the client and a retry will be made, if this does not happen, please resend the email when this incident is resolved.
Report: "Delay on configuration changes in KVM platform."
Last updateThis incident has been resolved.
We are continuing to work on a fix for this issue.
Right now we see a delay on configuration changes through our API and Control Panel affecting the KVM platform, this is being worked on and we have identified the cause. There is no service impact on KVM Virtual servers.
Report: "Partial outage of network in Falkenberg."
Last updateThis incident has been resolved and redundancy is back to normal.
We have no known affected customers anymore. However we are running on reduced redundancy and we will hold this incident open until this is resolved. If you do believe you are still affected please contact support.
We are continuing to work on a fix for this issue.
We have identified that services affected by the maintenance window from earlier today still see ongoing issues. We are looking into this.
Report: "Partial outage of network in Stockholm."
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Extended maintenance of Network in Falkenberg."
Last updateThis incident has been resolved.
We have corrected the issue and redundancy is back to normal. If you believe you are still affected please contact support.
We are moving affected single-homed customers to another router. We are still working with the vendor to determine best cause of action for router which is not working as expected.
Planned maintenance in Falkenberg (2024-09-17) did not go according to plan, customers affected by this maintenance are still affected. We are working with the vendor to identify the underlying issue.
Report: "Extended maintenance of Network in Stockholm."
Last updateThis incident has been resolved and redundancy is back to normal.
Replacement router will be set in production starting 21:00 CEST, this is a process that is expected to be completed on Monday (2024-09-16). There is no service impact expected during this process.
We have received the replacement hardware yesterday and are in progress of configuring it. We are expecting to take the new router into production this evening.
We're operating with reduced redundancy in Stockholm, there's no service impact expected from now on. Replacement hardware expected to arrive tomorrow.
All affected customers have been moved to another router. If you are still experiencing issues please contact support.
No further news, we continue to move affected customers to another router. This incident affects single-homed connections. If you believe you are affected and have a multi-homed connection contact support.
No further news, we continue to move affected customers to another router. This incident affects single-homed connections. If you believe you are affected and have a multi-homed connection contact support.
We are moving affected single-homed customers to another router. We are still working with the vendor to determine best cause of action for router which is not working as expected.
Planned maintenance in Stockholm did not go according to plan, customers affected by previous maintenance is affected still. We are working with the vendor to identify the underlying issue.
Report: "Storage incident on VMware service in Stockholm"
Last updateRead the Incident Report regarding our storage outage in Stockholm. [Download](https://static.glesys.com/Incident-Report-GleSYS-2024-09-04-Operations.pdf)
The incident has been resolved. If you are still experiencing issues, please contact GleSYS Support for further assistance. An incident report will be published on this page once it's available.
The VMs are now accessible again. However, it's possible that non-Windows VMs have switched to a read-only filesystem, which may require a reboot to restore full functionality.
A problem occured during a planned upgrade and some VMs have lost access to their storage. We are working with our vendor to resolve this issue, no ETA at this time.
Report: "Cloud Director portal in Stockholm issues."
Last updateThe incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating issues related to logging into Cloud Director portal in Stockholm. This is affecting management of VM's for Cloud Director customers.
Report: "Active phishing attempt"
Last updateThis incident has been resolved.
We are continuing to closely monitor the ongoing phishing attempt targeting our customers.
We want to inform you about an ongoing phishing attempt targeting our customers. The fraudulent message falsely claims that there was an issue processing your recent payment and that your account is now invalid. Please be aware that this message is not from us. Do not click on any links or provide any personal information.
Report: "Network disruption for Colocation customers in Falkenberg."
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Outbound emails from GleSYS Cloud are delayed"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Our upstream email provider are currently experiencing availability issues causing some of our emails to be delayed. We use an upstream email provider for outgoing transactional emails from GleSYS Cloud. These emails include invoices, verification emails, domain renewal emails, etc. However, if you're using our email service in GleSYS Cloud to set up email accounts, we don't rely on any third-party provider for that, and our email service wasn't affected by this incident.
Report: "ObjectStorage Falkenberg Degraded performance"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "ObjectStorage Falkenberg Issues"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently experiencing issues in our ObjectStorage cluster in Falkenberg.
Report: "Issue affecting certain VMs in VMware Falkenberg"
Last updateRead the Incident Report here: [Download](https://static.glesys.com/Incident-Report-GleSYS-2024-03-22-Operations.pdf)
This incident has been resolved.
A fix has been implemented and we are monitoring the results. If you are still experiencing issues with any VMs, please try a reboot first. If the problem persists, please contact GleSYS Support.
We are currently investigating this issue.
Report: "Network disturbance"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Currently experiencing intermittent network issues in Falkenberg. Our team is actively investigating and working on a resolution.
Report: "Issue adding payment cards"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Our payment card provider are having issues affecting the possibility to adding a new payment card. A fix is in progress.
Report: "Network issues in Falkenberg"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating issues with our network in Falkenberg. Initial reports shows that it affects multiple components, such as GleSYS Cloud and the API.
Report: "Domain order delays"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
Our upstream domain provider are currently experiencing availability issues causing some of our domain orders to be delayed. All orders are being queued as we're monitoring the situation expecting everything to be processed automatically as soon as the availability issues have been resolved.
Report: "Active phishing attack in GleSYS name."
Last updateThis incident has been resolved.
Still keeping an eye on the development of the situation.
We've gotten reports that right now there is an active phishing attack going on informing about domain renewals. Please be aware, You can always check status of your domains from our control panel.
Report: "Network issues KVM Stockholm"
Last updateRead the Incident Report regarding our network issues affecting KVM in Stockholm. [Download](https://static.glesys.com/Incident-Report-GleSYS-2024-01-31-Network.pdf)
We had short network disturbance in our KVM solution based in Stockholm
Report: "Network issues KVM"
Last updateRead the Incident Report regarding our network issues affecting KVM in Stockholm. [Download](https://static.glesys.com/Incident-Report-GleSYS-2024-01-31-Network.pdf)
This incident has been resolved.
The issue has been identified and a fix is being implemented.
We are having some network issues after the planned maintenance
Report: "Issue with the VMware Management Platform in Amsterdam"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating an issue with our VMware management platform in Amsterdam. Any management tasks on virtual machines in Amsterdam from GleSYS Cloud might fail.
Report: "Network issues in Stockholm"
Last updateRead the Incident Report regarding our network issues in Stockholm. [Download](https://static.glesys.com/Incident-Report-GleSYS-2023-12-18-Network.pdf)
This incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are continuing to work on a permanent fix for this issue. Network operational.
Partial fix in place, things are getting back to normal. Technician on site.
We are continuing to work on a fix for this issue.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Network issues in Stockholm"
Last updateRead the Incident Report regarding our network issues in Stockholm. [Download](https://static.glesys.com/Incident-Report-GleSYS-2023-12-18-Network.pdf)
This incident has been resolved.
A fix has been implemented and all equipment connected to the hardware causing issues has been moved, we are monitoring the results.
Issue caused by same hardware that caused yesterday's issue, currently back in operating mode but we're actively working on moving the connected equipment to other hardware.
Partial fix in place, things are getting back to normal. Technician on site.
We are currently investigating this issue.
Report: "Network problem London"
Last updateRead the Incident report regarding our network issues within GleSYS Network in London. [**Download**](https://static.glesys.com/docs/Incident%20Report%20GleSYS%202023-10-24.pdf)
All services are back to normal! We apologize for any inconvenience caused by the recent outage. Our suppliers has worked hard to restore everything as quickly as possible. You should be able to access your servers and services again without any issues. If you encounter any problems or have any questions, please contact our support team at support@glesys.se. We are always happy to help and hear your feedback.
A fix has been implemented and we are monitoring the results.
The part has been collected by the technician. He is on the way to the site. The ETA is 18:00 CEST.
Supplier field engineer is expected to pick up replacement parts at 15:45 - 16:15 CEST for issue in Düsseldorf.
We have identified the issue: On 2023-10-16, our provider suffered a sub-sea fiber cut 120 km from the British coast. Current status is that repairs are ongoing, we are expecting another update within the hour from our provider. On 2023-10-24, the redundant fiber suffered a hardware failure in Düsseldorf. Our provider is sending technicians out and procuring spare parts. We will merge all related active incidents with this one.
We are currently investigating this issue.
Report: "Object Storage in Stockholm service disturbance."
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We see sporadic disturbances in our Object Storage service in Stockholm. We are looking into it.
Report: "Problems with adding payment cards"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We continue investigating together with our provider.
We are continuing to investigate this issue.
We continue investigating together with our provider. We've identified that the problem might be limited to Mastercard cards.
We are investigating together with our provider.
Report: "Routing problem in Frankfurt"
Last updateProvider reports that during maintenance works an issue with the UPS was discovered. The maintenance was rolled back and the UPS is back to normal operation. It is unclear how this affected both our power feeds, we are awaiting the RFO and will talk further with our provider.
UPS on site failed to operate during a power outage. Our provider is in contact with their vendor to further troubleshoot, current redundancy status is unknown. Next update is expected within 2 hours.
We have had a short outage in Frankfurt. Right now, it appears to be a power loss. We're attempting to reach our provider and will update as soon as we have more information
Report: "Network problem in Vårgårda, Herrljunga and Alingsås"
Last updateThis incident has been resolved.
It seem like the issue re-occurred, we are investigating.
Report: "Network problem in Vårgårda, Herrljunga and Alingsås"
Last updateThis issus is now resolved.
The issue has been identified. The operator is working on resolving the issue. ETA 17:00 CEST
We have an ongoing issuse. We are working to fix the problem.
Report: "Network issues in Falkenberg DC."
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Some site and services can't be reached. We are investigating the issue.
Report: "Network disturbance in Alingsås, Herrljunga and Vårgårda"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are experiencing network disturbance in Vårgårda, Herrljunga and Alingsås due mutilple fibercuts. Experience poor connection or none at all, we are looking into the problem and working as fast as we can to resolve it.
Report: "Network outage in Falkenberg"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Network outage on our VMware platform in Falkenberg"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Object Storage in Stockholm service disturbance."
Last updateWe had a short service disturbance in our Object Storage service in Stockholm.
Report: "Web Proxy outage after planned maintenance"
Last updateConfiguration changes restored and further validation will be used in the future.
A fix has been implemented and we are monitoring the results.
Implemented temporary fix.
After planned maintenance the proxy cluster started behaving bad.
Report: "VMware Falkenberg Partially unavailable"
Last updateA temporary fix for the issue has been implemented. No customer workload has been affected. For a short period between 08:57 - 09:15 CEST (06:57-07:15 UTC) management operations on a VM may have failed. If you have any further questions, please contact support@glesys.se.
We are experiencing issues with our VMware platform in Falkenberg DC. Our technicians have found an issue and are working on implementing a fix.
Report: "GleSYS API disturbance for managing Object Storage service."
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating. The problem only affects management.
Report: "Network disturbance at London"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Report: "Network problem in Stockholm"
Last updateThis incident has been resolved.
The faulty distribution switch has been successfully replaced. All services are now back up and running. We apologize for any inconvenience caused by the service disruption and appreciate your patience as we resolved this issue.
The faulty distribution switch has been replaced and is currently being configured. Our team is working hard to ensure that all services are fully restored as soon as possible.
We have identified a problem with a distribution switch in VBDC, technician is on his way to investigate further.
We are currently investigating this issue.
Report: "Degraded performace on our spam detection"
Last updateThis incident has been resolved.
We have identified some degraded performances and delays in the spam detection system.
Report: "Degraded spam detection in our email system"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We have identified a problem with our spam detection in our email system and are working on a solution.
Report: "Datacenter Stockholm running on backup power"
Last updateThis incident has been resolved.
The issue has been identified, and we're running on our generators.
Report: "Network disturbance due to DDoS"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Network disturbance due to DDoS"
Last updateWe received alerts about an ongoing DDoS attack at 09:44 and it lasted to around 09:50.
Report: "Network disturbance due to DDOS."
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Network disturbance due to DDOS."
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.