Historical record of incidents for DRACOON Cloud
Report: "Scheduled Maintenance"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
We will be undergoing scheduled maintenance during this time. A short downtime for a couple of minutes can occur.
Report: "Partial Outage of DRACOON Cloud"
Last updateThe issue with DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with DRACOON Cloud has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Partial Outage of DRACOON Cloud"
Last updateThe issue with DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
We are currently investigating an issue with DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Outage of Storage Server (Upload/Download)"
Last updateWe experienced an issue with our Storage Server \(Upload/Download\) on 18.10.2024 from 08:10 - 08:40. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? There has been an outage of our Storage Server \(Upload/Download\) during the incident window. Why did this happen? There happened to be some unexpected issues with our Storage Server, which caused the upload and download feature to be unavailable. What did we do? Our incident response team quickly started investigating, identified the underlying issue and resolved it by replacing a failed hard drive on the Storage Server. What can we do to improve? We will further investigate the issue and improve our infrastructure to prevent similar issues to occur in the future. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with our Storage Server (Upload/Download) has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with our Storage Server (Upload/Download) has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with our Storage Server (Upload/Download). Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "DRACOON support portal not available"
Last updateThe issue with our support portal has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
We are currently investigating an issue with our support portal. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Outage of the DRACOON Cloud"
Last updateThe issue with the DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with the DRACOON Cloud has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with the DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Partial Outage of the DRACOON application"
Last updateThe issue with the DRACOON application has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with the DRACOON application has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with the DRACOON application. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Partial Outage of the API"
Last updateThe issue with the API has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with the API has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We have identified the issue with the API. Our engineers have already found a resolution and we will perform an emergency maintenance to resolve the problem at 15:00. There might be a downtime of a few minutes.
We are currently investigating an issue with the API. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Partial Outage of DRACOON Cloud"
Last updateThe issue with DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with DRACOON Cloud has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Partial Outage of Uploads"
Last updateThe issue with Uploads has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with Uploads has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with Uploads. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Outage of API (group 1-9)"
Last updateThe issue with API (group 1-9) has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with API (group 1-9) has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with API (group 1-9). Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Degraded Performance of DRACOON Cloud"
Last updateThe issue with DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with DRACOON Cloud has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Partial Outage of API (group 02)"
Last updateThe issue with API (group 02) has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
We are continuing to work on a fix for this issue.
We have identified the issue with API (group 02). Our engineers are working on a resolution and we are confident that we will have a fix in place soon. We will provide more information and updates as soon as they become available.
We are currently investigating an issue with API (group 02). Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Partial Outage of DRACOON Cloud"
Last updateThe issue with DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with DRACOON Cloud has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Degraded Performance of Storage Server (Upload)"
Last updateWe experienced an issue with Storage Server \(Upload\). Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? The upload was working but some customers experienced slow completion of uploads. Why did this happen? Due to a software problem exceptional high load was created on our storage system. What did we do? We were able to quickly stop the incorrect behavior of the software to improve performance. What can we do to improve? We fixed the software and improved our storage to prevent this problem from occurring again. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with Storage Server (Upload) has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with Storage Server (Upload) has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We have identified the issue with the Storage Server. Our engineers are working on a resolution and we are confident that we will have a fix in place soon. We will provide more information and updates as soon as they become available.
We are currently investigating an issue with the Storage Server (Upload). Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Outage of DRACOON Cloud"
Last updateThe issue with DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with DRACOON Cloud has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Degraded Performance of File Uploads"
Last updateThe issue with File Uploads has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with File Uploads has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
Report: "Outage of DRACOON Cloud"
Last updateThe issue with our DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with our DRACOON Cloud has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We have identified the issue with our DRACOON Cloud. Our engineers are working on a resolution and we are confident that we will have a fix in place soon. We will provide more information and updates as soon as they become available.
We are currently investigating an issue with our DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Degraded Performance of SMS feature"
Last updateThe issue of our SMS service provider has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue of our SMS service provider has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with our SMS service provider (see https://status.retarus.io/). SMS dispatch is currently delayed. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Partial Outage of Storage Upload"
Last updateWe experienced an issue with the DRACOON Cloud on 22.08.2024 from 12:30 - 15:00. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? There has been a partial outage of our Upload Functionality during the incident window. Only a part of our customers was affected. Why did this happen? There happened to be some issues on one of our backend services, which resulted in failing to complete uploads for some of our customers. What did we do? Our incident response team quickly identified the underlying issue and resolved it by restarting and increasing the amount of instances of the affected service. What can we do to improve? We will further investigate the issue and improve the affected service and its monitoring to prevent similar issues in the future. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with storage has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with storage has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with our storage. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Outage of DRACOON Cloud"
Last updateWe experienced an issue with our DRACOON Cloud on 04.09.2024 from 16:40 - 17:16. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? There has been an outage of our DRACOON Cloud during the incident window. Why did this happen? There happened to be some unexpected internal networking issues of our infrastructure, which caused the DRACOON Cloud to be unavailable. What did we do? Our incident response team quickly started investigating, identified the underlying issue and resolved it by reestablishing network connectivity between affected components. What can we do to improve? We will further investigate the issue and improve our infrastructure to prevent similar issues to occur in the future. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with DRACOON Cloud has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Outage of DRACOON CLoud"
Last updateThe issue with DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
There was a short outage of our DRACOON Cloud from 10:43 to 10:45 am german localtime. The issue has been resolved and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
Report: "Degraded Performance of the DRACOON Cloud"
Last updateWe experienced an incident on 2024-02-19. What Happened: Our system encountered a critical incident characterized by widespread resource depletion. Why Did This Happen: The incident occurred as a result of a race condition, a scenario where multiple threads or processes compete for shared resources in an unpredictable manner. What We Did: Upon identifying the race condition as the underlying cause of the incident, our incident response team swiftly intervened to mitigate the impact on system performance. We implemented immediate measures to address the resource depletion and restore stability to the system. Furthermore, we conducted a comprehensive review of our codebase to identify and rectify any instances of potential race conditions. What We Can Do to Improve: To prevent similar incidents in the future, we have implemented several proactive measures aimed at enhancing system resilience and stability. Firstly, we have bolstered our monitoring infrastructure to promptly detect any abnormal resource consumption patterns indicative of a race condition. Additionally, we have introduced rigorous edge-case testing to uncover and address potential vulnerabilities within our system's concurrency model. We apologize for any inconvenience caused by this incident and assure our users of our unwavering commitment to delivering reliable and stable services. If you have any further questions or concerns, please do not hesitate to reach out to our support team for assistance.
We are currently investigating an issue with DRACOON Cloud core service. The issue itself has been resolved after about 1 minute and we are now monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
Report: "Partial Outage of Storage"
Last updateWe experienced an issue with **our storage** on **2024-01-24**. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? **Our storage systems were not available leading to up- and download problems.** Why did this happen? **The error occurred during regular maintenance work after updating the systems to a new software version.** What did we do? **We contacted the vendor and found the root cause leading to the problem. A new software version was rolled out.** What can we do to improve? **We strive to improve our quality assurance processes to minimize the possibity of problems during upgrades.** We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with our storage has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with storage has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We have identified the issue with storage. Our engineers are working on a resolution and we are confident that we will have a fix in place soon. We will provide more information and updates as soon as they become available.
We are continuing to investigate this issue.
We are currently investigating an issue with storage. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Outage of DRACOON Storage Service"
Last updateWe experienced an issue with **our storage** on **2024-01-19**. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? **Our storage systems were not available leading to up- and download problems.** Why did this happen? **An internal network outage occurred leading to heartbeat timeouts and service restarts.** What did we do? **We have analyzed the logs and ensured that there is no major problem with the network.** What can we do to improve? **We will keep on monitoring our platform for errors and ensure the operability. We increased the alarm pririties of certain alerts for faster response times for the event of a recurrence of the problem.** We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with the DRACOON Storage Service has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with the DRACOON Storage Service has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with the DRACOON Storage Service, including upload and download functionality. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Outage of the Upload and Download Functionality"
Last updateWe experienced an issue with **our storage** on **2023-12-21**. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? **Our storage systems were not available leading to up- and download problems.** Why did this happen? **An internal network outage occurred leading to heartbeat timeouts and service restarts.** What did we do? **We have analyzed the logs and ensured that there is no major problem with the network.** What can we do to improve? **We will keep on monitoring our platform for errors and ensure the operability. We increased the alarm pririties of certain alerts for faster response times for the event of a recurrence of the problem.** We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
We are continuing to monitor for any further issues.
The issue with the upload and download functionality has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with the upload and download functionality. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Outage of Signing Feature"
Last updateWe experienced an unplanned disruption in our services on 16.01.2024. What Happened: On 16.01.2024, we noticed a sudden disruption in our services, specifically related to interactions with a partner API. Why Did This Happen: The incident occurred due to changes to the API of a partner. What We Did: Upon identifying the issue, our incident response team immediately initiated contact with our partner to address the situation. We worked closely with them to understand the nature of the changes and expedite the process of implementing a solution. As a mitigation strategy, we swiftly integrated a newer version of the partner's API into our system, restoring functionality and minimizing the impact on our users. What We Can Do to Improve: In response to this incident, we recognize the critical need for proactive measures to mitigate similar risks in the future. To prevent disruptions caused by unannounced changes from partners, we will establish clearer communication channels and protocols for receiving advance notice of API modifications. Additionally, we will enhance our monitoring systems to promptly detect and respond to any unexpected changes, ensuring minimal downtime for our services. We apologize for any inconvenience caused by this incident and assure our users that we remain committed to delivering reliable and uninterrupted service. If you have any further questions or concerns, please do not hesitate to reach out to our support team for assistance. Thank you for your understanding and continued support
The issue with the Signing Feature has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
We are continuing to work on a fix for this issue.
We have identified the issue with the Signing Feature. Our engineers are working on a resolution and we are confident that we will have a fix in place soon. We will provide more information and updates as soon as they become available.
Report: "Outage of datacenter"
Last updateWe experienced an issue with our datacenter infrastructure on 2nd of April 2024 16:20 CEST. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. * What happened? **Our datacenter infrastructure went offline thus taking down all our DRACOON cloud services at once.** * Why did this happen? **Our datacenter provider carried out some internal maintenance work to their billing systems. This caused our datacenter infrastructure to be suspended and therefore rendering it unusable at the time of the incident.** * What did we do? **After noticing the incident, we immediately notified all our customers and began analyzing the root cause. Once we found out all our datacenter services went offline at the same time we immediately contacted our datacenter provider who confirmed the outage and their efforts to bring our systems back online asap. Once the datacenter infrastructure was back online, we worked deliberately to restart all services and bring back online all customer environments.** * What can we do to improve? **Since the issue was caused by our datacenter provider during a routine, known to be a non-impacting maintenance work that resulted in an outage, we ensured our datacenter provider understands the massive impact his actions had to our infrastructure and to our customers. They ensured us to improve their processes further to prevent any further complication like this outage to the best of their abilities.** We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with data center has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with our data center has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are continuing to work on a fix for this issue.
We have identified the issue with our datacenter. Our engineers are working on a resolution and we are confident that we will have a fix in place soon. We will provide more information and updates as soon as they become available.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We are currently investigating an issue with our datacenter. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Degraded Performance of the DRACOON Cloud"
Last updateWe experienced an incident on 2024-01-15. What Happened: Our system encountered a critical incident characterized by widespread resource depletion. Why Did This Happen: The incident occurred as a result of a race condition, a scenario where multiple threads or processes compete for shared resources in an unpredictable manner. What We Did: Upon identifying the race condition as the underlying cause of the incident, our incident response team swiftly intervened to mitigate the impact on system performance. We implemented immediate measures to address the resource depletion and restore stability to the system. Furthermore, we conducted a comprehensive review of our codebase to identify and rectify any instances of potential race conditions. What We Can Do to Improve: To prevent similar incidents in the future, we have implemented several proactive measures aimed at enhancing system resilience and stability. Firstly, we have bolstered our monitoring infrastructure to promptly detect any abnormal resource consumption patterns indicative of a race condition. Additionally, we have introduced rigorous edge-case testing to uncover and address potential vulnerabilities within our system's concurrency model. We apologize for any inconvenience caused by this incident and assure our users of our unwavering commitment to delivering reliable and stable services. If you have any further questions or concerns, please do not hesitate to reach out to our support team for assistance.
The issue with DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with the DRACOON Cloud has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
Report: "Degraded Performance of DRACOON Cloud"
Last update**20.02.2024 - 15:13 CET - Post-Mortem** We experienced an issue with our DRACOON Cloud service on 20th of February 2024 at 15:13 CET. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. **What happened?** The performance of our DRACOON Cloud was degraded for some customers due to an extraordinary load situation on one component. **Why did this happen?** Due to a high-load situation the database performance was insufficient to cover the actual load for some specific requests/customers. Our auto-healing configuration therefore restarted the affected/stuck transactions which cleared the situation \(the transaction backlog\) within a couple of minutes. **What did we do?** An automated process restarted some stuck teansactions, so they could be processed as planned. No further/manual interactions were required. **What can we do to improve?** We are steadily improving the performance of our DRACOON Cloud infrastructure and the code of our application to be able to sustain such high load scenarios. So there is no specific action following this incident outside of our regular scope. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with the DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with our DRACOON CLoud has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are continuing to investigate this issue.
We are currently investigating an issue with our DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Slow performance of uploads to DRACOON S3 Storage"
Last updateThe issue with uploads to our S3 storage has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with uploads to our S3 storage has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with uploads to our S3 storage. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Degraded Performance of Virus Protection"
Last updateThe issue with Virus Protection has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with Virus Protection has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with Virus Protection. Some files cannot be scanned and remain locked for security reasons. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Degraded Performance of Virus Protection"
Last updateWe experienced an issue with our Virus Protection Feature on 01.07.2024 from 11:00 - 11:44. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? There has been Degraded Performance of our Virus Protection Feature during the incident window. Why did this happen? There happened to be some issues on one of our backend services, caused by an infrastructural change which resulted in Degraded Performance of our Virus Protection Feature. What did we do? Our incident response team quickly identified the underlying issue and resolved it by improving the deployment configuration of the affected service. What can we do to improve? We will further investigate the issue and improve the affected service to prevent similar issues in the future. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with Virus Protection has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with Virus Protection has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with Virus Protection. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Degraded Performance of Virus Protection"
Last updateThe issue with Virus Protection has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with Virus Protection has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We have identified the issue with Virus Protection. Our engineers are working on a resolution and we are confident that we will have a fix in place soon. We will provide more information and updates as soon as they become available.
We are currently investigating an issue with Virus Protection. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Partial Outage of Upload Functionality"
Last updateWe experienced an issue with the DRACOON Cloud on 28.05.2024 from 16:40 - 17:00. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? There has been Partial Outage of our Upload Functionality during the incident window. Only a part of our customers was affected. Why did this happen? There happened to be some issues on one of our backend services, which resulted in failing uploads for some of our customers. What did we do? Our incident response team quickly identified the underlying issue and resolved it by restarting the affected service. What can we do to improve? We will further investigate the issue and improve the affected service to prevent similar issues in the future. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with Upload Functionality has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with Upload Functionality has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with Upload Functionality. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them. Only a part of our customers are affected.
Report: "Degraded Performance of the DRACOON Cloud"
Last updateWe experienced an issue with the DRACOON Cloud on 25.04.2024 from 16:00 - 16:50. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? There has been Degraded Performance of our API and Web UI during the incident window. Why did this happen? There happened to be some long running queries on one of our database servers in addition to smaller issues with one of our file servers, which resulted in a Degraded Performance of the before mentioned components. What did we do? Our incident response team quickly identified the underlying issue and resolved it. What can we do to improve? We will further investigate the issue and improve the affected database queries to prevent similar issues in the future. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with the DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
We are currently investigating an issue with DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Degraded Performance of the Upload Feature"
Last updateWe experienced an issue with the upload feature on 20.03.2024 afternoon after updating one of our backend components. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? After the update of one of our backend components uploads for a small amount of our customers were delayed. Why did this happen? The update introduced an edge case, which resulted in some uploads occasionally getting delayed for a small amount of our customers. What did we do? Our incident response team quickly identified the underlying issue and resolved it for the affected component. What can we do to improve? We will extend our test cases to identify such issues before a production rollout. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with the Upload Feature has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with the Upload Feature has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We have identified the issue with the Upload Feature. Our engineers are working on a resolution and we are confident that we will have a fix in place soon. We will provide more information and updates as soon as they become available.
We are currently investigating an issue with the Upload Feature. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Partial Outage of Storage (Up- and Download)"
Last updateWe experienced an issue with **up- and downloads for hybrid customers using their own S3 storage** on **29.02.2024 after updating one of our backend components the night before** . Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? **After our latest update during our maintenance window, up- and downloads for customers with own S3 storages were not possible** Why did this happen? **One of our automated quality checks introduced a too restrictive policy without context, leading to a software change which resulted in non-working up- and downloads for hybrid customers.** What did we do? **Our incident response team quickly identified the underlying issue and provided an updated version of the affected component.** What can we do to improve? **We will extend our automated test cases covering hybrid setups to identify such issues before a production rollout.** We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with Storage has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with Storage has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We have identified the issue with our Storage. Our engineers are working on a resolution and we are confident that we will have a fix in place soon. We will provide more information and updates as soon as they become available.
We are currently investigating an issue with our Storage. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Partial Outage of Login Functionality"
Last updateWe experienced an issue with the Login Functionality on 2024-02-12 09:50 - 10:10. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? Our Login Functionality had a partial outage during the incident window, which resulted in some users being unable to login. Only users with DRACOON Premium and MFA in use were affected. Why did this happen? There was an error in one of our components, which is responsible for authentication. What did we do? We were able to deploy a fix and therefore stabilize the system. What can we do to improve? We will further analyze on what exactly the reason for the errors was and fix the underlying problem. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with the Login Functionality has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with the Login Functionality has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We have identified the issue with the Login Functionality. Our engineers are working on a resolution and we are confident that we will have a fix in place soon. We will provide more information and updates as soon as they become available. Only customers with DRACOON Premium and with MFA in use are affected.
We are currently investigating an issue with the Login Functionality. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Partial Outage of Branding Service"
Last updateWe experienced an issue with the Branding Service on 2024-01-25 09:00 - 10:15. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? During the time of the incident, the default branding was displayed on the login page for some requests instead of the configured custom branding. Why did this happen? The underlying issue with the incorrect branding being displayed was a timing issue introduced with a recent update of our authentication service. Because the issue was an edge case, not all running instances of the authentication service were affected and therefore not every response contained the incorrect branding. What did we do? We applied a temporary workaround to fix the issue immediately and will permanently fix the issue in the next version of our authentication service. What can we do to improve? We will further analyze the root cause of the underlying issue and improve our automated testing procedures to prevent similar incidents from happening in the future. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with the Branding Service has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with the Branding Service has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with the Branding service. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Degraded Performance of the DRACOON Cloud"
Last updateWe experienced an issue with the DRACOON Cloud on 2024-01-11 12:00 - 12:20. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? Our DRACOON Cloud had degraded performance during the incident window, which resulted in occasional errors for users. Why did this happen? There was some increased load on our backend systems caused by an error in one of the components. What did we do? We were able to deploy a fix and therefore stabilize the system. What can we do to improve? We will further analyze on what exactly the reason for the errors was and fix the underlying problem. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with the DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with the DRACOON Cloud has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with the DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Degraded Performance of the DRACOON Cloud"
Last updateWe experienced an issue with the DRACOON Cloud on 2024-01-09 12:30 - 13:20. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? Our DRACOON Cloud had degraded performance during the incident window, which resulted in occasional errors for users. Why did this happen? There was some increased load on our backend systems caused by an error in one of the components. What did we do? We were able to deploy a fix and therefore stabilize the system. What can we do to improve? We will further analyze on what exactly the reason for the errors was and fix the underlying problem. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with the DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with the DRACOON Cloud has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Degraded Performance of the Email Service"
Last updateWe experienced an issue with the Email Service on 2023-12-14 13:30 - 15:30. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? There was an issue with our Email Service which caused too many emails to be sent. Why did this happen? The issue was caused by a short outage of the DRACOON Cloud just prior to the incident window. What did we do? The issue was automatically resolved after the issue with the DRACOON Cloud has been resolved. What can we do to improve? We will further analyze on what exactly the reason for the error was and fix the underlying problem. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with the Email Service has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
We are currently investigating an issue with the Email Service. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Outage of DRACOON cloud"
Last updateWe experienced an issue with the DRACOON Cloud on 2023-12-14 13:15 - 13:22. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? Our DRACOON Cloud was unreachable for a short duration during the incident window. Why did this happen? One of our production servers experienced an issue and was therefore unreachable for a short duration during the incident window. What did we do? We immediately restarted the affected server. What can we do to improve? We will further analyze on what exactly the reason for the error was and fix the underlying problem. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with our DRACOON cloud service has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with our DRACOON cloud service has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with our DRACOON cloud service. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Degraded Performance of the API"
Last updateWe experienced an issue with the DRACOON Core on 2023-12-11 10:00 - 12:00. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? Our DRACOON Core had degraded performance during the incident window, which resulted in occasional internal server errors. Why did this happen? There was some increased load on our backend systems, which was caused by resource expensive errors. What did we do? We were able to temporarily block any further occurrences of the error. What can we do to improve? We will further analyze on what exactly the reason for the errors was and fix the underlying problem. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with the API has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with the API has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We have identified the issue with the API. Our engineers are working on a resolution and we are confident that we will have a fix in place soon. We will provide more information and updates as soon as they become available.
We are currently investigating an issue with the API. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Full Outage of DRACOON Cloud"
Last updateWe experienced an issue with the DRACOON Core on 2023-12-08 12:00 - 15:00. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? Our DRACOON Core had degraded performance during the incident window, which resulted in occasional internal server errors. Why did this happen? There was some increased load on our backend systems, which was caused by resource expensive errors. What did we do? We were able to temporarily block any further occurrences of the error. What can we do to improve? We will further analyze on what exactly the reason for the errors was and fix the underlying problem. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with the API has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with the API has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We have identified the issue with the API. Our engineers are working on a resolution and we are confident that we will have a fix in place soon. We will provide more information and updates as soon as they become available.
We are currently investigating an issue with the DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Partial Outage of Login Functionality"
Last updateWe experienced an issue with the Login Functionality on 2023-11-30 08:00 - 15:15. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. **What happened?** One of our main components has been updated, which resulted in customers using Microsoft OpenID Login being unable to login. **Why did this happen?** The Microsoft OpenID provider, unlike other OpenID providers, does not provide certain information, which our component was relying on. This caused the login workflow to fail, when Microsoft OpenID Login was used. **What did we do?** Upon discovery, we immediately worked on a solution to provide a hotfix for the affected component by assuming a default for the piece of information our component was relying on. **What can we do to improve?** We will extend our testing efforts in order to prevent similar issues from arising in the future. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with the Login Functionality has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with the Login Functionality has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We have identified the issue with the Login Functionality. Our engineers are working on a resolution and we are confident that we will have a fix in place soon. We will provide more information and updates as soon as they become available. Only customers using Microsoft OpenID Login are affected.
We are currently investigating an issue with the Login Functionality. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Partial Outage of DRACOON Cloud"
Last updateThe issue with DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with DRACOON Cloud has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We are currently investigating an issue with DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Degraded performance of DRACOON Cloud"
Last updateWe experienced an issue with the DRACOON cloud on 2023-11-10 09:27 - 10:24. Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. **What happened?** In order to fix an unrelated problem and improve performance a change has been implemented to some of our components, which resulted in 5xx errors and the experienced cloud outage. **Why did this happen?** The implemented change caused additional services to perform retries in case of an error. This resulted in some of the main components becoming overloaded and therefore resulting in 5xx errors. **What did we do?** We reverted the changes as soon as we realized there were problems. **What can we do to improve?** To prevent this from happening in the future, retries will only be enabled for our main components. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.
The issue with our DRACOON Cloud has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
The issue with our DRACOON Cloud has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
We have identified the issue with our DRACOON Cloud services. Our engineers are working on a resolution and we are confident that we will have a fix in place soon. We will provide more information and updates as soon as they become available.
We are currently investigating an issue with our DRACOON Cloud. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Virus Protection Outage"
Last updateThe issue with virus protection has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
Our team is still actively working to resolve the issue with Virus Protection. We apologize for any inconvenience this may cause and appreciate your patience. We will provide more information and updates as soon as they become available.
We are currently investigating an issue with our Virus Protection. Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
Report: "Problem with document export"
Last updateThe issue with DATEV has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
Customers with the current DATEV update may experience problems when exporting documents via the DRACOON for DATEV interface. A temporary solution is available and we are working in close cooperation with DATEV on a permanent solution.