Historical record of incidents for Demodesk
Report: "Microsoft Cloud issues delaying recording summary processing"
Last updateThis incident has been resolved.
A Microsoft Azure Cloud issue is impacting processing times of recording summaries. The summaries will become available after the Microsoft issue gets resolved. No other functionalities have been impacted.
Report: "Microsoft Cloud issues delaying recording summary processing"
Last updateThis incident has been resolved.
We are continuing to work on a fix for this issue.
A Microsoft Azure Cloud issue is impacting processing times of recording summaries. The summaries will become available after the Microsoft issue gets resolved. No other functionalities have been impacted.
Report: "Interrupted Demodesk meetings"
Last updateA number of Demodesk meetings (both Meeting and Coaching&AI) experienced interruptions between 10am and 11am CEST today. Recordings of those meetings are available, however they may miss some moments during the interruption.
Report: "GDPR compliant recording issues"
Last updateVery few meetings that had the feature "GDPR compliant recording" enabled, faced a problem where participants could not submit the form to provide their consent. This was a UI defect that led a popup window to stay open after clicking "accept". Besides the misbehavior of the model, recordings did start correctly as soon as all participants gave their consent. The UI defect was fixed by rolling back the faulty changes.
Report: "Google has an active incident for their Calendar API"
Last updateThis incident has been resolved.
Google Calendar is having issues. Demodesk functionalities that read or write into Google Calendars might not work as expected. Google shares status updates and details on their status page here: https://www.google.com/appsstatus/dashboard/incidents/7uJZ5F1Uy4n1n74iMacQ
Report: "Increased loading time"
Last updateFor a period of a few minutes, Demodesk experienced significantly increased loading times across the whole application.
Report: "Increased loading time"
Last updateThis incident has been resolved.
We have fixed the issue and are currently monitoring the systems.
We currently have an incident that increases loading times on all Demodesk functionalities – we're investigating the cause.
Report: "Degraded system performance as our DNS and CDN Cloudflare is facing issues"
Last updateCloudflare resolved their incident and Demodesk is fully back to normal operation. Details on their outage can be found here: https://www.cloudflarestatus.com/incidents/xvs51y9qs9dj
We mitigated the major impact and the core functionality our system is restored. Since Cloudflare is widely spread we also see errors in our communication with third party integrations (eg. Hubspot).
We see issues with various parts of the system. The root cause is an incident of Cloudflare (https://www.cloudflarestatus.com/).
Report: "Slow and unresponsive application"
Last updateOur API experienced high latencies which made it hard to use the application. Over a period of ~10 minutes, it was slow to us and for ~5 minutes most requests from the frontend timed out. We quickly identified the issue after the application was unresponsive and we were able to restore service within some minutes.
Report: "Increased meeting start times"
Last updateThis incident has been resolved.
We are currently looking into increased meeting start times that affect a minority of meetings (<1%).
Report: "Twilio outage"
Last updateThis incident has been resolved.
Audio/video is operation again and we're continuing to monitor the situation.
It's currently not possible to start meetings, as one of our service providers for audio/video communication has an outage. https://status.twilio.com/ We're working on a workaround and trying to resolve the situation as quickly as possible.
Report: "Delays in parts of the system"
Last updateThis incident has been resolved.
A fix has been implemented and we consider the issue to be solved but keep monitoring the results. The expected impact is that CRM synchronization was delayed or even skipped in some rare cases.
We identified an issue that causes certain functionality to be delayed (eg. syncing with CRMs). Demo starts should not be affected by this. We're working on resolving it.
Report: "Delays in starting recordings and meetings"
Last updateThis incident has been resolved.
Due to issue with a third party provider, we are experiencing delays in recordings as well as a minor subset of meetings starting times.
Report: "Google SSO login failures"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results
We're experiencing disruptions related to the Google SSO functionality. The issue has been identified and a fix will be deployed and fully functional soon.
Report: "Recordings not accessible"
Last updateThis incident has been resolved.
DigitalOcean has fixed the issue, we're now going through all affected recordings to verify they're accessible.
Our storage provider DigitalOcean has an outage, slowing down the availability of our recordings. We are working on a fix. (DigitalOcean ticket for reference: https://status.digitalocean.com/incidents/dw9913v02mq7)
Report: "Errors with booking for Microsoft Office users"
Last updateMicrosoft Office is currently facing internal issues affecting your Demodesk scheduling and booking pages. We will update you immediately once it is resolved. Google Gsuite customers are not affected by this. You can hold meetings that are already scheduled.
Report: "Google Cloud partial network outage"
Last updateGoogle Cloud reports increased network latencies, according to our monitoring the situation was resolved 17:20 UTC. Google status tracker for details: https://status.cloud.google.com/incident/cloud-networking/21006
Report: "Some recordings are currently unaccessible"
Last updateThis incident has been resolved.
One of our storage cloud providers is having an issue with serving files. This means that viewing recordings of past meetings might not be possible currently. The recordings of running demos are not affected.
Report: "Delayed demo starts for some customers"
Last updateThis incident has been resolved and we identified specific ways to prevent this from happening again which will be implemented.
We identified issues in our networking configuration and were able to fix the issues. We're currently monitoring the configuration change and identify the next steps to prevent this error in the future.
We are currently investigating this issue.
Report: "Playbook previews not loading"
Last updateDigitalOcean has resolved the issue.
Our service provider DigitalOcean has identified an issue with serving files: https://status.digitalocean.com/incidents/n14x2vg77hgq This is currently preventing playbook previews to be loaded. It has no impact on holding your meetings.
Report: "Slow responses and timeouts for 2-5 minutes"
Last updateDuring a planned deployment we faced slow responses and timeouts for a small percentage of users. Besides "Demodesk feeling slow" for some users, the symptoms included misbehavior or delays of functionality (like mute/unmute, slide switches, meeting starts, ...). The issue was resolved within 2 to 5 minutes and we're implementing additional safeguards to prevent this situation in the future.
Report: "Microsoft Office365 outage affects some Demodesk users"
Last updateMicrosoft resolved their issues. For some users, it was already resolved earlier.
Microsoft reports having issues with various Office365 services. We see increased error rates related to booking for Demodesk users with Office365 integrations. It might also affect the "Sign in with Office 365" feature of Demodesk and outgoing emails. Microsoft is tracking their status here: https://admin.microsoft.com/servicestatus
Report: "Delayed demo starts for some customers"
Last updateWe faced an issue in a regional cluster, which led to delays when starting a meeting for some customers. The issue was quickly resolved by shifting affected customers to a different cluster in the same region while we were investigating the root cause. The root cause was later identified and a fix implemented.
Report: "A few users experience a white page"
Last updateThis issue has been resolved.
Resolution: Please press CTRL+F5 in your browser to resolve this issue. Explanation: There was a time period of 5 minutes where users that freshly accessed Demodesk couldn't load a static file. This 404 request was cached inside the browser. The root cause was a misconfiguration of the update strategy of our static file servers.
Report: "Screensharing for running meetings is not working"
Last updateScreen sharing API is back up in all regions.
A fix has been implemented and we are monitoring the results.
We are continuing to work on a fix for this issue.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We're working on a workaround