Historical record of incidents for Dubber
Report: "US Dubber Portal Recordings Delayed Postings"
Last updateWe are aware of a slow down or degraded performance in the postings of call recordings to user accounts and are investigating at this time. There is no evidence that this is impacting call recording itself it is just a delayed posting of recordings at this time. We will update with further information as we investigate this.
Report: "Dubber Portal Maintenance - UK Region"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Dubber will be performing some required maintenance during this time to improve performance, stability and security of our platform. During this time there may be some delays in recordings appearing in the portal. Importantly calls will continue to be captured during this time.
Report: "Dubber Portal Maintenance - CA"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Dubber will be performing maintenance during this time to improve performance, stability and security of our platform. During this time, users may not be able to access to the Dubber portal and there will be delays in recordings appearing in the portal. Importantly calls will continue to be captured during this time.
Report: "MS Teams - Intermittent Call Initiation Issues"
Last updateAfter investigation, and liaising with Microsoft, Microsoft confirmed they experienced a power event in the North Europe region, which impacted their services in this region. Microsoft have confirmed that power and services were fully restored.
This incident is now resolved and MS Teams calls are now initiating as expected.
We are continuing to investigate this issue.
Dubber is aware of an issue intermittently impacting MS Teams call initiation which we are currently investigating. Please note recording is not impacted.
Report: "MS Teams - Intermittent Call Initiation Issues"
Last updateThis incident is now resolved and MS Teams calls are now initiating as expected.
We are continuing to investigate the issue.
We are continuing to investigate the issue.
Dubber is aware of an issue intermittently impacting MS Teams call initiation which we are currently investigating. Please note recording is not impacted.
Report: "Incident - Portal SSO Login Issue"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
Dubber is aware of an SSO issue impacting portal access which we're currently investigating. Please note recording of calls is not impacted.
Report: "Incident impacting the availability of call playback"
Last updateWe have resolved the issue with playback and download of recordings. We will continue to monitor this accordingly. No recordings were impacted as previously reported and normal playback and download should be restored.
We have identified the issue impacting the playback and downloading of recordings. This issue does not impact call recordings themselves. This issue is being addressed and we will update regularly until resolved.
We are aware that some customers are experiencing issues with playing calls back in the in the Dubber portal. Please be assured that this incident is impacting call playback only and calls are being recorded. All calls will be available for playback when this incident is resolved. We are working to resolve the incident as soon as possible and will provide regular updates.
Report: "Dubber on MS Teams - Call recording delays US and CA regions"
Last updateWe have resolved the incident with call recordings now appearing in the portal within usual timeframes. If you continue to experience issues please contact Dubber Support.
Dubber is investigating delays of call recordings appearing in the Dubber portal in our US and CA regions. We are continuing to capture recordings.
Report: "Incident - Dubber on Microsoft Teams EU & UK1 Regions"
Last updateDubber has restored service with calls appearing in the Dubber portal as expected. If you continue to experience service difficulties please contact Dubber support for assistance.
We are aware that some customers using Dubber on Microsoft Teams are experiencing delays in accessing recordings. Please be assured that calls are being recorded and all recordings will be available once the incident is resolved. We are working to resolve the incident as soon as possible and will provide regular updates.
Report: "MS Teams Incident - US region"
Last updateOur monitoring is indicating the incident is resolved. We are continuing to monitor systems.
The team are continuing to investigate with the highest priority.
We have taken action to address the incident and currently monitoring the systems.
We are continuing to investigate the issue. This has been escalated and the required engineering teams are enguaged.
We have had reports of call recording issues between MS Teams and Dubber. We are exploring this issue with priority and will work to resolve this in the shortest time possible.
Report: "Dubber Portal Access Incident"
Last updateThis incident has been resolved.
We are aware that some customers are experiencing issues accessing the Dubber portal. Please be assured that this incident is impacting portal access only and that calls are being recorded. We are working to resolve the incident as soon as possible and will provide regular updates.
Report: "Payment Services Incident"
Last updateCorrective actions as been completed and we believed the incident is resolved. We are continuing to monitor verify payments are working as expected.
We are continuing to investigate this issue.
We are investigating an incident that is impacting the Payment Services for some customer. We are working to resolve the incident as soon as possible and will provide regular updates.
Report: "Incident impacting call playback"
Last updateThis incident is now resolved. Playback is now operational.
We are aware that some customers are experiencing an issue with the playback of recordings in the Dubber portal. Please be assured that this incident is impacting call playback only and calls are being recorded. All calls will be available for playback when this incident is resolved. We are working to resolve the incident as soon as possible and will provide regular updates.
Report: "Dubber Portal SSO Access - AU, JP, SG"
Last updateDubber Engineering has resolved the problem. Users can access the portal through single sign on (SSO).
We are aware that some customers are experiencing issues accessing the Dubber portal when using single sign on. Please be assured that this incident is impacting portal access only. Recording is not impacted by this incident. We are working to resolve the incident as soon as possible and will provide regular updates.
Report: "Dubber API Connectivity Issues"
Last updateOur supplier has now classified this issue as fully resolved.
Our supplier identified the root cause of the issue to be an invalid DNS Start Of Authority (SOA), and applied mitigating action at ~14:06 UTC (Oct 01, 2024). The changes have mostly propagated and the issue is resolved for most customers, however the exact recovery time will vary depending on client's DNS provider, and how the cache is managed.
One of our suppliers has informed us of a service degrading issue, which resulted in an impact to some customers ability to hit Dubber's API service. The supplier has informed us that the root cause has been identified, and a mitigation has been put in place. The issue is therefore believed to be resolved, however Dubber are continuing to monitor. Call recording remains fully functional and is unaffected.
Report: "Delays in the availability of recordings for playback"
Last updateThis incident has been resolved.
Dubber acknowledges that some of our US Dubber Portal customers are experiencing delays in call recordings ingestion. This incident is impacting call processing only and calls are still being recorded. All calls will be available for playback when this incident is resolved. We are working to resolve the incident as soon as possible and will provide regular updates.
Dubber is working hard to resolve an issue that some customers are experiencing when trying to access their recordings. Though there is a delay in call recordings being available for playback, this incident is only affecting processing as call are being recorded. Once this issue is resolved, all calls will be available for playback. We are working to resolve the incident as soon as possible and will provide regular updates.
The cause of the incident has been identified and corrective action is being completed. Delayed call recordings are being processed into the portal and will be available for playback in the coming hours. We will continue to provide regular updates.
We are aware that some customers are experiencing delays in call recordings being available for playback in the Dubber portal. Please be assured that this incident is impacting call processing only and calls are being recorded. All calls will be available for playback when this incident is resolved. We estimate that this issue will be resolved this afternoon. We will continue to provide regular updates until this issue is solved.
We are aware that some customers are experiencing delays in call recordings being available for playback in the Dubber portal. As we continue to work on this issue, be assured that this incident is impacting call processing only and calls are being recorded. All calls will be available for playback when this incident is resolved. We are working to resolve the incident as soon as possible and will provide regular updates.
We are aware that some customers are experiencing delays in call recordings being available for playback in the Dubber portal. Please be assured that this incident is impacting call processing only and calls are being recorded. All calls will be available for playback when this incident is resolved. We are working to resolve the incident as soon as possible and will provide regular updates.
Report: "UK Portal Login Issues"
Last updateThe issue has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and Dubber is working on resolution.
Some customers have reported issues with logging in to the UK portal. Dubber is currently investigating. There is no impact on the capture of call recordings.
Report: "Dubber US portal Incident - Intermittent login errors and latency"
Last updateThis incident has now been resolved
A fix has been implemented and we are monitoring the performance. There will be delays in recordings processing into the portal.
Incident Update: Portal login and load times are improving and the recording backlog is decreasing. Incident Impact: Portal load times, delays in recordings appearing in the portal and playback of recordings
Incident Impact: Portal load times, intermittent errors when logging in and delays in recordings appearing in the portal
Report: "Global Dubber Issues with MS Teams"
Last updateThe incident has been resolved and all services are back online
A fix has been implemented and we are monitoring the results.
The team has found the root cause and is in the process of restoring service to all regions
Dubber is experiencing technical issues with MS Teams recording and are investigating the root cause
Report: "Microsoft Teams Incident - Adding New Users"
Last updateWe have found that users began recording after some time due to delays in the security group settings applying to newly added users in customers Microsoft tenants.
We are aware that some Microsoft Teams customers are experiencing an issue where new users added to call recording security groups are not being recorded. We are working with Microsoft to determine the cause and work on a resolution. While this is being investigated, we recommend that you do not make any changes to tenant or user recording settings unless advised by our support team.
Report: "Microsoft Teams - Post Processing Delays"
Last updateThis incident has now been resolved.
We are continuing to investigate this issue.
The issue has been identified and a resolution is currently being worked on.
Dubber have been alerted to an issue causing delays with the post processing of recorded Microsoft Teams calls, and are currently investigating. Call Recording is unaffected.
Report: "Intermittent Portal Login"
Last updateThis incident has now been resolved.
Dubber have detected an intermittent issue with portal login, and are currently investigating. Recording is not impacted.
Report: "Dubber Portal incident - Data Exports"
Last updateA fix has been released to address the issue with the Data Exporter. The fix has been tested and the service has been restored.
The team is working towards a resolution for this issue the next update will be in 2 hours
The team is working towards a resolution for this issue the next update will be in 4 hours
The team is working towards a resolution for this issue the next update will be in 4 hours
We are aware that customers are experiencing issues exporting data from the Dubber portal. We are working to rectify this issue as soon as possible. Next Update will be in 12 hours
Report: "US and CA Dubber Portal incident - Portal Unavailable"
Last updateThis incident has been resolved.
We are aware that some customers are experiencing issues accessing and using the Dubber portal. We are working to identify the cause of the problem and resolve it as soon as possible.
Report: "Dubber on Webex incident"
Last updateThe incident has been resolved. Services restored.
We are aware that some Webex Calling customers in the EU region are experiencing issues with recording of calls in Dubber. Dubber and Cisco are working a resolution as a priority.
Report: "Portal Call Delays"
Last updateThis issue has now been resolved.
We are aware that some customers are experiencing delays in recordings appearing in the Dubber portal. We are working to identify the cause of the problem and resolve it as soon as possible. All recordings are being captured as expected without issue.
Report: "New MS Teams recordings delayed in appearing in the Portal"
Last updateThe issue has now been resolved. New MS Teams recordings are no longer delayed in appearing in customer portals.
We have identified a delay in new MS Teams recordings appearing in some customer portals. The issue is currently under investigation. Call recording is unaffected and is working as expected.
Report: "Dubber Portal incident - AU, JP, SG & SBOX Search Functionality"
Last updateA fix has now been implemented, and the issue has been confirmed as resolved.
The issue has been identified and a fix is being implemented.
We are continuing to investigate this issue.
We are aware that some customers are experiencing issues with the search functionality in the Dubber Portal. We are working to identify the cause of the problem and resolve it as soon as possible. Please note recording of calls is not impacted.
Report: "Incident - Dubber on Microsoft Teams - UK"
Last updateWe are aware that some customers using Dubber on Microsoft Teams Capture experienced some problems using the service this morning. We have identified the root cause and resolved the problem.
Report: "Dubber Portal incident"
Last updateThis incident has been resolved.
We are aware that some customers are experiencing delays in recordings appearing in the Dubber portal. At this stage we believe that all recordings have been captured. We are working to identify the cause of the problem and resolve it as soon as possible.
We are aware that some customers are experiencing delays in recordings appearing in the Dubber portal. At this stage we believe that all recordings have been captured. We are working to identify the cause of the problem and resolve it as soon as possible.
We are aware that some customers are experiencing issues accessing and using the Dubber portal. We are working to identify the cause of the problem and resolve it as soon as possible.
Report: "Dubber Portal incident - US"
Last updateThis incident has been resolved.
Users can now access the Dubber portal. There is a delay in processing recordings into the portal which is expected to be cleared over the next few hours.
We are aware that some customers are experiencing issues accessing and using the Dubber portal. We are working to identify the cause of the problem and resolve it as soon as possible. At this stage this is not impacting capturing recordings.
Report: "Dubber Portal incident"
Last updateThis incident has been resolved.
We are aware that some customers are experiencing issues accessing and using the Dubber portal. We are working to identify the cause of the problem and resolve it as soon as possible.
Report: "Dubber Portal incident"
Last updateAll of the previously delayed recordings have now been processed.
Some recordings continue to be processed at this time.
We have restored access to the Dubber portal. Users can now log in. Some recordings are still processing and will appear in the portal over the next few hours.
We are aware that some customers are experiencing issues accessing and using the Dubber portal. We are working to identify the cause of the problem and resolve it as soon as possible. Recordings are not impacted by this incident.
Report: "Dubber Portal incident - AU Region"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented.
We are aware that some customers are experiencing issues accessing and using the Dubber portal. We are working to identify the cause of the problem and resolve it as soon as possible. Please note recordings continue to be captured.
Report: "Incident - Dubber Portal Delays - AU Region"
Last updateThis incident has been resolved.
We are aware that some customers are experiencing delays in recordings appearing in the Dubber portal. At this stage we believe that all recordings have been captured. We are working to identify the cause of the problem and resolve it as soon as possible.
Report: "Incident -Dubber Portal Delays - Uk1 and EU Region"
Last updateThis incident has been resolved.
The remaining records in the backlog have taken longer than expected to be processed, and have not cleared yet. Some customers may still experience a delay in records appearing.
The majority of the backlog has cleared, however some records continue to be processed at this time.
The root cause has been identified and resolved. There was no impact to the capture of call recordings. There is a backlog of recordings currently being processed following the root cause resolution, which may take ~2 hours to fully process.
The issue has been identified and a fix is being implemented.
We are aware that some customers in the Uk1 and EU region are experiencing delays in Microsoft Teams recordings appearing in the Dubber portal. At this stage, we believe that all recordings have been captured. We are working to identify the cause of the problem and resolve it as soon as possible.
Report: "Incident - Dubber Portal Delays - AU Region"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented.
We are aware that some customers in the AU region are experiencing delays in recordings appearing in the Dubber portal. At this stage we believe that all recordings have been captured. We are working to identify the cause of the problem and resolve it as soon as possible.
Report: "Incident - Dubber Portal Delays"
Last updateThis incident has been resolved.
A fix has been implemented and the number of delayed recordings is dropping. We are continuing to monitor the performance of the platform.
We are aware that some customers are experiencing delays in recordings appearing in the Dubber portal. At this stage we believe that all recordings have been captured. We are working to identify the cause of the problem and resolve it as soon as possible.
Report: "Dubber Portal incident"
Last updateThis incident has been resolved.
We are continuing to work on a fix for this issue.
The issue has been identified and a fix is being worked on. Some users may still be able to access the portal however it may be slow to load.
We are continuing to investigate this issue.
We are aware that some customers are experiencing issues accessing and using the Dubber portal. We are working to identify the cause of the problem and resolve it as soon as possible.
Report: "Incident - Dubber Portal Delays"
Last updateThis incident has been resolved.
All new recordings are being processed as normal. A backlog of delayed recordings is being processed, and it may take ~3 hours for this backlog to be fully cleared.
Remedial action is still in progress and delayed recordings continue to be processed.
Delayed recordings are being processed and will begin to be visible in the portal.
The root cause has been identified and remedial action is in progress. All recordings are being captured, but will be delayed in appearing in the portal until remedial action is complete.
The issue has been identified and a fix is being implemented.
We are aware that some customers are experiencing delays in recordings appearing in the Dubber portal. At this stage we believe that all recordings have been captured. We are working to identify the cause of the problem and resolve it as soon as possible.
Report: "Dubber Portal incident"
Last updateThis incident has been resolved.
We are aware that some customers are experiencing issues accessing and using the Dubber portal. We are working to identify the cause of the problem and resolve it as soon as possible.
Report: "Incident - Dubber on Microsoft Teams"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented.
We are aware that some customers using Dubber on Microsoft Teams are experiencing delays in recordings appearing in the Dubber portal. We are working to identify the cause and resolve it as soon as possible.
Report: "Incident - Dubber Portal Delays"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are aware that some customers are experiencing delays in recordings appearing in the Dubber portal. At this stage we believe that all recordings have been captured. We are working to identify the cause of the problem and resolve it as soon as possible.
Report: "Incident - Dubber on Microsoft Teams AU Region"
Last updateThis incident has been resolved.
We are aware that some customers using Dubber on Microsoft Teams capture were experiencing problems viewing recordings in the Dubber portal. We have been able to restore service with recordings gradually appearing in the portal. All recordings are expected to be visible in the portal within the next few hours.
Report: "Incident - Dubber Portal Delays v1.0"
Last updateThis incident has been resolved.
The root cause has been identified, and work is underway to resolve the issue. Call recording is unaffected, and all calls are recording as expected. The regions impacted by the delay in recordings appearing in the Dubber portal are Canada (CA), and United States (US). All other regions are not impacted.
We are continuing to work on a fix for this issue.
We are aware that some customers are experiencing delays in recordings appearing in the Dubber portal. At this stage we believe that all recordings have been captured. We are working to identify the cause of the problem and resolve it as soon as possible.
Report: "This is an example incident"
Last updateWhen your product or service isn’t functioning as expected, let your customers know by creating an incident. Communicate early, even if you don’t know exactly what’s going on.
Empathize with those affected and let them know everything is operating as normal.
As you continue to work through the incident, update your customers frequently.
Let your users know once a fix is in place, and keep communication clear and precise.
Report: "Dummy Incident"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
We are investigating how a dummy incident occurred.