Mural

Is Mural Down Right Now? Check if there is a current outage ongoing.

Mural is currently Operational

Last checked from Mural's official status page

Historical record of incidents for Mural

Report: "Mural Exports"

Last update
postmortem

**Incident Summary** On April 28, 2025, beginning at approximately 19:00 CET, Mural users experienced an inability to export murals in PDF and PNG formats. Our team declared an official incident at 20:35 CET and resolved the issue at 21:35 CET by releasing a hotfix. ‌ **Timeline** * 19:00 CET: A scheduled software release was deployed * Shortly after 19:00 CET: Customers began to experience issues exporting murals and contacting our Customer Support team * 20:35 CET: Our team declared an incident and began active investigation * 21:35 CET: The issue was identified and a software patch was deployed, restoring full export functionality * 21:50 CET: We had confirmation from affected users that their exports were working correctly again, and closed the incident ‌ **Root Cause** The issue with exports was traced to a defect introduced in our 19:00 CET software release. An unintentional change in the process of rendering mural content into PDFs resulted in exports failing. ‌ **What We’re Doing Next** * Automated monitoring was in place for detecting these issues, but we have identified improvements we can make here * Render and export functionality testing is being enhanced during deployments We understand that the ability to export your murals is critical to your workflow. We sincerely apologize for any disruption this incident caused. Thank you for your patience and for trusting Mural. If you have further questions or concerns, please reach out to our support team at [support@mural.co](mailto:support@mural.co).

resolved

The fix we implemented earlier has been successful in resolving the issue with exports and full service has been resolved. We apologize for the inconvenience this interruption caused, and will be conducting a full review to avoid a repeat in the future.

monitoring

We've implemented a fix that should resolve the issue with mural exports. We're monitoring the results to make sure this has the intended effect and will update this message as soon as we've been able to confirm this.

investigating

Attempting to export a mural in PDF or PNG format currently results in an error. We're investigating the issue and will restore normal service as quickly as possible. In the meantime and as a possible workaround, exports in HTML or CSV format are continuing to work as expected. Please check our status page for the most up-to-date info 👉 status.mural.co/

Report: "Mural notification emails"

Last update
resolved

The fix we implemented earlier has been successful in resolving the issue and email notifications are working as expected. We apologize for the inconvenience this issue caused, and will be conducting a full review to avoid a repeat in the future.

monitoring

A fix has been implemented and we are monitoring the results.

identified

Our team is continuing to work on a resolution for the ongoing email notification issue. We will post further updates shortly. In the meanwhile, please refer to our status page here for further live updates: http://status.mural.co/

identified

We are continuing to work on a fix for this issue.

identified

The issue has been identified and a fix is being implemented.

investigating

We have received reports that automated notification emails from Mural are not being sent. We're investigating and will provide updates as our teams work to resolve this as quickly as possible. Please check our status page for the most up-to-date info: status.mural.co

Report: "Mural exports issue"

Last update
resolved

The fix we implemented earlier has been successful in resolving the issue with exports and full service has been resumed. We apologize for the inconvenience this interruption caused, and will be conducting a full review to avoid a repeat in the future.

monitoring

We've implemented a fix that resolves the issue with exports. We're monitoring the results to make sure this has the intended effect and will update this message within the next hour once we've confirmed exports are working as expected.

identified

The cause of the exports issue has been identified and our team is working on fixing it. We'll provide an update as soon as there's more information available, or by 21:00 UTC at the latest.

investigating

We have received reports of an issue exporting murals in .pdf and .png formats. We're investigating the issue and will provide an update as soon as we have further details. Please check our status page for the most up-to-date info: status.mural.co

Report: "Mural's AI clustering service is momentarily non-functional (Enterprise)"

Last update
resolved

The additional enhancements we were working on have been successfully deployed. Our Mural AI is now performing as expected and normal service has been resumed. We apologize for the inconvenience this interruption caused, and will be conducting a full review to avoid a repeat in the future.

monitoring

The temporary fix we implemented for Mural's AI clustering service remains stable, however some functions are performing slower than intended. Our engineers have identified additional enhancements that will restore full service and performance, and we'll update this message as the work progresses. We appreciate your patience.

monitoring

The temporary fix we implemented for Mural's AI clustering service remains stable, however some functions are performing slower than intended. Our engineers have identified additional enhancements that will restore full service and performance, and we'll update this message as the work progresses. We appreciate your patience.

monitoring

We are continuing to monitor for further issues.

monitoring

A fix has been implemented and we are monitoring the results.

identified

Mural's AI clustering service is currently unavailable as we've discovered the one of our internal services is not running. This only affects our Enterprise customers, as it's a feature only available with that plan. We are working to apply a fix as soon as possible. We'll provide an update as soon as there's more information available.

Report: "Users getting prompted to leave the network to continue"

Last update
postmortem

**What happened:** At 17:10 CET on March 6th, 2024, we updated the IP allowlisting settings for one of our Enterprise customers. The list of IP addresses contained ranges used by a 3rd party cloud security provider, which prevented a subset of customers from accessing Mural. We started to receive reports of access issues and immediately engaged our incident task force to investigate. The incorrect IP address configuration was quickly identified as the cause of the access issues. We rolled back the change and full access was restored at 17:50 CET. ‌ **What we’ve done to avoid this happening again:** We have implemented additional checks on IP address restrictions, whilst our engineers work on product enhancements to prevent this issue from re-occurring.

resolved

This incident has been resolved.

monitoring

We have received several notifications that users were prompted to leave the network in order to continue, causing them to be automatically signed out from the Mural app. We have now detected the root cause and applied a fix, so we are now monitoring its effects.

Report: "Users are unable to sign In to Mural"

Last update
resolved

This incident has been resolved.

monitoring

We have implemented a change to correct the access issues users were experiencing. This appears to have resolved the issue. We are monitoring the results to ensure the system remains stable.

investigating

Users are currently unable to sign in to Mural. We're investigating the issue and will restore regular service ASAP. Please check our status page for the most up-to-date info 👉 status.mural.co/

Report: "Users are unable to consistently sign In to Mural"

Last update
resolved

The issue has been resolved and we have confirmed error messages have ceased to be displayed on the Mural application. We apologize for any inconveniences caused and appreciate your patience while we implemented a fix.

monitoring

We have identified the root cause of this issue and have already implemented a fix which seems to have stabilized the Mural application, as error messages are no longer being displayed. We will continue to monitor the app's behavior during the next hour to ensure our service is effectively restored. Please check our status page for the most up-to-date info: status.mural.co/

investigating

Users are experiencing an inconsistent experience signing in to Mural, resulting in different error messages being displayed or the Mural application failing to load. We know this is disrupting your use of Mural. We're investigating the issue and will restore regular service ASAP. Please check our status page for the most up-to-date info: status.mural.co/

Report: "Mural Notifications Delay"

Last update
resolved

We have determined that the change implemented previously has successfully resolved this issue, therefore restoring Mural's service to fully operational. We appreciate your patience while we were working on finding a solution and apologize for any inconveniences.

monitoring

We've implemented a change that should resolve the issue. We're monitoring the results of this change and will update this message by 22:45 to confirm this is working as expected.

investigating

We are still investigating the delays in sending transactional emails. We will post the next update here as soon as there is progress, or by 22:20 CET at the latest. Please check our status page for the most up-to-date info 👉 status.mural.co/

investigating

We are still investigating the delays in sending transactional emails. We will post the next update here as soon as there is progress, or by 21:20 CET at the latest. Please check our status page for the most up-to-date info 👉 status.mural.co/

investigating

We're experiencing a service disruption that is causing notifications, including password reset emails, to not be delivered. We're investigating the issue and will restore regular service ASAP. Please check our status page for the most up-to-date info 👉 status.mural.co/

Report: "Mural collaboration issue - right-clicking on objects within the canvas causes Mural to display a blank screen"

Last update
resolved

We have confirmed right-clicking on a Mural canvas no longer causes a blank page, and therefore consider this issue to be resolved. We apologize once again for any inconveniences caused and thank you for your patience while we reached a resolution.

monitoring

We have identified the root cause of this issue and have already implemented a fix. We will continue to monitor its progress to make sure our resolution has been effective. We appreciate your patience. Please check our status page for the most up-to-date info: status.mural.co/

investigating

Some users are currently experiencing issues with murals crashing or displaying a blank screen when they right-click on an object within the canvas. We are currently investigating this behavior and will do our best to restore our regular service as soon as possible. We apologize for any inconveniences caused. Please check our status page for the most up-to-date info: status.mural.co/

Report: "Some users are unable to sign in to Mural"

Last update
resolved

The fix we implemented earlier has been successful in resolving the issue and full service has been resolved. We apologize for the inconvenience this interruption caused and thank you for your patience whilst our teams were working on it.

monitoring

We have restarted some services, which appears to have resolved the issue. We're monitoring the results to make sure this has the intended effect and will update this message as soon as we've been able to confirm this.

investigating

Some users are currently experiencing issues signing into Mural. We're investigating the issue and will restore regular service as quickly as possible. Please check our status page for the most up-to-date info: status.mural.co/

Report: "Users are unable to sign In to Mural"

Last update
resolved

Full service has been restored and this incident is now resolved. We apologize for the inconvenience this interruption caused, and will be conducting a full review to avoid a repeat in the future.

monitoring

User are able to log in to Mural and full service has been restored. We are currently monitoring system stability and will update this message as soon as additional details become available.

investigating

Users are currently unable to sign in to Mural. We know this is a major service disruption for everyone. We're investigating the issue and will restore regular service ASAP. Please check our status page for the most up-to-date info 👉 status.mural.co/

Report: "Mural users are unable to log in"

Last update
postmortem

**Summary**:  On Saturday, November 11th at 03:00 UTC, Mural performed scheduled maintenance on our production clusters. Post-migration checks indicated all functions were performing as expected. On Monday, November 13th, some Mural customers reported difficulty logging into the Mural web application. Mural’s incident response team was immediately engaged in troubleshooting these reports. Initial investigations revealed that the platform upgrade over the preceding weekend had incorrect settings for the DNS infrastructure and a key backend application's auto-scaling. This resulted in unstable connections for some users. During the course of this investigation, we also discovered that load balancing improvements for clients with specific network and application configurations altered how the client’s IP address was interpreted by our system, preventing access for such clients.  Our incident response team addressed the auto-scaling configuration, resolving DNS-related issues and restored access for the majority of users. Next, a new load-balancing configuration underwent adjustments and testing to restore stable connections for the previously-impacted users. The total time from when our incident response team started working on this incident, to deploying the final fix, was 9 hours 40 minutes. **What we’ve done to prevent this happening again:** As part of Mural’s post-incident procedure, our engineering teams conducted a thorough review to identify the root cause and outline necessary improvements. 8 separate changes have been identified and will be implemented in the coming weeks. These changes cover monitoring to detect this scenario sooner, enhanced post-migration checks to ensure this scenario and others are included in our use cases and reviewing our migration process to reduce the risks. We apologize for any inconvenience this incident may have caused and sincerely thank your patience whilst we worked through this incident.

resolved

The correction we implemented earlier has been successful in resolving the issue and full service has been resolved. Some users reported connectivity issues after the earlier correction. In all cases this has been solved by clearing browser cache and using the link app.mural.co/bye to clear any previous session data. We apologize for the inconvenience this interruption caused. We will be conducting a full review will publish a root cause analysis in the coming days.

monitoring

The performance degradation issue has been addressed and service has returned to normal. Users can resume logging in and using Mural as normal. We'll continue to monitor the results of our corrections ensure service remains stable, and will publish a full root cause analysis in the coming days.

identified

The issue with logging in to Mural has been largely resolved. Users that were unable to access Mural should be able to log in again. There continues to be an intermittent performance degradation. Our team are investigating and we will continue to update our status page as this develops. Stay up-to-date with the latest info via 👉 status.mural.co

identified

We are continuing to work on a fix for this issue. We appreciate your patience while we resolve this.

identified

We are continuing to work on a fix for this issue. We appreciate your patience while we resolve this.

identified

We are continuing to work on a fix for this issue. We appreciate your patience while we resolve this.

identified

We are continuing to work on a fix for this issue.

identified

The issue has been identified and we are working towards implementing the fix.

investigating

We're experiencing a service disruption that is preventing users from logging in to Mural. We're investigating the issue and will restore regular service as soon as possible. Please check our status page for the most up-to-date info 👉 status.mural.co/

Report: "Image search returns no results within murals"

Last update
resolved

The fix we implemented earlier has been successful in resolving the issue and full service has been resolved. We apologize for the inconvenience this interruption caused, and will be conducting a full review to avoid a repeat in the future.

monitoring

We've implemented a fix that should resolve the issue. We're monitoring the results to make sure this has the intended effect and will update this message as soon as we've been able to confirm this.

identified

Searching for images in the "web" tab currently returns no results. We're investigating the issue and will restore regular service as quickly as possible. As a temporary workaround, users are advised to search for images via their usual search engine, and then upload the images to their mural. Please check our status page for the most up-to-date info: status.mural.co/

Report: "Some icons will not appear when added to a mural"

Last update
resolved

This incident has been resolved.

identified

We are continuing to work on a fix for this issue.

identified

We are continuing to work on a fix for this issue.

identified

We've applied a temporary fix for the problem and icons are now working again.

investigating

When some icons are added to a mural, they appear transparent and will not display. This does not apply to all icons in the library. We are investigating and will restore regular service as soon as possible.

Report: "Invalid signature error when signing in with SSO"

Last update
postmortem

**Summary** On 13th July 2023, we implemented a change to our SAML SSO login flow. This change was released to production at 7pm UTC and we started receiving sporadic reports of login issues that were treated as isolated incidents, as the vast majority of Mural users were able to continue accessing without issues. By 11am UTC on the 14th July, the volume of login issues had increased and we activated our taskforce to investigate the cause. By 11:25 UTC we identified a potential cause of the issue and started preparing a fix. At 11:45 UTC we made the decision to roll back the change from the previous day, which was completed at 12:15 UTC. As of 12:15 UTC login behavior returned to normal parameters.‌ **‌What we've done to avoid this happening again** The change we implemented on Thursday afternoon was rolled back and we are preparing a new change that will avoid impacting the SAML SSO login flow.

resolved

The fix we implemented earlier has been successful in resolving the issue and full service has been resolved. We apologize for the inconvenience this interruption caused, and will be conducting a full review to avoid a repeat in the future.

monitoring

We've implemented a fix that should resolve the issue. We're monitoring the results to make sure this has the intended effect and will update this message as soon as we've been able to confirm this.

investigating

We are continuing to investigate this issue.

investigating

Some users are unable to log in to Mural via SSO, with an error message of “invalid signature”. We are investigating and will restore regular service as soon as possible.

Report: "Degradation of the Microsoft Teams integration"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

identified

The issue has been identified and a fix is being implemented.

investigating

Some members are currently experiencing a service degradation with the Teams integration. We’re investigating the issue and are working to restore regular service as soon as possible.

Report: "Users are unable to access murals or log in to their accounts "something went wrong" error"

Last update
resolved

The fix we implemented earlier has been successful in resolving the issue and full service has been resolved. We apologize for the inconvenience this interruption caused, and will be conducting a full review to avoid a repeat in the future.

monitoring

We've implemented a fix that should resolve the issue. We're monitoring the results to make sure this has the intended effect and will update this message as soon as we've been able to confirm this.

identified

The issue has been identified and our team is working on fixing it. We'll update this message as soon as we have more details.

investigating

We're experiencing a service disruption causing users to not be able to access murals or access the sign-in page. We're investigating the issue and will restore regular service ASAP. Please check our status page for the most up-to-date info 👉 status.mural.co/

Report: "MURAL Collaboration Issue"

Last update
postmortem

**What happened?** At 06:40 UTC we started to receive notifications from Mural users that were unable to access their content in our European datacenter. This was caused by a configuration change that resulted in connections to our EU database being rejected. Once the cause of the issue was identified, an emergency fix was created, tested and deployed. Normal service was restored at 07:17 UTC. The impact of the emergency fix was monitored for an hour, after which the incident was declared as ‘resolved’. **Summary** Murals in our EU datacenter were unavailable from 06:40 to 07:17 UTC, for a total of 37 minutes of service interruption. **What we've done to avoid this happening again** We are improving our deployment processes and monitoring to include anomalies in the volume of realtime connections.

resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

identified

We are continuing to work on a fix for this issue.

identified

The issue has been identified and a fix has been implemented.

investigating

MURAL is experiencing connection issues, leaving users unable to collaborate, seeing a 'Trying to Reconnect' message. We're investigating and will restore regular service ASAP. Please check our status page for the most up-to-date info 👉 status.mural.co/

Report: "Access blocked when logging in to MURAL"

Last update
postmortem

**What happened?** At around 16:15 UTC we started to receive notifications from Mural users that were unable to log in to Mural. At 17:01 the issue was escalated to our major incident team. Initial investigations indicated the issue coincided with an update to to the Mural web application earlier in the day. Following the update, a higher volume of web traffic was being generated. This triggered security alerts in our firewall and blocked Mural users from logging in. At 17:18 we adapted the web traffic thresholds in line with the new expected volume of traffic. This enabled Mural users to log in again and restored full service. ‌ **Summary** This incident impacted logins from 16:15 UTC to 17:18 UTC, for a total of 1 hour 3 minutes of service interruption. ‌ **What we've done to avoid this happening again** The previous firewall ruleset had a low tolerance for deviations from the expected volume of web traffic. We have updated the firewall ruleset to account for the increased web traffic and ensure there are no further service interruptions.

resolved

At around 15:00 UTC we started to receive notifications from MURAL users that were unable to access their content. The issue appears to have been caused by one of MURAL's security measures, which identified certain actions as potentially malicious. This resulted in a number of MURAL users having their IP addresses blocked. We have modified this configuration to ensure users can log in. We are investigating the root cause and will publish a postmortem on our Status Page once we have full details and corrective actions.

Report: "Redirected URL is invalid error when logging in to Mural in MS Teams and Zoom"

Last update
postmortem

**What happened?** At around 05:43 UTC we started to receive notifications from Mural users that were unable to log in via 3rd party integrations. Access to Mural via [www.mural.co](http://www.mural.co) was not impacted. A database migration affected integrations and Mural API apps, temporarily resulting in duplicate documents. This had the effect of redirect URLs for these apps not being returned in the API response, and authentication failing. After the problem was identified, the duplicate documents were removed and normal integration and Mural API app authentication was restored at 13:45 UTC. **Summary** Access to Mural via 3rd party integrations, Microsoft Teams and Zoom, was interrupted from 05:43 UTC to 13:45 UTC for a total of 8 hours and 2 minutes. **What we've done to avoid this happening again** We are developing more robust test mechanism for database migrations and expanding our documentation around the steps to follow.

resolved

This issue has been resolved.

monitoring

A fix has been deployed for this issue and we are currently monitoring its results. We will keep this page updated as soon as we have more information. Please check our status page for the most up-to-date info: status.mural.co/

identified

We are continuing to work on a fix for this issue. We apologize for any inconvenience caused and appreciate your patience. Please check our status page for the most up-to-date info at status.mural.co/

identified

We’re experiencing a service disruption preventing access to Mural from the Microsoft Teams and Zoom apps. The issue has been identified and our team is working on correcting this. We'll update this message as soon as we have more details. Please check our status page for the most up-to-date info at status.mural.co/

investigating

We’re experiencing a service disruption preventing access to Mural from the Microsoft Teams and Zoom applications. Access from our web interface, Windows and MacOS applications is not affected. We are currently investigating the root cause and will keep this page updated as soon as we have more information to share. We apologize for any inconvenience caused and appreciate your patience. Please check our status page for the most up-to-date info at status.mural.co/

Report: "Mural Collaboration Issue - murals slow in loading"

Last update
resolved

This issue has been resolved.

monitoring

Our service provider has implemented a fix for this issue and we will continue to monitor its results. We will keep this page updated as we have more information. We apologize for any inconvenience caused.

identified

Our service provider is still working on this issue. We will keep this page updated as soon as we have more information.

identified

We've identified an issue with our service provider and are actively monitoring the situation.

investigating

We are continuing to investigate this issue.

investigating

Some users are currently experiencing issues with murals not loading or taking longer than usual to load. We're investigating a general performance issue and will restore regular service as quickly as possible. Please check our status page for the most up-to-date info: status.mural.co/

Report: "MURAL Exports Delay"

Last update
resolved

The fix we implemented earlier has been successful in resolving the issue with exports and full service has been resolved. We apologize for the inconvenience this interruption caused, and will be conducting a full review to avoid a repeat in the future.

monitoring

We've implemented a fix that should resolve the issue with PDF and PNG exports. We're monitoring the results to make sure this has the intended effect and will update this message as soon as we've been able to confirm this. If you were impacted by this incident and were unable to export your mural, you will need to initiate the export again. Note that a side-effect of this incident is that mural thumbnails were not being generated correctly. If your mural is missing a thumbnail, you can correct this by opening your mural and editing it. This will trigger a new thumbnail to be generated.

identified

We believe the issue has been identified and our team is working on fixing it. We'll update this message as soon as we have more details.

investigating

Exports of murals are taking longer than usual to process. We're investigating the issue and will restore normal service as quickly as possible. Please check our status page for the most up-to-date info 👉 status.mural.co/

Report: "MURAL "Workspace members" page is not loading"

Last update
resolved

The fix we have deployed has restored our service and the "Workspace members" page is now fully functional again. Workspace admins are now able to view and edit their workspace members as needed. We appreciate your patience while we worked through this issue and apologize again for any inconveniences caused.

monitoring

A fix has been deployed for this issue and we are currently monitoring its results. We will keep this page updated as soon as we have more information. Please check our status page for the most up-to-date info: status.mural.co/

identified

We have identified the root cause of this issue and we are currently working on a fix. We will continue to update this page as soon as we have more information. Please check our status page for the most up-to-date info: status.mural.co/

investigating

We’re experiencing a service disruption causing the “Workspace members” page within MURAL workspaces to display a blank page — workspace admins are therefore unable to view or edit the members within a workspace. We are currently investigating the root cause of this issue and will update this page as soon as we have more information to share. We apologize for any inconveniences caused and appreciate your patience. Please check our status page for the most up-to-date info :point_right: status.mural.co/

investigating

We’re experiencing a service disruption causing the “Workspace members” page within MURAL workspaces to display a blank page — workspace admins are therefore unable to view or edit the members within a workspace. We are currently investigating the root cause of this issue and will update this page as soon as we have more information to share. We apologize for any inconveniences caused and appreciate your patience. Please check our status page for the most up-to-date info :point_right: status.mural.co/

Report: "Users are unable to sign In to MURAL"

Last update
postmortem

**What Happened?** At 09:43 UTC on September 23rd 2022 our automated monitoring indicated that users were receiving intermittent errors when trying to access MURAL. We determined that the issues were being caused by a recent code change which unexpectedly impacted our infrastructure capacity. We were able to provisionally mitigate this by increasing capacity, resolving the issue definitively through an updated code change. ‌ **Summary** This incident impacted service availability from 09:43 UTC to 10:42 UTC, for a total of 1 hour of intermittent downtime. No data was lost, however some members would have experienced troubles accessing their MURAL data. ‌ **What we’ve done to avoid this happening again** We are documenting the constraints identified through this outage as guidance for future changes. In addition to this we are reviewing our automated infrastructure capacity management to ensure we stay within acceptable parameters. We are also reviewing protocols to maintain system stability, should this specific issue occur again.

resolved

The issue is now resolved and users are able to sign back into MURAL correctly. Once again, we'd like to apologize for any disruption this might have caused.

monitoring

The issue has been mitigated and users are now able to sign back into MURAL; we continue to monitor the situation. Once again, we'd like to apologize for any disruption this might have caused. Please check our status page for the most up-to-date info 👉 status.mural.co/

investigating

Users may be intermittently unable to sign in to MURAL. We know this is a major service disruption for everyone. We're investigating the issue and will restore regular service ASAP. Please check our status page for the most up-to-date info 👉 status.mural.co/

Report: "Users are unable to sign In to MURAL"

Last update
postmortem

**What happened?** At 06:25 UTC on September 28 2022 we started to receive notifications of users seeing an error page when accessing their MURAL workspaces. Initial investigations indicated the cause was an issue with our cloud provider. Shortly after we received confirmation from our cloud provider that routine server maintenance had had an unexpected impact on the availability of data hosted in one of their facilities. At 06:55 UTC MURAL implemented a workaround to re-route traffic and restore service via a secondary server. At 07:25 UTC our cloud provider confirmed that full service had been restored on the primary server and we were able to revert the earlier change. ‌ **Summary** This incident impacted service availability from 06:25 UTC to 06:55 UTC, for a total of 30 minutes of downtime. No data was lost, however MURAL was not accessible during this time. ‌ **What we've done to avoid this happening again** We have improved automated monitoring and notifications to include this particular scenario, to ensure we can restore service faster in the event this should occur again.

resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

identified

The issue has been identified and a fix is being implemented.

investigating

Users are currently unable to sign in to MURAL. We know this is a major service disruption for everyone. We're investigating the issue and will restore regular service ASAP. Please check our status page for the most up-to-date info 👉 status.mural.co/

Report: "Creating MURAL Workspaces"

Last update
resolved

The fix we implemented earlier has been successful in resolving the issue and full service has been resolved. We apologize for the inconvenience this interruption caused, and will be conducting a full review to avoid a repeat in the future.

monitoring

We've implemented a fix that should resolve the issue. We're monitoring the results to make sure this has the intended effect and will update this message as soon as we're able to confirm this.

investigating

We are investigating reports of difficulties creating new MURAL workspaces. We'll provide updates as soon as we have more details. Please check our status page for the most up-to-date info: status.mural.co/

Report: "MURAL Collaboration Issue"

Last update
postmortem

**What happened?** Realtime collaboration failed, resulting in MURAL users not being able to see other logged-in users or their actions in murals. ‌ **Summary** At 16:10 UTC on June 10th, we started to receive notifications from MURAL users of an issue with realtime collaboration. MURAL’s task force started investigating at 16:23 UTC. By 16:44 UTC a change had been deployed, restoring realtime collaboration and enabling users to see collaborators in their murals. This change was monitored over the next hour to ensure system stability, after which the incident was considered resolved. The incident lasted for 34 minutes, with an additional 60 minutes of monitoring time to ensure the system remained stable.

resolved

The fix we implemented earlier has been successful in resolving the real-time collaboration issue and full service has been restored. We apologize for the inconvenience this interruption caused and will be conducting a full review to avoid a repeat in the future.

monitoring

A fix has been deployed and the issue with real-time collaboration should be resolved. If you are not seeing other real-time collaborators, please refresh your browser tab. If you still do not see your real-time collaborators, please get in touch with our Customer Support team via support@mural.co.

identified

We have identified the cause of the real-time collaboration delays. We're preparing a correction to resolve this.

investigating

Some users are currently experiencing a real-time collaboration issue. We're investigating the issue. We will restore regular service as quickly as possible. Please check our status page for the most up-to-date info: status.mural.co

Report: "Some users are unable to access their murals"

Last update
postmortem

**What happened?** On June 14th at 07:48 UTC, we started to receive isolated reports of MURAL users in Europe being unable to access their murals. At 08:48 UTC we confirmed this was an issue affecting a significant proportion of MURAL users and escalated this to our incident response team to commence investigations. At 10:25 UTC our cloud provider confirmed there was an issue with their portal \(see [https://status.azure.com/en-gb/status/history/](https://status.azure.com/en-gb/status/history/) for more details\). This was confirmed to be the root cause of the issue affecting MURAL users. At 12:16 UTC, in collaboration with our cloud provider, we successfully updated our connection to the Azure portal. By 12:50 UTC full connectivity and service in MURAL had been restored. ‌ **Summary** This incident resulted in 5 hours 2 mins of downtime. No data from prior to the outage was lost during this time.

resolved

This incident has been resolved.

monitoring

Our cloud provider experienced a service disruption which impacted a limited number of MURAL users, preventing murals from loading correctly. Our cloud provider has fixed the issue on their side and we have implemented a change to mitigate the impact of this disruption. The issue should now be resolved. We are continuing to monitor system stability for any ongoing issues. If you are continuing to experience issues accessing your murals, please contact support@mural.co.

identified

We have detected the cause of the outage and are working on reestablishing the service as soon as possible. We appreciate your collaboration in this matter.

investigating

We are seeing some disruptions in our system and we're currently investigating on the back end. We appreciate your patience and apologise for any inconveniences.

investigating

We are seeing some disruptions in our system and we're currently investigating on the back end. We appreciate your patience and apologise for any inconveniences.

investigating

We are currently investigating this issue, but only certain murals seem to be affected at this time. We recommend refreshing your browser's cache and trying again whilst we investigate. Thank you for your patience in this matter!

Report: "MURAL Notifications Delay"

Last update
postmortem

**What happened?** On Friday, June 17 2022 at 22:20 UTC, our email service provider incorrectly identified a security risk with MURAL’s account. As a precaution, our email service provider suspended MURAL’s account. This resulted in MURAL product emails \(for example: invitations to join a mural\) not sending. MURAL worked with our email service provider to restore service as quickly as possible. Together with our service provider we implemented a fix at 02:50 UTC on June 18th, which restored full service and allowed the pending emails to be sent. We continued to monitor the results of the fix until 04:00 UTC, at which time the incident was closed. ‌ **Summary** MURAL’s platform remained available throughout this incident. There was a delay of 2 hours and 50 minutes sending product emails, but this did not impact service availability.

resolved

The fix we implemented earlier has been successful in resolving the issue. We apologize for the inconvenience this interruption caused and will be conducting a full review to avoid a repeat in the future.

monitoring

We are continuing to monitor the results to make sure the fix has the intended effects.

monitoring

We've implemented a fix that should resolve the issue. We're monitoring the results to make sure this has the intended effect and will update this message as soon as we've been able to confirm this.

identified

Our team is still working on resolving this issue. We'll update this message as soon as we have more details.

identified

We're continuing to work on resolving this issue.

identified

We have identified the path to return to full service and are working towards this as quickly as possible.

identified

The issue has been identified and our team is working on fixing it. We'll update this message as soon as we have more details.

investigating

We're experiencing a service disruption that is causing notifications, including password reset emails, to not be delivered. We're investigating the issue and will restore regular service ASAP. Please check our status page for the most up-to-date info 👉 status.mural.co/

Report: "MURAL Real-Time Collaboration Latency"

Last update
resolved

The fix we implemented earlier has been successful in resolving the issue and full service has been resolved. We apologize for the inconvenience this interruption caused, and will be conducting a full review to avoid a repeat in the future.

monitoring

We've implemented a fix that should resolve the issue. We're monitoring the results to make sure this has the intended effect and will update this message as soon as we've been able to confirm this.

investigating

We are currently experiencing service degradation. Some users are experiencing latency. We’re investigating the issue and working to restore regular service as soon as possible.

Report: "MURAL Email Notifications Delay"

Last update
resolved

We have implemented a fix for this issue and we have currently determined it has been successfully resolved. We apologize for any inconveniences caused and appreciate your patience.

monitoring

We have implemented a fix for this issue and we're currently monitoring its results. We will share an update as soon as we have further news. We appreciate your patience and apologize for any inconveniences caused.

investigating

We are continuing to investigate this issue. In addition to delays with email notifications, some file previews in murals are also currently not being processed. As a temporary workaround, you can upload an image of the file instead. We will post another update as soon as we have more information to share. We appreciate your patience and apologize for any inconveniences.

investigating

We are continuing to investigate this issue. In addition to delays with email notifications, some file previews in murals are also currently not being processed. As a temporary workaround, you can upload an image of the file instead. We will post another update as soon as we have more information to share. We appreciate your patience and apologize for any inconveniences.

investigating

We are continuing to investigate this issue. In addition to delays with email notifications, some file previews in murals are also currently not being processed. As a temporary workaround, you can upload an image of the file instead.

investigating

We're experiencing a service disruption that is causing some email notifications to not be delivered. We're investigating the issue and will restore regular service ASAP. Please check our status page for the most up-to-date info :point_right: status.mural.co/

Report: "Customers on private tenants with BYOK are not able to log in"

Last update
postmortem

**What happened?** A small number of customers using BYOK experienced an issue with logging in to the MURAL application. Authentication requests were being redirected from their customer tenants to the main [app.mural.co](http://app.mural.co) tenant, resulting in their users being unable to log in. Initial reports of this were received from MURAL customers on Sunday May 1st. Further reports were received on Monday May 2nd, at which point the issue was classified as a major incident and our task force was engaged. ‌ **Summary** MURAL’s task force started investigating at 13:58 UTC on Monday May 2nd. The cause of the issue was identified as being an incorrect configuration in how users on custom tenants were being routed through the login process. Once the issue was identified, a fix was rolled out at 14:07 UTC. This immediately corrected the login flow for clients using BYOK. ‌ ‌**What we've done to avoid this happening again** Parts of the login flow for BYOK clients had been hard-coded. We have changed this to be dynamically generated, reducing the risk of code-based errors. We are also researching avenues to improve the automated monitoring of login issues.

resolved

This incident has been resolved

monitoring

We are continuing to monitor for any further issues.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

Some users are currently unable to sign in to MURAL. We know this is a major service disruption. We're investigating the issue and working to restore regular service as soon as possible. Please check our status page for the most up-to-date info status.mural.co

Report: "Some users are unable to access certain murals"

Last update
resolved

The fix we implemented earlier has been successful and full service has been restored.

monitoring

Our teams are continuing to monitor this incident and we will update you as soon as it is resolved. We recommend clearing your browser’s cache and fully restarting your browser. If you continue experiencing problems, please reach out to our Support Team.

monitoring

We’re continuing to monitor this incident and will update you as soon as it is resolved. Some problems have already been fixed so we recommend clearing your browser’s cache to get the latest version of the app. If you continue experiencing problems, please reach out to our Support Team.

monitoring

We’re still monitoring this incident and hope to be back to normal soon. We appreciate your collaboration in this matter.

monitoring

Our team continues to monitor this incident and is working to reestablish service as soon as possible. We will continue updating you with any new developments.

monitoring

We are continuing to monitor for any further issues.

monitoring

We are continuing to monitor for any further issues and we'll update you as soon as this incident has been resolved. Thank you for your understanding!

monitoring

A fix has been implemented and we are monitoring the results. Please clear your browser's cache if you're still experiencing any issues; if the problem persists, reach out to our Support team.

identified

The issue has been identified and we're preparing a fix to resolve this.

identified

The issue has been identified and we're continuing to work to restore service as soon as possible. We thank you for your patience.

identified

The issue has been identified and we're working on reestablish the service as soon as possible.

investigating

Some users are currently experiencing an issue trying to access some murals. We're investigating the issue and will restore regular service as quickly as possible. Please check our status page for the most up-to-date info: status.mural.co

Report: "Users are unable to access MURAL"

Last update
resolved

The fix we implemented earlier has been successful and full service has been restored. We apologize for the inconvenience this interruption caused and will be conducting a full review on how to prevent this issue from occurring again.

monitoring

A fix has been deployed and the issue with accessing MURAL should be resolved. If you are still not able to access MURAL, please clear your cache and cookies and refresh your browser tab. If that still does not work, please get in touch with our Customer Support team via support@mural.co.

identified

The issue has been identified and we're preparing a fix to resolve this.

investigating

We are continuing to investigate the issue with users being unable to access MURAL.

investigating

We're still investigating the issue. We will restore service as quickly as possible.

investigating

We are continuing to investigate the issue.

investigating

Users are currently unable to access MURAL. We know this is a major service disruption for everyone. We're investigating the issue and will restore regular service ASAP. Please check our status page for the most up-to-date info 👉 status.mural.co/

Report: "MURAL loading time issue"

Last update
resolved

We have implemented a fix for this issue with successful results. We appreciate your patience and apologize for any inconveniences caused during this incident.

monitoring

We have applied a fix for this issue and we are closely monitoring its results. We will keep this site updated as soon as more information becomes available.

identified

We are continuing to investigate this issue. We have not encountered significant impact for MURAL members in the past hour. We will keep this site updated as soon as more information becomes available.

identified

We are continuing to investigate this issue. We have not encountered significant impact for MURAL members in the past hour. We will keep this site updated as soon as more information becomes available.

identified

We are continuing to investigate this issue. We will keep this site updated as soon as more information becomes available.

identified

We are continuing to investigate this issue. We will keep this site updated as soon as more information becomes available. We appreciate your patience and apologise for any inconvenience.

identified

We are continuing to investigate this issue. We will keep this site updated as soon as more information becomes available. We appreciate your patience and apologise for any inconvenience.

identified

We have identified the root cause of these issues and we are continuing to investigate the best way to implement a fix for the slow API requests. We will continue to update this site as soon as we have more information to share.

investigating

We are continuing to investigate this issue. We will keep this site updated as soon as more information becomes available. We appreciate your patience and apologise for any inconvenience.

investigating

We are continuing to investigate this issue. We will keep this site updated as soon as more information becomes available. We appreciate your patience and apologize for any inconvenience

investigating

We are currently experiencing some slow API requests that might affect MURAL’s loading time. Our team is currently investigating this issue and we'll update you as soon as we have new information to share. We apologise for any inconveniences this might have caused.

Report: "MURAL Collaboration Issue"

Last update
resolved

What happened? At 16:13 UTC on Wednesday 23rd March we detected a latency increase in the MURAL application. This resulted in collaboration sessions being terminated and users being unable to log back in to MURAL. MURAL's engineers quickly identified the cause of the increased latency and deployed a fix. Latency returned to normal levels and full service was resumed at 16:30 UTC. MURAL will be conducting an in-depth root cause analysis to determine how to prevent this issue from occurring again.

Report: "MURAL search bar and email service issues"

Last update
postmortem

**What happened?** On Friday, February 18, 2022, the search engine in MURAL was upgraded from ElasticSearch 6 to ES7. The change proceeded as planned and no immediate issues were detected during our post-release checks. Later that day our engineers detected unexpected behavior with MURAL search results. An immediate decision was taken to roll back to the previous version. The process to roll back the upgrade was unsuccessful. Our team worked through the weekend to restore search functionality within MURAL workspaces. Public API endpoints for searching were however inoperative. Our team continued working through the next week to identify the root of the issue with ElasticSearch. On Friday, February 25, the indexes were fully rebuilt on a new ES6 cluster, tested successfully in beta, and then enabled in production. This restored full functionality using ES6, including the public API endpoints for search. ‌ **Summary** This incident resulted in a partial outage for search functionality within MURAL workspaces, lasting 54 hours and 56 minutes. MURAL remained operational throughout this incident and members were able to log in and access their data. ‌ **What we've done to avoid this happening again** We are re-evaluating our upgrade process for ES6 to ES7 to ensure this does not happen again during the next upgrade.

resolved

Password reset emails, confirmation emails, export emails, and search functionality have been restored. For template search please use the create mural option. We appreciate your understanding and patience in this matter.

monitoring

We are currently monitoring the fix we implemented for password reset emails, confirmation emails, and export emails. The fix that has been deployed is stable and functionalities are working properly. The search functionality is already working for all workspaces. For globalTemplates in every workspace, those currently remain searchable through the "create mural" option. We appreciate your understanding and patience.

identified

The fix we implemented for password reset emails, confirmation emails and export emails is stable and this functionality is working correctly. Search functionality remain restricted. Searching for murals using keywords will not currently return any results. Our engineers have identified the path to resolving this issue and are working diligently to implement an update as quickly as possible. We expect to have further details within the next 24 hours. In the meantime you can continue to use the 'your recently opened' list to see your most current murals, or search visually within your dashboard. We apologize for this ongoing inconvenience and appreciate your understanding and patience.

identified

We have verified the fix implemented has allowed password reset emails, confirmation emails, and export emails sent from the app to be fully functional again. We are continuing to investigate the best way to implement a fix for the Search bar functionality. We will continue to update this site as soon as we have more information to share.

identified

We have identified the root cause of these issues and implemented a fix that should allow password reset emails, confirmation emails, and export emails sent from the app to be fully functional again. We will continue to monitor the status of these and update this site as soon as we have more information to share. We are continuing to investigate the best way to implement a fix for the Search bar functionality. We will continue to update this site as soon as we have more information to share.

investigating

We are continuing to investigate this issue. We will keep this site updated as soon as more information becomes available. We appreciate your patience and apologize for any inconvenience.

investigating

We are currently experiencing a service degradation that is affecting MURAL’s dashboard search functionality. Additionally, some members are not receiving password reset emails, confirmation emails, or export emails from the app. This should not affect general usage in the MURAL application. Our team is currently investigating and we will post another update when we have new information to share. We apologize for any inconveniences caused.

Report: "MURAL Canvas Issue - Icons not loading properly"

Last update
resolved

The fix we implemented earlier has been successful in resolving the issue and full service has been resolved. We apologize for the inconvenience this interruption caused, and will be conducting a full review to avoid a repeat in the future.

monitoring

We've implemented a fix that should resolve the issue. We're monitoring the results to make sure this has the intended effect and will update this message as soon as we've been able to confirm this.

monitoring

A partial fix has been released for this issue and we continue to work towards a full resolution.

identified

We are continuing to work on a fix for this issue.

identified

We are continuing to work on a fix for this issue.

identified

We are continuing to work on a fix for this issue.

identified

The issue has been identified and a fix is being implemented.

investigating

Some users are currently experiencing icons not loading properly while performing a search in the menu. We're currently investigating the issue and will restore regular service as quickly as possible. Please check our status page for the most up-to-date info: status.mural.co/

Report: "MURAL Connectivity Issue - MURAL and murals are slow to load"

Last update
resolved

This incident has been resolved.

monitoring

Our provider has confirmed the connectivity issue is resolved. We are seeing some services begin recovering and continuing to monitor all services for a full recovery.

identified

The issue has been identified and a fix is being implemented.

investigating

Some users are currently experiencing issues with logging in to MURAL. Additionally, some murals are not loading or taking longer than usual to load. We're investigating the issue and will restore regular service as quickly as possible. We apologize for the inconvenience. Please check our status page for the most up-to-date info: status.mural.co/

Report: "Users experience icons disappearing on the mural and are no longer available in the icon library when searched"

Last update
postmortem

**What happened?** At 19:00 UTC on November 18 2021 we started to receive a small number of notifications of some [Noun Project icons](https://support.mural.co/en/articles/2113734-add-icons) disappearing from murals and not being visible in the search bar. During our initial investigations we were unable to reproduce the issue. We continued to receive reports and at 09:40 UTC on November 19 2021 we classified this as a critical incident. The relevant code for displaying icons was retained and no data was lost, however the icons were not being displayed. ‌ **Details and corrective actions** At 16:26 UTC we updated the configuration for the Noun Project integration, which restored full service with no data loss. ‌ **Summary** This incident resulted in a partial outage for a core service, lasting 7 hours and 44 minutes. MURAL remained operational throughout this incident and members were able to log in and access their data; however, some Noun Project icons were not visible in the search menu or on murals. ‌ **What we've done to avoid this happening again** We have resolved the configuration issue and restored full service with the use of icons. We are working on several short- and medium-term initiatives to improve the reliability of this service going forward.

resolved

The fix we implemented has been successful in resolving the issue with icons and full service has been resolved. We apologize for the inconvenience this interruption caused and will be conducting a full review to avoid a repeat in the future.

monitoring

We've implemented a fix that should resolve the issue with icons. We're monitoring the results to make sure this has the intended effect and will update this page within the next hour to confirm.

identified

Our team continues to work on this issue. We will post an update as soon as we have more information or in an hour’s time. We appreciate your patience.

identified

We are continuing to work on a fix for this issue. We will post an update as soon as we have more information or in an hour’s time.

identified

Our team is still working on this issue. We will post an update as soon as we have more information or in an hour’s time.

identified

Our team continues to work on this issue. We will post an update as soon as we have more information or in an hour’s time.

identified

Our team continues to work on fixing the issue. We will post an update as soon as we have more information or in an hour’s time. We appreciate your patience and apologize for this inconvenience.

identified

The cause of the issue has been identified and our team is working on fixing it.

investigating

We're experiencing a service disruption causing icons to disappear on the mural and are no longer available on the icon library when searched. We're investigating the issue and will restore regular service ASAP.

Report: "Uploading images to murals"

Last update
resolved

The fix we implemented earlier has been successful in resolving the issue we were experiencing with uploading images and full service has been resolved. We apologize for the inconvenience this interruption caused, and will be conducting a full review to avoid a repeat in the future.

monitoring

We've implemented a fix that should resolve the issue with uploading images. We're monitoring the results to make sure this has the intended effect and will update this page within the next hour to confirm. If you continue to experience issues with uploading images to your murals, please refresh your browser and try again. If this still does not resolve the issue, please contact us at support@mural.co.

identified

We have identified a temporary workaround for this issue. The issue with uploading images is related to the privacy cookie settings. Members that have disabled the "Targeting cookies" can enable this setting, in order to restore image upload functionality. To enable "Targeting Cookies", click on your name in the bottom-left corner of the MURAL interface. Select "Profile Settings". On the next screen, select "Profile", scroll down to "Cookie Settings" and click on this. A pop-up window will appear where you can select your MURAL cookie preferences. Enable "Targeting Cookies" and click "Confirm Preferences". You should now be able to upload images to your murals again. We understand that this is not an ideal workaround and will not be an option for some users. Our engineers are continuing to work on a fix and we will update this page as soon as we have further details.

identified

The cause of the issue with uploading images to murals has been identified and our team is working on fixing it. We'll update this message as soon as we have more details.

investigating

Our team continues to investigate this issue. We will post an update as soon as we have more information or in an hour's time.

investigating

We are continuing to investigate this issue. We will update this message as soon as we have more information or in an hour's time.

investigating

Our team continues to investigate this issue. We will post an update as soon as we have more information or in an hour's time. We appreciate your patience and apologize for this inconvenience.

investigating

We are continuing to investigate this issue. We will update this message as soon as we have more information or in an hour's time.

investigating

Some members are experiencing issues when uploading images to their murals. We’re currently investigating the issue to determine the cause. We apologize for the inconvenience. Please check our status page for the most up-to-date information: status.mural.co

Report: "Users are unable to sign in to MURAL"

Last update
postmortem

**What happened?** At 21:51 UTC on September 27 2021, we executed a routine operation in our database which inadvertently caused database writes to fail. This in turn overloaded the database and resulted in access requests also failing. Once the original operation finished at 22:42, the database returned to normal operations and access to the MURAL application was restored. ‌ **Details and corrective actions** The specifics of how the operation was performed resulted in a less-known bug on our database server to be triggered. We now understand the steps and will update our processes to avoid repeating this scenario. ‌ **Summary** The outage resulted in 50 minutes of downtime. No data from prior to the outage was lost during this time. ‌ **What we've done to avoid this happening again** We have updated our processes for running database operations to avoid triggering the now-known bug, and will be performing an upgrade to fully mitigate the issue. This upgrade will be announced on the MURAL status page as routine maintenance with the appropriate notice period.

resolved

The fix we implemented earlier has been successful in resolving the issue and full service has been resolved. We apologize for the inconvenience this interruption caused, and will be conducting a full review to avoid a repeat in the future.

monitoring

We've implemented a fix that should resolve the issue. We're monitoring the results to make sure this has the intended effect and will update this message as soon as we've been able to confirm this.

identified

The issue has been identified and our team is working on fixing it. We'll update this message as soon as we have more details.

investigating

Some members are currently unable to sign in to MURAL. We’re investigating the issue and will restore regular service ASAP. Thank you for your patience. Please check our status page for the most up-to-date info: status.mural.co/

Report: "Some users are unable to sign in to MURAL"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

Some users are currently experiencing issues signing into MURAL. We're investigating the issue and will restore regular service as quickly as possible. We apologize for any inconvenience and will post another update as soon as we learn more. Please check our status page for the most up-to-date info: status.mural.co/

Report: "Users are unable to sign In to MURAL"

Last update
postmortem

**What happened?** At 06:15 UTC on August 9, 2021, we experienced a spike in CPU usage on our primary database servers. A very large number of simultaneous operations in a single workspace, specifically joining a workspace and moving content between workspaces, generated write conflicts and resulted in the primary database server locking up. Users that were logged in at the time had their sessions terminated and no new login requests could be processed. **‌Details and corrective actions** We identified the cause of the incident and initiated a fail-over to a new primary database server at 06:44 UTC. This was completed at 07:35 UTC, at which point full service was restored. We immediately started investigating the root cause of the write conflicts and optimizing the workflows for joining workspaces to prevent this from impacting system availability again. ‌**Summary** The outage resulted in 1 hour and 20 minutes of downtime. No data from prior to the outage was lost during this time. ‌**What we’ve done to avoid this happening again** As an immediate action we implemented an optimization to the workflow for joining the impacted workspace. We are working towards applying this update to all workspaces in an upcoming release.

resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

identified

The issue has been identified and a fix is being implemented.

investigating

Users are currently unable to sign in to MURAL. We know this is a major service disruption for everyone. We're investigating the issue and will restore regular service ASAP. Please check our status page for the most up-to-date info 👉 status.mural.co/

Report: "MURAL Collaboration Issue"

Last update
resolved

The fix we deployed has successfully resolved the issue with real-time updates in collaboration sessions. If you are continuing to experience difficulties, please refresh your browser window to make sure you're using the latest updates. We are very sorry for the disruption to your collaboration sessions. We will be conducting an in-depth analysis to avoid this happening again.

monitoring

We have deployed an update to fix the lag with real-time updates. We're monitoring the results to make sure this has the intended effect.

identified

We have identified the cause of the lag in real-time updates. We're working on a fix that we're looking to deploy in the next few minutes.

investigating

Some users are currently experiencing an issue causing a lag in real-time updates to their murals. We're investigating the issue and will restore regular service as quickly as possible. Please check our status page for the most up-to-date info: status.mural.co

Report: "Users are unable to sign In to MURAL"

Last update
postmortem

**What happened?** At 17:30 UTC on June 9, 2021, we experienced a spike in CPU usage on our primary database servers. A bulk action in billing groups resulted in the primary database server locking up. Users that were logged in at the time had their sessions terminated and no new login requests could be processed. ‌ **Details and corrective actions** At 17:32 UTC we initiated a fail-over to a new primary database server. This was completed at 17:46 UTC, at which time full service was restored with no data loss. ‌ **What happened next?** At 23:33 UTC we experienced a similar set of events and the database on the new primary database server became unresponsive. ‌ **Details and corrective actions** At 23:42 UTC we initiated a fail-over to another new primary database server. This was completed at 23:56 UTC, at which time full service was restored with no data loss. ‌ **Summary** The first outage resulted in 16 minutes of downtime, with another 23 minutes of downtime for the second outage. ‌ **What we’ve done to avoid this happening again** Following the outage on May 19, we performed a series of maintenance operations over the weekend of May 22-23 to significantly improve our database performance. This reduced the likelihood of a similar outage in future, whilst not entirely eliminating it. As an immediate remedial action, we have temporarily disabled the bulk change functionality in billing groups \(an Enterprise Network feature\). This functionality is being refactored and will be re-released as soon as possible.  We are also conducting a comprehensive review of bulk operations within the MURAL platform to ensure this cannot happen again.

resolved

The fix we implemented has proven to be successful and MURAL has remained stable. We are closing this incident and starting our analysis into the cause of this issue. We are very sorry for the service interruption and will be taking steps to mitigate this in future.

monitoring

We have successfully implemented a fix and full service has been restored. We will continue to monitor the situation to ensure this remains stable.

identified

We have identified the cause of this service interruption and are working to resolve this as quickly as possible.

investigating

Users are currently unable to sign in to MURAL. We know this is a major service disruption for everyone. We're investigating the issue and will restore regular service ASAP. Please check our status page for the most up-to-date info 👉 status.mural.co/

Report: "MURAL is down."

Last update
resolved

The fix we implemented has proven to be successful and MURAL has remained stable. We are closing this incident and starting our analysis into the cause of this issue. We are very sorry for the service interruption and will be taking steps to mitigate this in future.

monitoring

We have successfully implemented a fix and full service has been restored. We will continue to monitor the situation to ensure this remains stable.

identified

We have identified the cause of this service interruption and are working to resolve this as quickly as possible.

investigating

Users are currently unable to sign in to MURAL. We know this is a major service disruption for everyone. We're investigating the issue and will restore regular service ASAP. Please check our status page for the most up-to-date info 👉 status.mural.co/

Report: "Website not accessible"

Last update
resolved

A fix was deployed by our vendor at at 10:36 UTC. Website (https://www.mural.co/) is now fully operational. https://app.mural.co/ was unaffected by this incident.

monitoring

A fix has been deployed by our vendor. Customers may experience increased load time as vendor services return. All aspects of https://app.mural.co/ remain unaffected.

identified

We are currently investigating issues with one of our upstream providers that provides CDN services. This is affecting https://mural.co/. All aspects of https://app.mural.co/ are unaffected We are monitoring this and will provide updates as soon as we have them. We can be contacted through in-app chat or via support@mural.co email.

investigating

We are currently investigating reports of https://mural.co/ not being accessible for users in several geographies. One of our vendors is experiencing technical issues and we are in contact with them to resolve the incident. All aspects of https://app.mural.co/ are unaffected. We can be contacted through in-app chat or via support@mural.co email.

Report: "Credit Card Payments Issue"

Last update
resolved

The fix we deployed has successfully resolved the issue and credit card payments are once again being processed correctly. Any users impacted by this issue can now re-submit their billing details to complete their subscription. We apologize for the inconvenience this may have caused and thank you for your patience.

monitoring

We are continuing to monitor the fix that has been deployed for this issue. We will update this message as soon as there are further details available, or at the latest within the next hour.

monitoring

A fix for this issue has been deployed and we are currently monitoring its status. We will update this message as soon as there are further details available, or at the latest within the next hour.

identified

We are continuing to work on a fix for this issue. We will update this message as soon as there are further details available, or at the latest within the next hour.

identified

We are continuing to work on a fix for this issue. We will update this message as soon as there are further details available, or at the latest within the next hour.

identified

We have identified the cause of the credit card payment issue. We're working on a fix that we hope to deploy soon. In the meantime, please continue to contact our Customer Support team at support@mural.co if you are unable to access your workspace due to an expired subscription.

investigating

We are currently investigating reports from a small number of MURAL users of an issue paying for a monthly or annual subscription via credit card. If you are experiencing this issue and need to access your MURAL workspace urgently, please contact our Customer Support team at support@mural.co.

Report: "MURAL Authentication Error"

Last update
postmortem

What happened: At 08:20 UTC on May 18, 2021, we experienced a spike in CPU usage on our primary database servers. This was caused by an unexpectedly-large number of concurrent requests, which resulted in the MURAL application being unresponsive and users no longer being able to log in. ‌ Details and corrective actions: At 09:01 UTC we initiated a manual fail-over to a new primary database server. This was completed at 09:05 UTC, at which time full service was restored with no data loss. ‌ What we’ve done to avoid this happening again: Over the weekend of May 22-23 we performed a series of maintenance operations to significantly improve our database performance. We are also improving our automated internal alerts to identify potential issues earlier. This will help us to react faster in the event of a similar occurrence in future.

resolved

The issue with logging in and interacting with the MURAL application has been resolved, and full service has been resolved. We apologize for the inconvenience this may have caused, and will be conducting a full review to avoid a repeat in the future.

monitoring

Our developers have just sent out a fix and we continue to monitor the issue.

investigating

We are currently investigating this issue.