Pantheon

Is Pantheon Down Right Now? Check if there is a current outage ongoing.

Pantheon is currently Degraded

Last checked from Pantheon's official status page

Historical record of incidents for Pantheon

Report: "Degraded Availability of Static Files"

Last update
identified

Following the global upstream provider outage on June 12, we have identified a lingering issue affecting the availability of static files on some sites. In certain cases, files that exist on the platform may return a 404 error or be inaccessible by the PHP application. Our engineering team is actively investigating a platform-wide solution to resolve this inconsistency. In the meantime, if you encounter this issue, please reach out to our Support team. We are able to assist by reloading the affected site's filesystem cache to restore correct file availability. There is no data loss associated with this issue. We will provide updates as we make progress, thank you for your understanding.

Report: "Dashboard Availability Issues"

Last update
investigating

Our monitoring systems have identified an increase in errors impacting access to the Pantheon Dashboard and customer sites. These errors are the result of an issue originating from an upstream service provider. At this time, some users may experience intermittent errors when trying to log in to the dashboard, as well as site downtime. We are also seeing downtime for our Front End Sites customers. Our team is actively investigating this issue with the highest priority and will share additional updates as soon as more details are available. For urgent assistance, please submit a support ticket or use chat.

Report: "Intermittent File System Error"

Last update
investigating

We are currently investigating reports of file permissions issues affecting a limited number of sites. This is being treated with the highest priority, and our team is working diligently to identify and resolve the root cause. If you are experiencing related errors, please contact Support via chat or submit a ticket. Our team is ready to assist and will prioritize your case. We will provide updates as soon as more information becomes available. Thank you for your patience.

Report: "Infrastructure Issue Affecting Customer Sites"

Last update
resolved

The issue affecting SFTP and Git operations has been fully resolved. All systems are now operating normally, and our monitoring confirms stability. Thank you for your patience while we worked to address this.

monitoring

A fix has been implemented for the issue affecting SFTP and Git operations. We are currently monitoring system performance to ensure stability and full recovery. We'll continue to keep a close eye on the situation and will provide a final update once we've confirmed the issue is fully resolved. Thank you for your patience throughout this process.

identified

We've identified the root cause of the issue affecting SFTP and Git operations. Our team is now working on implementing a fix to restore normal functionality.

investigating

We are still investigating the issue affecting SFTP and Git operations. Our engineers are actively analyzing potential root causes and continue to work toward a resolution. Thank you for bearing with us.

investigating

Our team continues to investigate the issue affecting SFTP and Git operations. We're making progress in narrowing down the cause and are working to implement a solution. We'll provide the next update within 45 minutes or as soon as new information is available. Thank you for your ongoing patience.

investigating

We are still actively investigating the issue impacting SFTP and Git operations. Our engineering team is reviewing system components and logs to isolate the root cause. We appreciate your continued patience and will share another update within the next 30 minutes or as soon as more information becomes available.

investigating

Our team is continuing to investigate the infrastructure issue affecting SFTP and Git operations. We are actively working to identify the root cause and will provide another update within the next 30 minutes. Thank you for your patience as we work to resolve this.

investigating

We're currently addressing an infrastructure issue impacting SFTP and Git operations.

Report: "Infrastructure Issue Affecting Customer Sites"

Last update
Investigating

We're currently addressing an infrastructure issue impacting SFTP and Git operations for sites in the US region.

Report: "Degraded Workflows"

Last update
resolved

This incident has been resolved. All workflows are operational, any workflows that were run during the incident and marked as failed will need to be re-run. If you encounter any issues, please reach out to support and we will be happy to assist.

monitoring

A mitigation has been deployed, and we're seeing signs of improvement. Our team is continuing to monitor the situation to ensure everything remains stable. Thank you for your continued patience.

identified

We've identified the root cause of the issue affecting workflow performance. Operations such as environment cloning, restores, and backups may still experience delays or degraded performance. Our team is working on a fix and will provide updates as progress is made. Thank you for your patience and understanding.

investigating

We're currently investigating an issue causing degraded performance in workflow execution, including creating new sites or environments, cloning operations, restore operations, and backup operations. For urgent issues, please contact support via helpdesk@pantheon.io or by opening a support chat.

Report: "Routine Maintenance Impacting Dashboard and Terminus Operations"

Last update
Scheduled

In order to improve the customer experience and keep our systems updated with the latest scalable technologies, Pantheon will be performing scheduled maintenance on Tuesday, May 13, 2025. We will be extending our regular May maintenance window to 1.5 hours to allow sufficient time for applying an important security update.During this maintenance window, there will be a temporary interruption of Dashboard and Terminus operations. Workflows that run within the Dashboard or via the Terminus command line may fail to execute. These workflows include the creation of new multidev environments, site creation, backup, or restore operations, code pushes, and scripts run by Quicksilver. We recommend you avoid starting workflows during the maintenance window. We apologize for any inconvenience this may cause and assure you that our team will work diligently to minimize any disruption.We do not anticipate any impact to your site(s) uptime during this maintenance window.We understand the importance of our services to your business, and we assure you that our team will complete the maintenance as quickly as possible. We will also keep you informed of any updates or changes during the maintenance process. Should you have any questions or concerns, please reach out to the Pantheon Helpdesk

In progress

Scheduled maintenance is currently in progress. We will provide updates as necessary.

Report: "Intermittent Downtime for Front-End Sites"

Last update
resolved

After a thorough investigation, we have identified and addressed root cause of the recent service disruption for Front-End Sites. The issue stemmed from rate-limiting imposed by a critical third-party service provider, with whom we collaborated in diagnosing the underlying problem and implementing corrective measures. A detailed report will follow for all customers affected by the disruption.

investigating

We are continuing our investigation into a platform-level issue that previously led to intermittent availability impacts for some Front-End Sites. While platform monitoring has remained stable, our Engineering team is conducting an in-depth review to fully understand the underlying cause and ensure a long-term resolution is in place. We appreciate your continued patience and understanding. The next update will be shared within 24 hours, or sooner if new information becomes available.

investigating

We are continuing to investigate the platform-wide issue that previously caused intermittent downtime for Front-End Sites. While monitoring had shown signs of stability, a recurrence affecting a small number of isolated sites was observed today, resulting in temporary unavailability from approximately 05:30 to 06:47 UTC. This latest incident appears to be related to the same underlying issue, and our Engineering team is actively engaged in a thorough investigation to identify the root cause and implement a long-term fix. We understand the impact of these disruptions and are treating this with high urgency. Our next update will be shared within 24 hours, or sooner if new information becomes available.

investigating

Our engineering team continues investigating the previous incident that affected front-end websites.  We haven't received any new reports in the past few days, and platform-wide monitoring has remained steady. To provide a thorough root cause investigation and ensure long-term platform reliability, we continue the investigation. To prevent a recurrence, we utilize a rigorous and systematic approach. Within the next 24 hours, or sooner if new information becomes available, the next update will be provided.

investigating

Our Engineering team continues to investigate the earlier issue that impacted Front-End sites. We have not received any new reports in recent days, and monitoring has remained stable across the platform. This ongoing investigation is part of our commitment to delivering a thorough root cause analysis and ensuring long-term platform reliability. We are taking a careful and methodical approach to prevent recurrence. The next update will be provided within the next 24 hours or sooner if new information becomes available.

investigating

Our Engineering team is continuing to investigate and monitor platform behavior to ensure consistent stability across all Front-End Sites. While no new reports have been received over the past several days, we remain focused on identifying the root cause and maintaining optimal performance across the platform. We will share the next update within 24 hours or sooner if new information becomes available.

investigating

Our engineering team continues to actively monitor the platform to ensure stability, as no new reports of affected Front-End sites have been received in the past 24 hours. This ongoing observation supports our efforts to maintain consistent performance metrics and assist in the root cause analysis. We will provide the next update within 24 hours, or sooner if new information becomes available.

investigating

Front-End Sites are now fully operational, with stable metrics and no new issues.Our team continues to monitor performance and investigate the root cause. Drupal and WordPress sites were unaffected. Next update in 12 hours or sooner.

investigating

Since no further issues have been reported and platform metrics have remained stable over the past few days, we are now marking the Front-End Sites component as fully operational. Our engineering team continues to actively monitor performance and conduct a comprehensive root cause analysis to help prevent future incidents. Drupal and WordPress sites remained fully operational throughout this event. We will continue to provide updates as our investigation progresses.

investigating

The platform has maintained stable operations for several consecutive days. Our engineering team continues to actively monitor system performance and conduct a detailed investigation into the root cause to prevent future occurrences. Please note that Drupal and WordPress sites were not impacted at any time. We will provide further updates as our analysis progresses.

investigating

We are continuing to investigate intermittent downtime affecting Front-End Sites. Drupal and WordPress sites remain unaffected. If you are currently experiencing any issues with your Front-End Site, please reach out to Pantheon Support. We will share another update within the next 12 hours, or sooner if new information becomes available.

investigating

We're investigating reports of intermittent downtime affecting Front-End Sites. Rest assured Drupal and WordPress sites are not impacted. If you're experiencing issues, please contact Support via chat or ticket — we're ready to help. We'll share another update within 12 hours or sooner if additional information becomes available.

investigating

We are actively investigating reports of intermittent downtime affecting Front-End Sites. At this time, Drupal and WordPress sites remain unaffected. If you are currently experiencing issues with your Front-End Site, please reach out to Support via chat or ticket—our team is ready to assist you. We will provide another update within the next 12 hours, or sooner if additional information becomes available.

investigating

We are investigating reports of intermittent downtime affecting some front-end websites. WordPress and Drupal sites are not impacted. If you are experiencing issues, please contact Support through chat or by submitting a ticket. We will post another update within 12 hours, or sooner if we have new information.

investigating

We are conducting investigations into reports of front-end sites experiencing intermittent downtime. This incident is not currently affecting WordPress or Drupal websites. Our staff is available to help if you're having problems with your front-end site right now. Please contact Support by chat or ticket. Within the following twelve hours, or sooner if further information becomes available, we will provide another update.

investigating

We are actively investigating reports of intermittent downtime impacting Front-End Sites. At this time, Drupal and WordPress sites are not affected by this incident. If you're currently experiencing issues with your Front-End Site, please contact Support via chat or ticket—our team is standing by to assist. We will share another update within the next 12 hours or sooner as more information becomes available.

investigating

We are continuing to investigate the intermittent downtime affecting Front-End Sites. Drupal and WordPress sites remain unaffected. We will provide another update in 12 hours or sooner if more details become available. If you need immediate assistance, please reach out to Pantheon Support.

investigating

Our investigation into the intermittent downtime affecting Front-End Sites is still ongoing. We are continuing to analyze the root cause and working toward a more durable solution, while closely monitoring the platform for any further recurrence. Drupal and WordPress site functionality remains unaffected. We will provide the next update in approximately 12 hours, or sooner if new information becomes available. If you're still experiencing issues or have any questions, please don't hesitate to reach out to Pantheon Support.

investigating

We are currently investigating a recurrence of intermittent downtime affecting Front-End Sites. The latest disruption occurred between 11:11 and 11:20 UTC on April 24, 2025. While a previous fix was implemented and monitored following the April 23 incident, this recurrence indicates that the issue has not been fully resolved. Our team is actively investigating the root cause and working toward a more durable solution. Drupal and WordPress site functionality remain unaffected. We will provide an update in 12 hours or sooner as more information becomes available. If you are experiencing continued issues or have questions, please contact Pantheon Support.

Report: "Intermittent Downtime for Front-End Sites"

Last update
resolved

This incident is now resolved. We identified the root cause and implemented a fix to prevent recurrence. Ongoing monitoring confirms that the solution has been effective and Front-End Site performance remains stable. We understand how disruptive issues like this can be and appreciate your patience while we worked to address it.

monitoring

We observed intermittent 401 response codes affecting Front-End Sites between 15:50 and 15:57 UTC. The issue has been identified, and a fix has been implemented. We are now monitoring for continued stability. Drupal and WordPress back-end functionality remains unaffected. If you have any questions or need assistance, please contact Pantheon Support.

Report: "Intermittent Downtime for Front-End Sites"

Last update
Monitoring

We observed intermittent 401 response codes affecting Front-End Sites between 15:50 and 15:57 UTC. The issue has been identified, and a fix has been implemented. We are now monitoring for continued stability.Drupal and WordPress back-end functionality remains unaffected. If you have any questions or need assistance, please contact Pantheon Support.

Report: "Degraded Workflows"

Last update
resolved

This incident has been resolved. All workflows are operational, any workflows that were run during the incident and marked as failed will need to be re-run. If you encounter any issues, please reach out to support and we will be happy to assist.

monitoring

A fix has been implemented and we are monitoring the results. Any failed workflows will need to be re-run to ensure completion.

investigating

We're currently investigating an issue causing degraded performance in workflow execution. Affected customers may experience delays, timeouts, or workflow failures. Our engineering team is actively working to determine the root cause and restore full functionality. We will share updates as soon as more information becomes available.

Report: "Degraded Workflows"

Last update
Investigating

We're currently investigating an issue causing degraded performance in workflow execution. Affected customers may experience delays, timeouts, or workflow failures. Our engineering team is actively working to determine the root cause and restore full functionality. We will share updates as soon as more information becomes available.

Report: "Intermittent database access issues on non-live environments"

Last update
resolved

Service has been fully restored following an incident that affected non-Live environments and a limited number of idle Live environments. The impact lasted from 15:27 to 18:03 UTC. All systems are now operating normally. We sincerely apologize for the disruption and are taking steps to prevent recurrence.

monitoring

We've implemented a fix, and service has been restored. Database connections and related workflows should now be functioning normally across all environments. We are continuing to monitor the platform to ensure stability. If you encounter any issues going forward, please contact Support.

identified

We are continuing to work on a fix for this issue. While Live environments on paid sites remain largely unaffected, we have identified a limited scenario where 504 database errors or workflow failures may occur. This can happen if a paid Live environment is non-production and has not received any web requests in the past 12 hours. Our team is actively addressing this and will provide further updates as progress is made.

identified

We have identified the root cause of the issue affecting non-Live environments, which may result in 504 database errors or workflow failures. Our team is implementing a fix and working to restore full functionality as quickly as possible. Live environments on paid sites remain unaffected.

investigating

We are currently investigating an issue affecting non-Live environments on some sites. Users may see 504 “Database not responding” errors or encounter workflow failures involving database access. Live environments on paid sites are not impacted. Our team is actively working to resolve this as a top priority. We will provide updates as more information becomes available.

Report: "Intermittent database access issues on non-live environments"

Last update
Investigating

We are currently investigating an issue affecting non-Live environments on some sites. Users may see 504 “Database not responding” errors or encounter workflow failures involving database access.Live environments on paid sites are not impacted.Our team is actively working to resolve this as a top priority. We will provide updates as more information becomes available.

Report: "Pantheon Dashboard Partial Outage"

Last update
resolved

Between 12:00 and 13:00 UTC the Pantheon Dashboard saw a partial outage, particularly on Workspaces. This incident did not have any impact on site availability. The issue has since been corrected and the root cause is identified and fixed.

Report: "Pantheon Dashboard Partial Outage"

Last update
Resolved

Between 12:00 and 13:00 UTC the Pantheon Dashboard saw a partial outage, particularly on Workspaces. This incident did not have any impact on site availability. The issue has since been corrected and the root cause is identified and fixed.

Report: "Routine Maintenance Impacting Dashboard & Terminus Operations"

Last update
Scheduled

In order to improve the customer experience and keep our systems updated with the latest scalable technologies, Pantheon will be performing scheduled maintenance on Tuesday, April 8, 2025. During this maintenance window, there will be a temporary interruption of Dashboard and Terminus operations. Workflows that run within the Dashboard or via the Terminus command line may fail to execute. These workflows include the creation of new multidev environments, site creation, backup, or restore operations, code pushes, and scripts run by Quicksilver. We recommend you avoid starting workflows during the maintenance window. We apologize for any inconvenience this may cause and assure you that our team will work diligently to minimize any disruption. We do not anticipate any impact to your site(s) uptime during this maintenance window. We understand the importance of our services to your business, and we assure you that our team will complete the maintenance as quickly as possible. We will also keep you informed of any updates or changes during the maintenance process. Should you have any questions or concerns, please reach out to our customer support team via chat or email us at Pantheon Helpdesk.

In progress

Scheduled maintenance is currently in progress. We will provide updates as necessary.

Report: "Dashboard Degraded Service"

Last update
resolved

This incident has been resolved. The Pantheon dashboard experienced a partial outage between 17:46 and 18:37 UTC. Service has fully recovered and dashboards are now functioning normally.

monitoring

A fix has been implemented, and workspace dashboards are now accessible. We are currently monitoring to ensure full resolution. Please contact support if you continue to experience any issues.

investigating

We're currently investigating an issue affecting the loading of workspace dashboards. Individual site dashboards remain accessible, and there is no impact to live site availability. If you're experiencing an urgent issue, please contact support at helpdesk@pantheon.io

Report: "Dashboard Degraded Service"

Last update
Investigating

We're currently investigating an issue affecting the loading of workspace dashboards. Individual site dashboards remain accessible, and there is no impact to live site availability. If you're experiencing an urgent issue, please contact support.

Report: "Intermittent 504s for non-live environments"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented, and we are actively monitoring its impact. If you experience any 504 errors in non-live environments, please reach out via ticket or chat with Support for assistance. We will continue to provide updates as needed.

identified

We're actively working on this. If you encounter any 504 errors with your non-live environments, please don't hesitate to reach out via ticket or chat with Support.

identified

Intermittent unavailability for non-Live environments may continue for approximately 48 hours. Most environments recover within 10 minutes. If yours remains unavailable for longer, please contact support so that we may assist. Live environments will not be impacted. We will provide further updates once new information is available, but do not expect regular updates on the status page during this period.

identified

Pantheon has identified an issue that is causing intermittent unavailability for non-Live environments, including Dev, Test, and Multidev. The current symptoms are a 504 response when trying to access the environment, inability to connect via Terminus or SFTP, and failed workflows related to that environment. There is no impact to Live sites at this time. If you require immediate assistance, please reach out to support.

Report: "Intermittent 504s for non-live environments"

Last update
Identified

Pantheon has identified an issue that is causing intermittent unavailability for non-Live environments, including Dev, Test, and Multidev. The current symptoms are a 504 response when trying to access the environment, inability to connect via Terminus or SFTP, and failed workflows related to that environment.There is no impact to Live sites at this time. If you require immediate assistance, please reach out to support.

Report: "Environments degraded performance"

Last update
resolved

The incident has been resolved. If you're still experiencing any issues related to this, please don’t hesitate to reach out—our support team is here to assist you. We appreciate your patience and understanding throughout the resolution process.

monitoring

We are actively monitoring the situation and working closely with our Engineering team, as there have been reports of workflow issues affecting a small number of Live environments. If you're experiencing this on your site, please reach out to Support via chat or ticket, and our team will investigate immediately. We will provide another update within the next 1-3 hours or as soon as more details become available.

monitoring

We have taken steps to address the degraded performance on the environments and are currently in ongoing monitoring and investigation.

monitoring

We are moving back to investigating the incident as we are noticing that degraded performance in non-live environments is re-emerging. We are actively investigating the issue as a top priority and will provide updates as soon as more information becomes available.

monitoring

We are continuing to monitor for any further issues and will provide another update in the next 3 hours. If you still encounter issues on non-live environments on your site, please reach out to Support via chat or ticket.

monitoring

A fix has been implemented and we are actively monitoring the results. If you still encounter issues on non-live environments on your site, please reach out to Support via chat or ticket. We'll provide updates every 3 hours or sooner if new information becomes available.

monitoring

A fix has been implemented and we are monitoring the results If you still encounter issues on non-live environments on your site, please reach out to Support via chat or ticket. We'll provide updates every 3 hours or sooner if new information becomes available.

identified

We are currently working on a fix for this issue. The symptoms mainly involve 504 errors occurring only in non-live environments and affecting sites located in the US. If you're experiencing this on your site, please reach out to Support via chat or ticket. We'll provide updates every 3 hours or sooner if new information becomes available.

identified

We're actively working on a fix for this issue. The symptoms mainly involve 504 errors occurring only in non-live environments and affecting sites located in the US. If you're experiencing this on your site, please reach out to Support via chat or ticket. We'll provide updates in about an hour or as soon as more information becomes available.

identified

We're actively working on this. If you encounter any issues with your non-live environments, please don't hesitate to reach out via ticket or chat with Support. We'll provide further updates within the next 30 minutes to an hour.

identified

The issue has been identified and a fix is being implemented.

investigating

We have been alerted to degraded performance on non-live environments for a small set of customer sites. This will lead to difficulties loading the environment code log, as well as committing, deploying code, creating multidevs and making backups. However, there are no Live environments affected. There is no impact to Live site uptime due to this incident. We are actively investigating the issue as a top priority and will provide updates as soon as more information becomes available.

Report: "Site Unfreeze Workflows Degraded"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented, and unfreezing sites going forward will now work properly. Sites that experienced issues with unfreezing are being proactively fixed and we will update here once that work is complete.

identified

Our team is actively working on a solution for all affected sites. We'll provide another update in an hour or sooner if there's significant progress. If you need urgent assistance, please contact our support team

identified

We are continuing to work on a fix for this issue.

identified

After unfreezing a site, the code page will display an error, "We were unable to load your Git commit log." The issue is identified and a fix is being worked on, in the meantime restoring the last backup to a new site will resolve the issue. There is no loss of data associated with this issue and no impact to any live sites.

Report: "Front End Sites Outage"

Last update
resolved

This incident has been resolved. We apologize for the disruption and appreciate your patience while we worked to restore service. Our team is continuing to investigate the root cause and implement improvements to prevent similar occurrences in the future. If you have any questions, please reach out to our support team.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

Front End Sites hosted on Pantheon are returning 401 status with "AuthenticationRequired" errors. We are investigating this as a highest priority. Drupal and WordPress CMS sites are unaffected.

Report: "Degraded Workflows with Upstream Operations"

Last update
resolved

This incident has been resolved.

monitoring

We are continuing to monitor for any further issues.

monitoring

At 3:45 PM PST (23:45 UTC) we identified issues with creating sites from Pantheon's upstreams, as well as running upstream updates. These failures may be intermittent. The cause is now identified and a fix for the issue was just put in place. There is no impact on site uptime, if you have any questions or concerns please contact Pantheon support.

Report: "Degraded Workflow Operations"

Last update
resolved

This incident has been resolved. All workflows are operational, though any that were run during the incident and marked as failed will need to be re-run. If you encounter any issues, please reach out to support and we will be happy to assist.

monitoring

A fix has been implemented and we are monitoring the results. Any failed workflows will need to be re-run to ensure completion.

investigating

We have detected and are investigating elevated response times for some workflows, which may slow sync code, deployment, and environment creation operations.

Report: "Degraded Workflow Operations"

Last update
resolved

On January 8, 2025, between 15:35 UTC and 15:50 UTC, Pantheon experienced a degradation in Workflow Operations due to an issue with one of our upstream infrastructure services. Once the upstream issue was resolved, workflows returned to normal operations. During this period, any workflows initiated may have failed. Any failed workflows will need to be re-run to ensure completion. If you encounter any remaining issues or have questions, please reach out to our Support team. We apologize for any inconvenience caused and appreciate your understanding.

Report: "Degraded Workflow Performance and SFTP Access Issues"

Last update
resolved

The issue affecting workflows, SFTP, and Terminus connections has been fully resolved. Systems are operating normally, and we have observed sustained stability following remediation. Thank you for your patience and understanding while we worked to resolve this. If you encounter any further issues, please contact our support team.

monitoring

We have completed our remediation efforts, and services now appear stable. Workflows, SFTP, and Terminus connections have returned to normal. Our team is closely monitoring the system to ensure ongoing reliability. If you experience any lingering issues, please reach out to our support team. Thank you for your patience while we worked to resolve this problem.

identified

We are continuing to work on a fix for this issue.

identified

We have identified the underlying cause of the intermittent failures affecting workflows and connections via Terminus and SFTP. Our engineers have already fixed several servers, and remaining servers will be addressed promptly, improving overall reliability and reducing these connection issues. For now, we continue to recommend pausing deployments between environments as we finalize remediation efforts. We will provide another update within the next 30 minutes. If you need immediate assistance, please reach out to our support team.

investigating

We are continuing to investigate intermittent failures with workflows related to deployment workflows and connecting to application servers. Users may also experience difficulty connecting to development environments via SFTP and Terminus. Our initial remediation efforts are showing promising results, and we are actively working to fully resolve the issue. We recommend pausing deployments between environments for now. Our team is treating this as a top priority and will provide another update in 30 minutes. If you have urgent concerns, please contact our support team for assistance.

investigating

We are currently experiencing intermittent failures with workflows related to deployments and switching between Git and SFTP modes. Additionally, some users are reporting difficulties connecting to development environments via SFTP and Terminus. At this time, we recommend pausing deployments between environments while our engineering team actively investigates this issue as a top priority. We will provide an update within the next 30 minutes. If you are facing urgent issues, please reach out to our support team for assistance.

Report: "Infrastructure Issue Affecting Customer Sites"

Last update
resolved

The incident has been resolved. Thank you for your patience.

monitoring

A fix has been implemented and we are monitoring the results.

identified

We are continuing to work on resolving the issue, with the remaining challenges focused on Git and SFTP workflows. Uptime remains unaffected, and sites are stable. Our next update will be provided within 3 hours, or sooner if significant new information arises. Thank you for your continued patience.

identified

We are continuing to address the issue and currently observe disruptions with Git and SFTP workflows. Uptime remains unaffected, and other workflow functions have stabilized. We will provide another update within 30–60 minutes, or sooner if new information becomes available. Thank you for your continued patience.

identified

We are continuing to work on a fix for this issue.

identified

The status is still identified, but we are seeing issues with Git and SFTP workflows. We are seeing improvements in the site uptime. We will provide another update within the next 30–60 minutes, or sooner if new information becomes available. Thank you for your continued patience.

identified

The issue remains identified, and our team is actively working on implementing the necessary fixes to the affected resources. We are prioritizing resolution and will provide updates as progress continues. The following workflows have been reported as affected: - Cloning sites - Lock/unlock environments - Commits via Git/SFTP - Multidev creations - Terminus commands - Clearing cache If you require urgent support, please contact support and we will be happy to assist. Thank you for your understanding and patience.

identified

The issue remains identified and we are actively implementing the necessary fixes to the affected resources. Our team is working diligently to resolve the situation, and we will provide additional updates as progress is made. For urgent issues, please contact helpdesk@pantheon.io

identified

The issue has been identified and a fix is being implemented. We will provide another update as soon as more information becomes available. For urgent issues, please contact helpdesk@pantheon.io

investigating

We are continuing to investigate the issue and are making progress. We will provide another update as soon as significant progress is made.

investigating

Our team is actively investigating these issues at the highest priority and will update as soon as we have more information.

investigating

We are continuing to investigate the issue impacting site availability and the elevated workflow errors. For urgent issues, please contact helpdesk@pantheon.io

investigating

We are currently investigating an infrastructure failure impacting customer sites. The identified symptoms include "The application did not respond in time" errors leading to site unavailability.

Report: "Degraded Database Performance in North America"

Last update
resolved

From 5:55 AM to 6:39 AM PST (13:55 to 14:39 UTC), some sites hosted within the United States region experienced degraded database performance, which in certain cases resulted in downtime. The issue was identified and resolved by our engineering team. We sincerely apologize for the disruption this may have caused to your operations. If you have any questions or concerns regarding this incident, please don’t hesitate to contact our support team.

Report: "Solr 8 Schema Reversion and Performance Issues"

Last update
resolved

We are moving this incident to resolved as the immediate impact has been addressed. Below is the final update summarizing the current status, resolution steps, and ongoing work:<br><br> <h5>Current Status</h5> The release of the Drupal module <tt>search_api_pantheon</tt> v8.2.1 has resolved the critical issue impacting Solr schema reverting. Customers who have upgraded to this version and re-posted their Solr schema should no longer experience issues following server reboots.<br><br> <h5>Next Steps for Customers</h5> <b>Upgrade Module:</b> Ensure your site is using the latest version of the <tt>search_api_pantheon</tt> module (v8.2.1). <a href="https://docs.pantheon.io/release-notes/2024/11/solr-module-8-2-0">Release notes here</a>.<br> <b>Post Schema:</b> Use the module admin interface or Drush to re-post your schema to the Solr server.<br> <b>Dashboard path:</b> <tt>/admin/config/search/search-api/server/pantheon_solr8/pantheon-admin/schema</tt><br> <b>Drush command:</b> <tt>drush search-api-pantheon:postSchema [solr-server] [path-to-schema]</tt><br><br> <h5>Ongoing Engineering Efforts</h5> While immediate issues have been addressed, Pantheon engineers are working to ensure that schemas persist during major platform updates. No further Solr 8 updates are planned until this enhancement is complete. We appreciate your patience and collaboration throughout this process. If any related concerns arise, please don’t hesitate to reach out to our support team.

monitoring

We are pleased to announce the release of version 8.2.1 on Drupal.org, which addresses the critical issue affecting the Pantheon Search API Admin page. Apply this update to resolve the issue and restore optimal performance. For reference: https://www.drupal.org/project/search_api_pantheon/releases/8.2.1 During our testing of the module updates, we identified an additional edge case that could cause content reversion. As part of our ongoing efforts to resolve this, we are implementing an update to the Pantheon internal services to address this behavior. If you have any questions or need assistance with this update, our support team is here to help. We appreciate your patience and understanding as we work to ensure the best possible experience.

monitoring

We are actively monitoring the situation and working closely with our Engineering team to resolve a critical issue impacting the Pantheon Search API Admin page. Issue Overview: A fatal error has been identified in certain scenarios after applying configuration to the Solr server. Error Message: Uncaught PHP Exception TypeError: "Drupal\search_api_pantheon_admin\Form\PantheonSolrAdminForm::getViewSolrFile(): Argument #2 ($contents) must be of type string, array given, called in /code/web/modules/contrib/search_api_pantheon/modules/search_api_pantheon_admin/src/Form/PantheonSolrAdminForm.php on line 82" at /code/web/modules/contrib/search_api_pantheon/modules/search_api_pantheon_admin/src/Form/PantheonSolrAdminForm.php line 108 We are in the final stages of developing a patch to address this error and will release it as soon as it's ready. Please rest assured that resolving this issue is our top priority. If you encounter any further challenges, our support team is here to help. Thank you for your patience and understanding as we finalize the solution.

monitoring

We are continuing to monitor for any customer reports of success or issues with the new module version. For reference: https://www.drupal.org/project/search_api_pantheon/releases/8.2.0 https://docs.pantheon.io/release-notes/2024/11/solr-module-8-2-0 Our support team is here to help with any questions or guidance needed. Please don't hesitate to reach out for further assistance.

monitoring

We have published search_api_pantheon v8.2.0 on Drupal.org, which includes a critical patch to resolve Solr performance issues and prevent reversion to previous versions. Customers experiencing these issues will need to apply this update and subsequently post schema to the Solr server from their website through the module admin UI or with Drush. For reference: https://www.drupal.org/project/search_api_pantheon/releases/8.2.0 https://docs.pantheon.io/release-notes/2024/11/solr-module-8-2-0 Our support team is here to help with any questions or guidance needed. Please don't hesitate to reach out for further assistance. Thank you for your patience as we worked to deliver this essential improvement.

identified

A pre-release branch of the search_api_pantheon module has been pushed to the 8.1.x-dev branch on drupal.org. With this update, a core reload is called following a schema post from the dashboard (i.e. "/admin/config/search/search-api/server/pantheon_solr8/pantheon-admin/schema") or with Drush ("drush search-api-pantheon:postSchema"). This branch does not yet trigger a reload when "drush search-api-solr:reload" is invoked. To avoid Solr schema reverts, customers can install the new branch of the module on their site with: composer require 'drupal/search_api_pantheon:8.1.x-dev@dev' And then post their schema update in the admin dashboard or with Drush. With the core reload attached to posting the schema, sites should no longer see schema revert. We are continuing to work towards a stable release of this fix that will include reloads through search-api-solr.

identified

We're making steady progress on resolving this issue and will provide another update in about 6 hours, or sooner if we have additional information. Thank you for your patience as we work through this.

identified

We are continuing to work on a fix for this issue and making progress. We'll post another update in 6 hours, or sooner if significant progress is made.

identified

We are continuing our efforts to fix this issue and will provide updates within the next 6 hours.

identified

Our team is actively working toward a solution for this issue. We'll post another update in 6 hours, or sooner if significant progress is made.

identified

We're making progress on a fix for this issue and will provide another update in 2 hours, or sooner if more details become available.

identified

We are continuing to work on a fix for this issue. The next update will be in 2 hours or as soon as we have more details.

identified

Between November 5 and November 8, 2024, a critical security update was applied to Solr 8 across our platform. During this process, a subset of customers experienced issues with their Solr schema reverting to a previous version. This schema reversion may lead to challenges such as limited indexing of new content and disrupted search functionalities. We believe we've discovered the source of the issue affecting schema stability, and an update to the Drupal Search API Pantheon module will be available soon. In the interim, if you encounter any Solr indexing or search-related issues, please reach out to our support team for prompt assistance.

Report: "Degraded Workflow Performance"

Last update
resolved

This incident has been resolved. All workflows are operational, though any that were run during the incident and marked as failed will need to be re-ran. If you encounter any issues, please reach out to support and we will be happy to assist.

monitoring

A fix has been implemented and we are monitoring the results.

identified

Our team has identified the root cause of the issue, linked to a recent update. Engineering is actively working on a resolution. We expect to provide another update within 30 to 60 minutes. Thank you for your continued patience as we address this.

investigating

We've observed issues with workflow operations, including site and multidev creation, Terminus commands, deployments, and Autopilot. Existing site environments remain unaffected, with no impact on uptime. Our team is actively investigating these concerns as a top priority, and we’ll keep you updated with any new information as soon as possible. Thank you for your patience and understanding as we work through this.

Report: "Degraded Dashboard Workflow"

Last update
resolved

This incident has been resolved.

monitoring

We're continuing to monitor the implemented fix closely, and the platform remains stable with positive results in our internal monitoring. If you encounter any unforeseen issues with workflows, please don't hesitate to reach out to our support team for immediate assistance. Thank you for your patience.

monitoring

We are actively monitoring the situation, and with remediations in place, our systems are showing stable status so far. We will provide another update in the next 30–60 minutes, or sooner if new information arises. Thank you for your patience.

identified

We are continuing to work on a fix for this issue.

identified

The issue has been identified and a fix is being implemented.

investigating

We have detected and are investigating elevated response times for dashboard workflows, which may slow down backups, cloning, deployment, and environment creation operations.

Report: "Support chat is currently unavailable"

Last update
resolved

Support chat is now operational.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

We are experiencing an outage with our support chat system and we are currently investigating the issue. For urgent issues, please contact support via helpdesk@pantheon.io or open a ticket through the dashboard.

Report: "Workflow issues and degraded Git operations"

Last update
resolved

This incident has been resolved.

monitoring

We are actively monitoring the situation and will provide an update in 2 hours or sooner if new information arises.

monitoring

We are actively monitoring for any further developments. We will provide another update in 2 hours or as soon as more information becomes available.

monitoring

We continue to monitor the situation. We will provide another update in 2 hours or as soon as more information becomes available.

monitoring

We are closely monitoring the situation to ensure everything is running smoothly. We will provide another update in 2 hours or as soon as more information becomes available.

monitoring

We are actively monitoring for any further developments. We will provide another update in 1 hour or as soon as more information becomes available.

monitoring

We are continuing to monitor for any further issues.

monitoring

A fix has been implemented and we are monitoring the results.

identified

The issue has been identified and a fix is being implemented.

investigating

We have been alerted to degraded performance on Git repository connectivity. This will lead to difficulties loading the Pantheon dashboard code log, as well as committing, deploying code, creating multidevs, and making backups. There is no impact on site uptime due to this incident. We are actively investigating the issue as a top priority and will provide updates as soon as more information becomes available.

Report: "Partial outage on newly created sites or mutlidevs"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

identified

The issue has been identified and a fix is being implemented.

investigating

We are continuing to investigate this issue.

investigating

Our internal team has identified errors with DNS records of newly created sites or multidevs. These issues will affect the ability to interact with environments using Git and SFTP, as well as running Terminus commands. We are actively investigating this and will provide updates as soon as we have more information.

Report: "Dashboard Availability Issues"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

Our monitoring systems have detected increased errors affecting access to the Pantheon Dashboard. Please note that site uptime has no impact, but some users may have encountered errors when attempting to access the dashboard. We are actively investigating this issue as a top priority and will provide further updates as soon as more information becomes available. If you require urgent support, please open a ticket or chat, if you are unable to access the dashboard you may email helpdesk@pantheon.io

Report: "Autopilot Service Interruption"

Last update
resolved

This incident has been resolved.

monitoring

Our internal monitoring detected that autopilot services on the platform were paused. A fix has been implemented, and we are closely monitoring the situation to ensure stability. If you need immediate assistance, please open a support chat with our team or submit a ticket. Thank you for your patience!

Report: "Dashboard Access Issues"

Last update
resolved

This incident has been resolved.

monitoring

The dashboard has been successfully restored to operational status and is undergoing continuous monitoring for performance and stability.

investigating

Our monitoring systems have detected an increase in errors affecting Dashboard availability. At the moment systems are stable but customers may have been presented with errors when trying to access the Pantheon Dashboard. There is no impact on site uptime. We are investigating this issue as a top priority and will provide updates as soon as more information is available. If you require urgent support, please open a ticket or chat, if you are unable to access the dashboard you may email helpdesk@pantheon.io

Report: "Site and Multidev Creation Workflows Degraded"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results. If you are still experiencing issues or need immediate support, please email helpdesk@pantheon.io

investigating

We are investigating an infrastructure issue affecting several workflows, including creating new sites or environments. For urgent issues, please contact helpdesk@pantheon.io

Report: "404 Errors on Assets After Environment Cloning"

Last update
resolved

This incident has been resolved.

monitoring

The fix has been implemented and deployed. We are now observing successful clones, assuming that the issue has been resolved.

identified

We have identified the issue and are actively taking steps to resolve it. We will issue further updates within the next 30 minutes or as new information becomes available.

identified

We have identified the issue and are currently taking preliminary steps to resolve it. We will provide further updates in 30 minutes or as additional information becomes available.

identified

We are currently investigating reports of 404 errors when accessing static file assets after a clone. Affected sites may experience these errors in the destination environment following the successful cloning of files between environments. Our engineering team is aware of the issue and is actively working on a resolution. If you encounter this issue, please reach out to support for assistance. We will provide further updates in 30 minutes or as more information becomes available.

Report: "Degraded Dashboard Workflow and Site Performance"

Last update
resolved

This incident has been resolved, but if you encounter any further issues, please don’t hesitate to contact our support team. We appreciate your patience and understanding.

monitoring

We are actively monitoring the situation to ensure everything continues to run smoothly. We will provide updates and share any significant developments as they occur. Should you encounter any further issues, please do not hesitate to contact our support team. We appreciate your patience and understanding.

monitoring

We're continuing to monitor the situation to ensure everything is running smoothly. We'll keep you updated and share any important developments as they arise.

monitoring

We are closely monitoring the situation to ensure everything remains stable. We'll keep you informed and will share another update within the next few hours.

monitoring

We are continuing to monitor for any further issues and will provide another update in the next few hours.

monitoring

Our systems are currently stable, but we remain vigilant and are actively monitoring for any potential issues.

monitoring

We are closely monitoring the situation and addressing issues with customer sites as they arise. Once all sites have been fully remediated, we will provide an update. Please know that our team is dedicated to resolving this, and we’re here to support you throughout the process. If you encounter any additional issues, please reach out to our support team. We’re here to help. Thank you for your continued patience.

monitoring

We are actively monitoring the situation for any further issues. We are continuing to remediate issues with customer sites as they emerge and will announce when remediation for all sites is complete. Please rest assured that our team is fully committed to resolving this, and we’re here to support you every step of the way. If you experience any further issues, don’t hesitate to reach out to our support team—we’re here for you. Thank you for your patience.

monitoring

We are continuing to monitor for any further issues.

monitoring

We are actively monitoring the situation, and our systems are indicating a stable status. We will provide another update in the next 30 minutes to 1 hour, or sooner if new information becomes available.

monitoring

A fix has been implemented and we are monitoring the results.

identified

We've resolved the majority of impacted sites and are continuing to address any new ones as they come up. We're working diligently to resolve the issue as quickly as possible.

identified

We are diligently addressing the issues affecting the impacted sites and will continue to provide timely updates as we make progress.

identified

We are continuing our work to resolve the remaining affected sites and will share updates within the next few hours.

identified

We are continuing our efforts to remediate the remaining affected sites and will provide updates within the next few hours.

identified

We are actively working on remediating all affected sites and will provide updates as progress is made.

identified

We are seeing elevated 504 errors on customer sites in different regions. Our engineering team is aware of the issue and is actively working on a resolution. We are committed to resolving the situation as quickly as possible and will keep you updated as we make progress.

identified

We are continuing to work on a fix for this issue.

identified

The issue remains identified, and our engineering teams are now manually applying the necessary fixes to the affected resources. We are working diligently to resolve the situation and will provide further updates as progress is made.

monitoring

A fix has been implemented and we are monitoring the results.

identified

The issue has been identified, and preliminary steps are being made for resolution.

investigating

Our internal team has identified workflow errors affecting several sites. We are actively investigating this with the highest priority and will provide updates as soon as we have more information.

Report: "Degraded Site Performance"

Last update
resolved

We apologize for the inconvenience, this incident has been resolved.

monitoring

The issue has been identified, preliminary steps are made for resolution, and we are monitoring the results.

investigating

Internal monitoring has detected elevated site availability issues for some sites in our NA (Canada) region. There are also elevated workflow errors on the platform. We are actively investigating this at the highest priority and will update as soon as we have more information.

Report: "Infrastructure Issue Affecting SFTP Mode"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are continuing to monitor the result for another 6 hours.

investigating

Our Engineering team is actively working on identifying the cause of this issue. If you encounter any SFTP-related problems with your sites, please contact Support for assistance. We will provide updates in around 6 hours or as soon as we have more information available.

investigating

We are actively investigating the issue and will provide an update within the next 6 hours, or sooner if more information becomes available. For immediate assistance, please reach out to our support team via chat. We appreciate your patience and understanding.

investigating

We are currently investigating the issue and will provide an update within the next 6 hours or sooner as soon as more information becomes available. For urgent assistance, please reach out to support via chat.

investigating

Our team is actively investigating the issue. We will update you within the next 6 hours or as soon as we have more information. For urgent matters, please contact support via chat.

investigating

Our dedicated team of Engineers are continuing to investigate this issue. We'll provide an update within the next 6 hours, or as soon as we have more details. For urgent issues, please contact support by opening a support chat.

investigating

Our team of dedicated engineers is diligently investigating the issue. We aim to provide an update within the next 6 hours. Should you require immediate assistance, please initiate a support chat with our team.

investigating

Our team of dedicated engineers is actively investigating this issue. We will provide an update within the next 6 hours. For immediate assistance, please open a support chat with our support team.

investigating

Our dedicated team of Engineers are continuing to investigate this issue. We'll provide an update within the next 6 hours, or as soon as we have more details. For urgent issues, please contact support by opening a support chat.

investigating

We have detected elevated reports for the Dashboard related to SFTP development mode. These may manifest as the dashboard not reflecting changes when updating code via SFTP. While we are investigating the issue, we recommend using Terminus env:commit as a workaround: https://docs.pantheon.io/terminus/commands/env-commit If using Terminus is not possible, you may use Git mode to commit the code, otherwise please reach out to support.

Report: "Sites Connection failure"

Last update
postmortem

On July 8th, 2024 at 18:30 UTC, Pantheon Engineering received reports that customers trying to visit their websites encountered a "Connection Failure" message. This was caused by infrastructure issues with Pantheon’s CDN provider due to an unusually high number of simultaneous deployments. This affected customers who were trying to access sites through the CDN’s Newark, New Jersey POP \(Point of Presence\). During the incident, the sites remained available and accessible through all other PoPs. Maintaining site availability is Pantheon’s top-most priority, and we remain committed to sustaining the trust you demonstrated when choosing Pantheon. We apologize for the impact caused to our customers. We are taking measures to improve our monitoring and alerting of similar issues in the future and remain committed to providing reliable and secure hosting services.

resolved

This incident has been resolved.

investigating

We have been alerted to issues with sites showing "Connection Failure" which is isolated to traffic flowing through our CDN partner’s Newark, NJ, data center. Affected environments should see a "Connection Failure" when accessing their sites. If you need immediate assistance, please open a support chat or submit a ticket with our support team. Thank you for your patience!

Report: "CVE-2024-6387 Vulnerability"

Last update
resolved

Pantheon has successfully applied all necessary remediations to address CVE-2024-6387. We have thoroughly investigated and have not observed any impact on our customers due to this vulnerability. No action is needed by customers at this point. We remain committed to maintaining the highest level of security and will continue to monitor the situation closely.

investigating

Pantheon is aware of the recent vulnerabilities reported in CVE-2024-6387. We have already initiated efforts to mitigate this issue. We have not observed any impact on our customers due to this vulnerability. We are committed to maintaining the highest level of security and will continue to monitor closely. Thank you for your continued trust in our services.

Report: "Site Dashboard access issue"

Last update
postmortem

On May 29, 2024, at 16:30 UTC, we encountered an infrastructure issue affecting the site dashboard and Terminus Workflows, which led to temporary impact for customers using workflows via Dashboard and Terminus. Our team quickly identified and addressed the root cause, restoring all services by 17:45 UTC. There was no customer site uptime impact. We apologize for the impact caused to our customers and assure you that we are actively taking steps to enhance our systems to prevent similar incidents in the future. These improvements include strategic upgrades to our infrastructure services, refinement of our response and observability strategies to ensure swift resolution of potential issues. At Pantheon, we remain committed to providing reliable and secure hosting services.

resolved

Between 9:30 AM and 10:45 AM PDT today, the Pantheon dashboard was unavailable or slow to load. The underlying issue was identified and repaired. There was no impact on site uptime. Thank you for your patience during this degraded performance.

Report: "Degraded site performance and workflow errors"

Last update
resolved

This incident has been resolved.

monitoring

We are continuing to monitor for any recent reports of related issues.

monitoring

We are continuing to monitor for any further issues. Please get in touch with Support if your sites are still experiencing 504 errors and workflow issues. We will provide an update in approximately 30 minutes to an hour or as soon as more information becomes available.

monitoring

A fix has been implemented, and the affected sites are now stable.

identified

The issue has been identified and we have implemented a remediation plan for affected sites. If you experience 504 errors or encounter failed workflows on your sites, please contact Support. We will provide an update in approximately 30 minutes or as soon as more information becomes available.

investigating

Internal monitoring has detected elevated issues site availability on the platform showing 504 and 502 errors. There are also elevated workflow errors on the platform. We are actively investigating this at the highest priority and will update as soon as we have more information.

Report: "Degraded Dashboard Performance"

Last update
resolved

We are resolving this incident as the system has remained stable for more than three hours, and we are returning to normal level of monitoring.

monitoring

We are continuously engaged in active monitoring.

monitoring

The system has maintained stability for the last hour, and we are actively monitoring its performance.

investigating

We have observed another short spike in error rates and are continuing to investigate.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

We are monitoring intermittent elevated error rates and timeouts on the Dashboard. These may manifest as slow page loads and failed logins. If you have an urgent issue and are unable to reach support chat, please contact support via helpdesk@pantheon.io

Report: "Dashboard issue"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

We are continuing to investigate this issue. Customers might still be experiencing dashboard unavailability intermittently.

investigating

Internal monitoring has detected elevated issues with the Dashboard. We are actively investigating this at the highest priority and will update as soon as we have more information.

Report: "Code Server Errors"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

The investigation is ongoing. We will provide another update within the next hour or as soon as we have more information.

investigating

We are continuing to investigate this issue. We will provide another update within 1 hour or as soon as we have more information available.

investigating

We are still investigating this issue. Thank you for your patience as we resolve this matter.“

investigating

We are continuing to investigate this issue.

investigating

We are actively investigating this at the highest priority and will update as soon as we have more information.

investigating

We have detected elevated error rates for code server related workflows. This issue does not affect any customer sites or uptime.

Report: "Dashboard and Terminus outage"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

identified

We believe we have identified the root cause of the issue and are working to restore service to the affected systems as soon as possible. We will provide an update within the next 30 minutes to an hour. Thank you for your patience as we resolve this matter.

investigating

We are continuing to investigate this issue.

investigating

We have been alerted to issues accessing the site dashboard as well as running site-specific workflows via Terminus. This does not impact site uptime. We are actively investigating this at the highest priority and will update as soon as we have more information.

Report: "Degraded Dashboard Performance"

Last update
resolved

This incident has been resolved. Pantheon engineers identified an issue with a recent change on the dashboard and successfully rolled out a fix and tested to ensure this will not reoccur. Thank you for your patience as we worked to resolve this.

monitoring

A fix has been implemented and we are monitoring all related services.

investigating

We are continuing to investigate this issue.

investigating

We have detected elevated error rates for the Dashboard. These may manifest as inability to load the dashboard, failed logins, or failures with workflows. This issue does not affect any customer sites or uptime. For urgent issues, please contact support via helpdesk@pantheon.io

Report: "Site Downtime"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

We have detected a network availability issue and is causing downtime for a subset of sites and we are currently investigating the issue. For urgent issues please open a ticket or chat, or if you are unable to access the dashboard you may email helpdesk@pantheon.io

Report: "Intermittent site error responses"

Last update
resolved

This incident has been resolved. We have also put in place proactive measures to prevent this from recurring and will continue to iterate on improvements to infrastructure and stability.

monitoring

Internal monitoring has detected elevated error levels for site application responses. We immediately began investigating and remediating this at the highest priority. Impacts were slow loading pages, and intermittent 500 level error response codes.

Report: "Degraded Dashboard Performance"

Last update
resolved

This incident has been resolved.

monitoring

We’re still closely monitoring the implemented fix and the platform remains stable now. We’ll update around 30 minutes to an hour or as soon as more information becomes available.

identified

The issue has been identified and a fix is being implemented.

investigating

Our Engineering team is actively investigating the issue by thoroughly checking every aspect of the Dashboard.

investigating

Our Engineering team is still actively investigating the issue with the Dashboard.

investigating

We are continuing to investigate this issue.

investigating

We have detected elevated error rates on the Dashboard, leading to slowness or unavailability of dashboard pages. We are actively investigating this at the highest priority and will update you as soon as we have more information. For urgent issues please open a ticket or chat, or if you are unable to access the dashboard you may email helpdesk@pantheon.io

Report: "403 site errors"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and everything should be back to normal, but we're currently monitoring the results. We’ll update around 30 minutes to an hour or as soon as more information becomes available.

identified

The issue has been identified and a fix is being implemented.

investigating

Internal monitoring has detected issues in the form of 403 errors on a number of sites within the platform. We are actively investigating this at the highest priority and will update as soon as we have more information.

Report: "Degraded Workflows"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

monitoring

A fix has been implemented and we are monitoring the results.

identified

We are diligently working on this fix and attempting remediations as our top priority. We will share another update in 1 hour or as soon as more information becomes available.

identified

We are diligently working on this fix and attempting remediations as our top priority. We will share another update in 1 hour or as soon as more information becomes available.

identified

We are diligently working on this fix and attempting remediations as our top priority. We will share another update in 1 hour or as soon as more information becomes available.

identified

We are diligently working on this fix and attempting remediations as our top priority. We will share another update in 30 minutes to 1 hour or as soon as more information becomes available.

identified

We are diligently working on this fix and attempting remediations as our top priority. We will share another update in 30 minutes to 1 hour or as soon as more information becomes available.

identified

The issue has been identified and a fix is being implemented.

investigating

We are continuing to investigate this issue.

investigating

We are continuing to investigate this issue.

investigating

We have detected and are investigating elevated response times for some workflows, which may slow deploy and environment creation operations. For urgent issues, please contact support via helpdesk@pantheon.io or by opening a support chat.

Report: "Intermittent Dashboard errors"

Last update
resolved

This incident has been resolved.

monitoring

We are continuing to monitor for any further issues.

monitoring

The team is still actively monitoring for any persisting issues, as there have been no reported concerns related to the incident within the last 2-3 hours. We'll continue to provide updates within the next 30 minutes to 1 hour.

monitoring

A fix has been implemented and we are monitoring the results.

identified

We are continuing to work on a fix for this issue. Rest assured that we'll post an update as soon as we have them ready from our end. Thank you for your patience

identified

The issue has been identified from an internal service being down and the cause is currently being looked into. We’ll update around 30 minutes to an hour or as soon as more information becomes available.

investigating

Internal monitoring has detected issues in the form of 500 errors on the dashboard and degraded dashboard/terminus performance. We are actively investigating this at the highest priority and will update as soon as we have more information.

Report: "Intermittent site errors in the Canada region"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results. Thank you for your patience with us as we work to resolve this issue.

identified

A fix is still being implemented for the issue impacting sites under the Canada region. We will provide another update in 1 hour or as soon as more information becomes available.

identified

The issue has been identified and a fix is still being implemented. We will provide another update within 1 hour or as soon as we have more information available. Thank you for your patience.

identified

The issue has been identified and a fix is being implemented.

investigating

We're currently investigating the issue impacting sites under the Canada region to identify its root cause. We anticipate providing another update within the next 30 minutes to 1 hour or as soon as we have more information available. Thank you for your patience.

investigating

We are continuing to determine the issue. We will provide another update in 30 minutes or as soon as more information becomes available.

investigating

Internal monitoring has detected elevated error levels for site application responses specifically in the Canada region. We are actively investigating this at the highest priority and will update as soon as we have more information.

Report: "Intermittent site errors"

Last update
resolved

This incident has been resolved.

monitoring

We continue to monitor the implemented fix closely, and the platform is currently stable. We'll provide another update within the next 30 minutes to an hour or as soon as further information becomes available.

monitoring

A fix has been implemented and we are monitoring the results.

identified

Our Engineering team has pinpointed the issue, with the resolution currently in progress. We sincerely appreciate your patience and understanding as we work through this process.

investigating

We are continuing to investigate this issue.

investigating

We are continuing our investigation on this and will post further updates.

investigating

Internal monitoring has detected elevated error levels for site application responses. We are actively investigating this at the highest priority and will update as soon as we have more information. Impacts are slow loading pages, application did not respond in time and 500 error response codes.

Report: "Degraded Application and Dashboard Performance"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are closely monitoring the results. All site and dashboard functionality is restored at this time.

identified

We are continuing to work on a fix for this issue.

identified

We are continuing to work on a fix for this issue. While this work is being completed there will still be intermittent degraded performance.

identified

We have detected degraded application performance on the platform and have identified an issue and are putting a fix in place now. Symptoms include 500 error response codes both for sites and the Pantheon dashboard. For urgent issues, please contact support via helpdesk@pantheon.io or by opening a support chat or ticket.