Historical record of incidents for pganalyze
Report: "Index statistics unavailable"
Last updateThe restore of historic index statistics data has been completed, and the unused index check will run again as scheduled.
We are continuing to restore affected historic index statistics. We anticipate full recovery in approximately 9 hours time. We will provide the next update around 8am Pacific / 4pm UTC.
We are continuing to restore affected historic index statistics. We anticipate full recovery in approximately 12 hours time. We will provide the next update around 12am Pacific / 8am UTC.
We are continuing to work on restoration of historic index statistics data. Current index statistics information shows up successfully now (e.g. for the current index size), but index-related graphs are missing historic information. The unused index check (in Index Advisor) continues to be unavailable, and you may also see intermittent errors accessing other Index Advisor pages. We will provide the next update by 8pm Pacific / 4am UTC.
We're currently experiencing a data availability issue related to index statistics, including index size and index activity metrics. We're working to restore the affected data from a backup, and expect to have this completed within a few hours. During this issue the unused index check (part of Index Advisor) will be unavailable and show outdated information. Other statistics and advisor recommendations are not affected, and both Index Advisor's missing index check and VACUUM Advisor continue to function. We will provide the next update by 6pm Pacific / 2am UTC.
Report: "Delayed statistics data"
Last updateSnapshot processing was delayed to due an operational problem between 2023-05-24 00:00 UTC (5pm Pacific) and 2023-05-24 02:00 UTC (7pm Pacific). Statistics snapshots received in this time frame are being processed with delay, and will be available within the next few hours.
Report: "Intermittent failure to load query pages"
Last updateDue to a deployment issue, query detail pages within the pganalyze application were not available for about 10 minutes. This issue has been resolved and all data received during the time was processed as expected.
Report: "Delayed processing of statistics"
Last updateThe statistics backlog has completed processing as of 9:05am UTC, and the incident has been fully resolved.
We are still processing a backlog of statistics data, and expect to be fully caught up within the next 1-2 hours.
We are seeing first signs of recovery and processing of statistics data that was queued up. You may still see delays for the next hours as the backlog is processed.
AWS has provided an estimated resolution time of 5pm Pacific (12am UTC) for service recovery. Statistics data processing continues to be delayed and will be processed once the upstream provider issue has been resolved. The pganalyze dashboard, statistics data API and other components continue to be available and are not impacted by this incident.
AWS has confirmed this is a wider outage of Amazon ECS and is working on a resolution. pganalyze statistics data is continuing to be queued for delayed processing.
We have confirmed this issue is related to an upstream provider issue with Amazon Web Services (AWS) and are continuing to work on a resolution.
We are currently investigating an issue that is causing processing of statistics to be delayed by up to 1 hour.
Report: "Website offline (no impact to application / API / statistics processing)"
Last updateThe pganalyze website was offline for 18 minutes between 11:19:20pm and 11:37:21pm GMT due to upstream DNS provider issues. The application and statistics processing was not impacted.