Historical record of incidents for Custom Charts by Tempo
Report: "Infrastructure Upgrades US Cluster"
Last updateScheduled maintenance is currently in progress. We will provide updates as necessary.
We will be performing scheduled maintenance on our infrastructure to ensure continued performance, reliability, and security.During this time, some services may experience brief interruptions. We are taking all necessary precautions to minimize any potential impact.Thank you for your patience and understanding.
Report: "Infrastructure Upgrades EU Cluster"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
We will be performing scheduled maintenance on our infrastructure to ensure continued performance, reliability, and security.During this time, some services may experience brief interruptions. We are taking all necessary precautions to minimize any potential impact.Thank you for your patience and understanding.
Report: "Service Unavailability Issue"
Last updateAll systems are now fully operational. Thank you for your patience!
All systems are now fully operational. Thank you for your patience!
The issue has been resolved, and we are actively monitoring the situation to ensure stability. Thank you for your patience and understanding.
We have identified an issue with the database that is impacting functionality. Our team is actively working on resolving the problem and implementing a fix as quickly as possible. We appreciate your patience and will provide updates as soon as we have more information.
We are currently experiencing an issue causing service unavailability. Our team is actively working to identify and resolve the problem as quickly as possible. We apologize for any inconvenience this may cause and appreciate your patience.
Report: "Service Unavailability Issue"
Last updateAll systems are now fully operational. Thank you for your patience!
All systems are now fully operational. Thank you for your patience!
The issue has been resolved, and we are actively monitoring the situation to ensure stability. Thank you for your patience and understanding.
We have identified an issue with the database that is impacting functionality. Our team is actively working on resolving the problem and implementing a fix as quickly as possible. We appreciate your patience and will provide updates as soon as we have more information.
We are currently experiencing an issue causing service unavailability. Our team is actively working to identify and resolve the problem as quickly as possible. We apologize for any inconvenience this may cause and appreciate your patience.
Report: "Performance Degradation Across Custom Charts"
Last updateThis incident has been resolved.
The fix has been deployed to production, and we're keeping a close watch on system performance.
The issue has been identified and a fix is being implemented
We are currently observing a recurrence of performance degradation. Our team is investigating and working to resolve the issue as quickly as possible.
Performance has stabilized. We continue to investigate to determine the root cause, and we are actively monitoring to ensure stability remains.
We are currently observing a recurrence of performance degradation. Our team is investigating and working to resolve the issue as quickly as possible.
Performance has stabilized at this time. We continue to investigate to determine the root cause, and we are actively monitoring to ensure stability remains.
We are now experiencing performance degradation across both regions. We are continuing to investigate.
We are currently experiencing degraded performance in the EU region. We are actively investigating.
Report: "Incorrect totals being returned for charts and issue lists"
Last updateAfter 24 hours of continued monitoring and stable performance, we can confirm that this incident is now resolved.
We are pleased to share that Custom Charts is now operating normally. Through collaboration with Atlassian, the behavior that caused the 100 issue limit has been addressed. We have shelved our mitigation and can confirm everything continues to function as expected. We will continue monitoring to ensure stability, but we are confident that Custom Charts is Operational at this time. Thank you for your understanding and patience during this event.
Mitigation remains stable and Custom Charts continues to perform as expected. We are continuing to monitor closely and work toward a comprehensive solution.
The mitigation measure implemented to address the 100 issue limitation experienced in Custom Charts remains stable. All charts and lists should be loading as expected. We are continuing to monitor closely, as well as collaboratively work toward a more comprehensive solution. We will provide further updates as needed.
We have implemented a mitigation measure to address the behavior impacting Custom Chart totals, specifically the 100 issue limit, and are monitoring the situation. This change is now active and requires no action from your side. We are continuing our collaborative efforts with Atlassian to finalize a long-term solution.
The 100 issue limitation incident remains under active investigation. Our team is continuing to work diligently with Atlassian to resolve this limitation. We are actively pursuing all available avenues for resolution and will provide an update as soon as we have new information to share. Thank you for your continued patience.
Our team continues to work closely with Atlassian to resolve the current limitation affecting Custom Chart results. We understand this is impacting your workflows, and we are diligently seeking a confirmed timeline for resolution. We will share that information as soon as it is available. Thank you for your ongoing patience.
We are currently investigating an issue affecting Custom Charts, where all results are limited to 100 issues. Not all sites are impacted at this time. This appears to be caused by a staged rollout of API endpoint changes. We are working closely with Atlassian to identify and implement a resolution quickly.
Report: "Performance Issues"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented.
We are experiencing performance issues and increased delays.
Report: "Atlassian Jira Cloud Platform Outage - Affects Some of Our Customers"
Last updateThe Atlassian Cloud Platform is now operational. The recent issues were related to a disruption between 12:15 UTC and 15:20 UTC on February 28th, during which Connect apps were unable to perform user impersonation operations. The fault has been identified and resolved by scaling up the infrastructure. Post-incident review (PIR) and detailed root cause investigation will be conducted by Atlassian and shared publicly.
The Atlassian Jira Cloud platform is experiencing some issues affecting our systems. We are monitoring this situation, but that situation is out of control. We will close this incident as soon as the Atlassian will resolve issues on their platform. see: https://developer.status.atlassian.com/incidents/ncqyrsz7tg0x
Report: "Interruption of DB Connections for Production Environments"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We have identified the root cause - ETA for fix ~15min.
We are currently investigating this issue.
Report: "Custom Charts for Confluence Cloud is experiencing an outage"
Last updateCustom Charts for Confluence is no longer experiencing an incident. Customers who tried to re-authenticate during the incident can refresh their pages and try again. Any users that did not try to re-authenticate during this incident should see no changes or action required to load their charts once more.
Custom Charts for Confluence is currently experiencing an incident. Existing charts are displaying Authentication errors. Our team is actively working on a solution to this issue. Jira customers are not impacted by this incident.
Report: "Custom Charts experiencing some performance issues"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Some customers are experiencing degraded performance with Custom Charts.
Report: "Custom Charts Degraded performance"
Last updateYesterday on 6 June 2023, some US customers experienced performance degradation of Custom Charts. This was caused by instability on several of the application nodes for approximately four hours. The application nodes are stable once more, and we are implementing improvements to the infrastructure to ensure that there is no customer impact in the case of instability.
Some Custom Charts users may be experiencing degraded performance. Charts are loading slower than expected, but continuing to load successfully. We are currently investigating this issue.
Report: "Performance Degraded for Custom Charts for Jira + Confluence"
Last updateThis incident has been resolved. Yesterday, one of our nodes experienced network issues. This caused degraded performance for some US customers.
Custom Charts is up and stable on all nodes, across all regions. We are currently monitoring and investigating the root cause.
We are currently investigating this issue. Chart performance may be degraded for some users.
Report: "Custom Charts for Jira/Confluence experienced some issues loading gadgets."
Last updateThis incident has been resolved.
Custom Charts is back to fully operational. We are monitoring and reviewing to identify root cause.
Custom Charts for Jira and Confluence Cloud users may have seen degraded performance or failure to load some gadgets. We are currently investigating and working on restoring the app.
Custom Charts for Jira Cloud users may have seen degraded performance or failure to load some gadgets for <5 minutes. This should be resolved, and we are monitoring the situation. Confluence users are not impacted at this time.
Report: "Custom Charts for Jira down"
Last updateThis incident has been resolved. Following our infrastructure maintenance this weekend we have experienced hardware issues on the side of our cloud provider. This impacted US customers for approximately ~20 minutes while our systems restarted and recovered.
Our services have been restored and we are monitoring performance.
Custom Charts for Jira is not currently responding to US customers. Performance may be degraded for EU customers. We are working to restore service as quickly as possible.
Report: "Custom Charts for Jira is unresponsive"
Last updateThis incident has been resolved. A post-mortem report will be released soon.
Our team has managed to mitigate the issue and all our services are being restored. We are now monitoring the system and all Cloud customers should have Custom Charts working again.
Custom Charts for Jira is not currently responding for US customers. Performance may be degraded for EU customers. We are working to restore service as quickly as possible.
We are currently investigating this issue.
Report: "Custom Charts for Jira down"
Last updateThis incident has been resolved. A post incident report will be released shortly.
A fix has been implemented and we are monitoring the results.
Custom Charts for Jira Cloud is currently experiencing an outage. We are currently investigating this issue and working to restore service.
Custom Charts for Jira service has been restored. This outage occurred during a planned release. This release has been rolled back to the latest stable production version and we are investigating the root cause.
We are continuing to investigate this issue.
Custom Charts for Jira Cloud is currently experiencing an outage. We are currently investigating this issue and working to restore service. Confluence is unaffected.
Report: "Custom Charts down for some users"
Last updateThis incident has been resolved. A postmortem will be posted once complete.
A fix has been implemented and we are monitoring the results. We will provide additional information here once we have completed our investigation. Thanks everyone for your patience, and please feel free to reach out to our support portal (https://ossapps.atlassian.net/servicedesk/customer/portal/1) if there are any questions that we can answer.
We are currently investigating this issue.
Report: "Custom Charts for Jira down"
Last updateThis incident has been resolved. A postmortem will be posted once complete.
A fix has been implemented and we are monitoring the results.
The issue has been identified - only some US customers are impacted currently, and only Custom Charts for Jira Cloud. We are working on getting the app back up as soon as possible.
Custom Charts are down for some customers. We are currently investigating this issue and will update as soon as we have any additional information.
Report: "Charts are not loading data in dashboards and pages"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
One of our regions has an unexpected DNS issue with the inability to resolve the direction of traffic. As it is impacted a small number of our clients, it was complicated to identify issues. Now we are fully operational. Sorry for the inconvenience.
Charts are not loading data in Jira dashboards and Confluence pages. Our team are currently investigating the root cause and will update you as soon as we've managed to restore our services.
Report: "Custom Charts for Jira down"
Last updateOn October 28, Custom Charts for Jira experienced an unexpected outage for some users. This outage was caused by a recent release that included improvements to how Custom Charts performs with regards to rate limits in Jira. Although these improvements were tested and scale tested, an unexpected bottleneck caused the system to become unresponsive for some users. Custom Charts was rolled back to the previous stable release, and the system was restarted to ensure the app recovered as quickly as possible so we could properly investigate the incident. In the future, StatusPage notifications will be sent out for all incident updates, including initial incident alerts. We apologize for any inconvenience due to this downtime. If anyone would like to know more about this incident please contact our support team at support@oldstreetsolutions.com Morgan - Old Street Support Team
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Chart Loading Error"
Last updateAn issue with one of our service providers caused a DNS error that resulted in Custom Charts becoming unavailable for some users. This issue has now been resolved and we are monitoring the situation carefully. A full incident review will be conducted to ensure that there is greater redundancy in the future for this aspect of the application. Thank you to everyone that raised an incident ticket with us and for your patience while we resolved this problem. If anyone would like to know more about this incident please contact our support team: support@oldstreetsolutions.com Thanks, Tom - Old Street Support Team