Historical record of incidents for edX
Report: "Commerce and dashboard functionality unavailable"
Last updateDue to widespread global outages impacting service providers used by edX, some users were not able to purchase edX products approximately between 6 p.m. and 8:30 p.m. UTC. In addition, some users were unable to access program cards in their dashboard. These services are back online and the issues have now been resolved.
Report: "Some pages inaccessible on edX.org"
Last updateFor approximately 13 hours, between 2 a.m. and 3 p.m. UTC, some webpages were not available on edX.org. Affected pages include all Executive Education pages, some Degree pages, the Contact Us page, and many Spanish-language pages. In addition, the Discover tab did not load in the edX mobile apps for iOS and Android. This issue has now been resolved.
Report: "edX.org learning pages down"
Last updateThis issue has been resolved and access is restored and stable.
The issue has been addressed so some learners may be able to access their coursework. We are continuing to monitor to ensure learner access.
The learning pages for edX.org are currently down and we are investigating.
Report: "Some labs not accessible"
Last updateFor approximately 17 hours, labs in some courses were inaccessible due to a recent code change that had unintended effects. This issue has now been resolved.
Report: "Issue with Proctoring Experience with Proctortrack"
Last updateThis incident has been resolved.
Fix is in production and in the process of verifying.
A fix has been verified in Stage and is being deployed to Production.
The issue has been identified and a fix is being implemented.
We are currently investigating an issue with the proctoring experience via Proctortrack.
Report: "Delay in course purchase/upgrade display"
Last updateAll purchases have been processed and this issue has now been fully resolved.
There is no longer a delay between course purchases and the course appearing on the learner home page. Learners who have recently purchased/upgraded a course should refresh their home page before trying to check out again. If you completed a purchase and are still not seeing your course, no need to repurchase as we're currently working through a queue of purchases. We will update this status when all these purchases have been restored.
A fix has been implemented. There is no longer a delay between course purchases and the course appearing on the learner home page. Learners who have recently purchased/upgraded a course should refresh their home page before trying to check out again.
We are investigating an issue that is resulting in a delay between the time that a course is purchased or upgraded and when that course appears for learners on the learner home page. Learners who have recently purchased/upgraded a course should wait and refresh their home page before trying to check out again.
Report: "Intermittent disruption to discovery site"
Last updateThis incident has been resolved.
We believe that this issue was a result of an outage from one of our third-party cloud service providers and the affected navigation and content is now functioning as expected. Our team will continue to monitor performance.
Our engineers are continuing to investigate the issue. Learners attempting to login to the site to work on coursework can do so directly from: https://authn.edx.org/
We are continuing to investigate this issue.
We are investigating an issue that is preventing users from accessing parts of the site that relate to learning about and enrolling in courses. Our engineering team is working to restore continuity.
Report: "Account settings unavailable"
Last updateThis incident has been resolved.
We've restored access to the account settings page and our engineers are now monitoring performance.
Access to the account settings page on edX (accounts.edx.org) is currently unavailable. Our engineers have identified the issue and are working to restore access.
Report: "Login with Facebook Unavailable"
Last updateLogin via Facebook is now available.
We are working with Meta to restore the availability of the Login with Facebook feature. The final resolution of this issue may take a few days to deploy. Learners and Educators who use Facebook to login can use the "Forgot Password" link on the login screen to setup a password and login with the email address that is associated with the account.
We have identified the issue with login via Facebook and our teams are working towards a solution. The solution may take time to roll out as it requires interaction and coordination with teams at Meta, the company that makes Facebook.
Login via Facebook is currently unavailable across web and mobile apps limiting the ability to login to edx.org applications for users of Facebook login.
Report: "Fulfillment Delays"
Last updatePerformance of the student courseware is back to normal and stable.
Performance has returned to normal on student courseware. We'll continue to monitor to ensure stability.
We've implemented a fix that requires a rollout over time. Thus, we're continuing to see some performance issues in the student courseware, but they are decreasing. We're currently monitoring until performance fully returns back to normal.
Purchase fulfillment performance is now back to normal. However, downstream effects are still causing slowdowns in the student courseware. We are currently rolling out a fix for this.
We are noticing reports of delays in learners' enrollment status updating after a purchase. We have identified the issue and are working to bring performance back up to normal speed.
Report: "Inconsistent check-out and course experience"
Last updateStudent courseware and the checkout (purchase) experience have continued to maintain normal performance, so this issue is now resolved.
Student courseware and the checkout (purchase) experience have continued to maintain normal performance, so this issue is now resolved.
Student courseware and the checkout (purchase) experience have both returned to normal performance. We are continuing to monitor the situation to ensure no further performance issues.
We have identified the issue and have begun to address it. The purchase (checkout) experience has returned to normal performance.
We are investigating an issue that may impact the purchasing experience and interrupt learning in courses for a subset of learners.
Report: "fulfillment of customer purchasing courses"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
we're investigating an infrastructure issue that is indirectly impacting fulfillment of customer purchasing courses (preventing them from receiving the courses they're buying)
Report: "Course Access Issues"
Last updateThis issue has been resolved and all courses are now fully accessible
A fix has been implemented and all courses seem to be fully accessible now. We are currently monitoring things.
We have identified the cause of the issue and are currently working on bringing access to the courses back online.
We are getting reports of learners unable to access some of their enrolled courses. We're aware of the issue and currently investigating.
Report: "LMS Availability"
Last updateAccess to courses has been fully restored and our support team is working to respond to tickets that were created during this period.
A fix for this issue has been made and we're now observing normal behavior return to the learning management system and courses. We'll continue to monitor performance.
We are currently investigating a recurrent issue that may prevent access to courses within the learning management system and slow our support ticket response time.
Report: "LMS Availability"
Last updateAccess to courses has been fully restored and our support team is working to respond to tickets that were created during this period.
A fix for this issue has been made and we're now observing normal behavior return to the learning management system and courses. We'll continue to monitor performance.
We are currently investigating an issue that may prevent access to courses within the learning management system and slow our support ticket response time.
Report: "Password Reset Link Issue"
Last updateThis issue has been resolved. Users should be able to reset passwords. Please reach out to support if still having issues resetting your password.
We have identified a potential cause of the issue and are currently implementing a solution.
We are continuing to investigate this issue. If you are having issues resetting your password, please reach out to edX Support at info@edx.org.
We are hearing reports that learners are not able to reset their passwords as the confirmation emails contain faulty links. We are currently investigating the issue.
Report: "Enrollment Disruption"
Last updateThe issue has been resolved. If you are still running into issues with completing the enrollment process, please log out of edx.org and log back in.
We have identified this as an issue related to cookies and the engineering team is currently working on a fix. In the meantime, for the subset of learners experiencing issues with enrollment, clearing cookies for edx.org should help.
We are currently investigating reports and data indicating that a subset of learners are not able to complete enrollment in courses from the edx.org site.
Report: "Assessment Errors"
Last updateThis issue has been resolved. Learners may want to check their progress on an any active assessments prior to their due date.
The fix has been deployed and we're seeing a positive effect on error rates, we'll continue to monitor performance and update as needed.
Our engineers have identified a possible cause of the issue and are working to deploy a fix.
We are currently investigating errors related to assessments that may be impacting the ability for learners to submit content.
Report: "Access to Certificates"
Last updateBetween 1:35PM and 2:50PM ET viewers (learners or public) of program certificates and learning records may have encountered slow or unresponsive performance from edx.org. The issue has been resolved by our engineering team.
Report: "Degraded Experience on LMS"
Last updateA subpopulation of learners and course team members encountered slow response times from the LMS for ~30min beginning at 10:03am ET. The incident has been resolved by engineering.
Report: "Courseware Latency"
Last updateThe edX Learning Management System (LMS) and Studio experienced a period of longer-than-expected latency and some errors related to xBlocks between 3:05AM and 9:05AM ET. This issue resulted in lagging performance which may have impacted learners ability to progress in courses. Our engineering team worked to resolve the issue via multiple avenues and was able to restore full performance.
Report: "3rd Party Course Tools"
Last updateThe issue has been identified and resolved.
We are investigating reports of 3rd party course tools (i.e. LTIs) not working as expected in the learning experience. Learners may face challenges completing lessons or assignments that require third party tools such as coding environments, specialized content, etc...
Report: "Search Page Disruption"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are investigating errors related to traffic on the search page of edx.org. Users may experience intermittent issues loading the search page.
Report: "Course Outline Page Load"
Last updateOur team has determined that these errors are not impactful to learners and have addressed the situation.
Our engineers are investigating a series of errors apparent in our monitoring tools for the Course Outline page on a subset of courses. End users may experience intermittent disruption in course navigation.
Report: "Marketing Pages Unavailable"
Last updateMarketing pages were unavailable to site visitors from ~3:18pm ET to 3:30pm. The issue has been resolved.
Report: "Coupon usage"
Last updateThis issue has been resolved, we observe normal coupon usage in checkout.
A fix has been implemented and engineers are monitoring for continued stability.
The issue has been identified and engineers are working to improve the experinece.
Learners are reporting that coupons are not working during checkout. Our engineers are currently investigating.
Report: "Degraded Learning Experience"
Last updateThe edx.org LMS served a degraded experience to learners and course teams for ~30 min beginning at 4:33am ET. Engineering resolved the issue at 5:01am ET.
Report: "Program Certificates and Learning Records Unavailable"
Last updateFrom 2:38pm ET until 4:15pm the Credentials Service, which displays learner certificates and records, was interrupted - preventing users from accessing program certificates and learning records. The service has been restored and our team is monitoring performance.
Report: "Course Content and Discussion Forums Services Unavailable"
Last updateAt 6:38am ET the Course Content, Studio, and Discussion Forums services were unavailable to learners and authors for 18 minutes. Engineers resolved the issue at 6:56am.
Report: "Degraded Experience for Learners and Authors"
Last updateBeginning at 10:35pm ET on April 9th several services were disrupted or unavailable to learners and authors - including Studio, Discussion Forums, and Javascript-heavy learning blocks such as video, LTI, and some problem types causing a degraded experience for learners for ~10 hours. Engineers resolved the issue at 8:30am on April 10th.
Report: "Disruption for Subpopulation of Users"
Last updateAt 6am ET, a caching server failed causing disruption in many edx.org services, including: login, pageload, exams, and proctoring for a subpopulation of users for ~3.5 hours. At 9:30am the server was rebooted, and learner experience improved temporarily. At 12pm, the problem arose again and our team took several corrective actions to improve performance, at 1pm, the issue resolved.
Report: "Disruption for Subpopulation of Users"
Last updateAt 5am ET, a caching server failed causing disruption in many edx.org services, including: login, pageload, exams, and proctoring for a subpopulation of users for ~2 hours. At 6:30am identified unanticipated surging traffic as the root cause for this and previous events and added additional hardware, which resolved the issue.
Report: "Disruption for Subpopulation of Users"
Last updateAt 5am ET, a caching server failed causing disruption in many edx.org services, including: login, pageload, exams, and proctoring for a subpopulation of users for ~9 hours. At 2pm, the issue resolved.
Report: "Checkout currently not available on payment.edx.org. PayPal is available."
Last updatePayment issues resolved. Check out is fully available. Our payment provider experienced elevated error rates that temporarily prevented checkout on edX.org.
Learners are unable to checkout on payment.edx.org. Please do not attempt to pay for a course at this time.
Report: "Degraded Performance on edx.org"
Last updateThis incident has been resolved.
The issues on edx.org are recovering. We are actively monitoring performance on edx.org.
edx.org is currently experiencing intermittent performance issues. Users may experience difficulty loading course and authoring pages. Our engineers are actively investigating.
Report: "Intermittent Performance Issues on edx.org"
Last updateThis incident has been resolved.
The intermittent performance issues on edx.org have been resolved.
The intermittent issues have recovered. We will continue to actively monitor performance.
edx.org is currently experiencing intermittent performance issues. Users may experience difficulty loading course pages. Our engineers are actively investigating.
Report: "Student Courseware Increased Latency"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
courses.edx.org is experiencing issues. Our engineers are currently investigating. End users may experience intermittent slowness
Report: "Software Secure Proctored Exams and ID Verification Outage"
Last updateedX systems are now running smoothly. While our service providers continue to work towards a full recovery, performance across our services is now stable.
A fix has been implemented and we are monitoring the results.
There is an issue with Software Secure proctored exams and ID verification that is currently being investigated. Please do not attempt your Software Secure exam or ID verification at this time.
Report: "Degraded performance for edge.edx.org background processes"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
The root cause has been identified and a fix is currently being deployed.
We are aware that there may be issues with background processes on edge.edx.org and are investigating the issue.
Report: "Degraded Performance on edx.org"
Last updateedX experienced a momentary performance degradation. Our engineers are currently investigating. End users were unable to access courseware, watch videos, or submit some assignments briefly.
Report: "Primary Payment System Down"
Last updateOur engineers identified an issue with our primary payment provider shortly after 2:35 PM ET. The issue was resolved at 4:06 PM ET. Learners were able to use PayPal to complete payments during this time.
Report: "We are investigating issues with the course dashboard"
Last updateThe issue with the dashboard for enterprise learners has been identified and resolved.
We are investigating issues with the course dashboard, we apologize for the inconvenience.
Report: "Unexpected courseware outage"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Courseware is under unexpected maintenance. We have identified the issue and our engineers are working to implement a fix. We apologize for any inconvenience.
Report: "www.edx.org down due to cloudflare outage"
Last updateThe issue has been resolved.
Cloudflare is back up, we're keeping an eye on things.
www.edx.org and the LMS are both down or partially unreachable due to a cloudflare DNS outage. We are monitoring the situation and working on a resolution.
Report: "Database maintenance Checkout"
Last updateThis incident has been resolved.
We are performing emergency maintenance on the Checkout service due to scaling issues, we apologize for the inconvenience. We should be back momentarily.
Report: "Database maintenance"
Last updateThis incident has been resolved.
We are performing emergency maintenance on the Checkout service due to scaling issues, we apologize for the inconvenience. We should be back momentarily.
Report: "Intermittent Performance Issues on edx.org"
Last updateThe intermittent performance issues on edx.org have been resolved.
The course page load issues on edx.org are recovering. We are actively monitoring performance on edx.org.
edx.org is currently experiencing intermittent performance issues. Users may experience difficulty loading course pages. Our engineers are actively investigating.
Report: "Database related slow down"
Last updateThis incident has been resolved.
The issue has resolved and we are continuing to monitor for any further issues.
We are currently investigating this issue.
Report: "Insights is under maintenance"
Last updateThe maintenance has been completed, thank you for waiting.
We are currently upgrading instructor analytics and it will be briefly unavailable, we apologize for the inconvenience. It will be back up momentarily.
Report: "Partial outage of edx.org"
Last updateThis incident has been resolved.
We're continuing to monitor the issue, but courses.edx.org and studio.edx.org are back online.
Performance issues on edx.org have recovered. At this time, users in Studio will be unable to access the service. We are actively working on a fix.
The issue has been identified and a fix is being implemented.
We are attempting to scale up our services to manage increased load.
Report: "Database related slow down."
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
We've scaled up our database infrastructure to meet current demand.
We are attempting to scale up our services to manage increased load.