Historical record of incidents for MIT
Report: "ServiceNow Upgrade – Post-Upgrade Issue: Atlas App Live Chat Unavailable"
Last updateFollowing the completion of the ServiceNow Yokohama upgrade, we have identified an issue with the live chat feature in the Atlas mobile app. Users are currently unable to connect with Service Desk agents via live chat. Our team is actively investigating and working to resolve this as quickly as possible. All other ServiceNow functions remain operational. We will provide further updates as more information becomes available. If you need assistance, please submit a support ticket via email at servicedesk@mit.edu or telephone at 617-253-1101.
Report: "Scheduled Network Maintenance - SN, BTP119, SAE (FSILG Locations)"
Last updateDue to a scheduled network maintenance, MITnet including wired, wireless, BMS networks and VoIP telephones will be unavailable at times in FSILG Locations SN, BTP119, SAE on Wednesday 6/4/25 between 8:00am - 2:00pm.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Report: "Scheduled Network Maintenance - TX, PDT, SN (FSILG Locations)"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Due to a scheduled network maintenance, MITnet including wired, wireless, BMS networks and VoIP telephones will be unavailable at times in FSILG Locations TX, PDT, SN on Tuesday 6/3/25 between 8:00am - 2:00pm.
Report: "reports.mit.edu (cognos services) currently down"
Last updateThe service at reports.mit.edu should be available again for all users. Thank you again for your patience.
An AWS hypervisor failure is currently disrupting the cognos service at reports.mit.edu. We currently do not have an ETA for when service will be restored. Thank you for your patience.
Report: "reports.mit.edu (cognos services) currently down"
Last updateThe service at reports.mit.edu should be available again for all users. Thank you again for your patience.
An AWS hypervisor failure is currently disrupting the cognos service at reports.mit.edu. We currently do not have an ETA for when service will be restored. Thank you for your patience.
Report: "Scheduled Network Maintenance - Building 76"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Due to a scheduled network maintenance, MITnet including wired, wireless, BMS networks and VoIP telephones will be unavailable at times in Building 76 first floor. Saturday 5/31/25 between 5:00am - 2:00pm.If you experience any network issues after the posted maintenance period, please contact the Service Desk at 617-253-1101 or servicedesk@mit.edu
Report: "Phone System Maintenance"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
On Thursday 5/22/25, between 6:00 p.m. and 10:00 p.m. IS&T will be completing a minor configuration change to the campus telephone system. No interruption of service is expected. If you experience any telephone related issues after the posted maintenance period, please contact the Service Desk at 617-253-1101 or servicedesk@mit.edu
Report: "Zoom Service Outages"
Last updateThis incident has been resolved.
Zoom has restored most services. IS&T is continuing to monitor the situation.
Zoom is experiencing service outages impacting areas including phone, video conferencing, and workspace. Zoom is aware of this outage and is working to restore services. Further updates on the service outage can be found at https://status.zoom.us. IS&T will communicate any service status change as soon as we have more information.
Report: "Instructure"
Last updateThis incident has been resolved.
Partial System Outage
Report: "Investigating Network Outages"
Last updateThis incident has been resolved.
IS&T has received reports of degraded network performance affecting multiple MIT services, including websites, servers, and apps. We are currently investigating and will provide updates as soon as possible.
Report: "Warehouse Data Access Unavailable"
Last updateAll data warehouse access has been restored. This incident is now resolved.
As of 5:00 p.m., all warehouse data access, with the exception of Edacca access, has been restored to users. Edacca access is currently being restored and will be available soon. Please continue to direct any questions to warehouse@mit.edu.
During a planned maintenance window in the Warehouse to support Daylight Savings Time, we experienced an issue with the SAP scheduler, which impacted authorization data. The data in the warehouse is stable, but user access to the data is unavailable at this time. We are working with SAP to correct this issue and re-run authorizations, and we are working to make the data available this afternoon. Please direct any questions about this incident to warehouse@mit.edu.
Report: "Instructure"
Last updateThis incident has been resolved.
Partial System Outage
Report: "Microsoft 365 and Outlook login issues"
Last updateThis incident has been resolved by Microsoft.
Microsoft has indicated that a majority of impacted services are recovering following their change. IS&T will keep monitoring until impact has been resolved for all Microsoft services.
Microsoft has identified a recent code change to a portion of their M365 service infrastructure that they suspect is causing the login issue. They have also reverted the code change, and are monitoring service health telemetry to confirm if the reversion is returning service to expected functionality. Outlook access has appeared to have been restored. IS&T is monitoring Microsoft status to confirm when M365 service is fully restored.
Microsoft 365 and Outlook services are currently down and inaccessible. Email is inaccessible because of this service disruption. This also affects other M365 services like Teams and Sharepoint. Microsoft is investigating an issue in which users may be unable to access Outlook features and services. Live updates from Microsoft can be found at https://x.com/MSFT365Status. We'll update the MIT community as we receive additional information.
Report: "Slack Connectivity, API Issues"
Last updateThis incident has been resolved.
Most issues related to Slack APIs and Workflows should now be resolved; however, Slack continues to monitor issues with mentions and replaying older events: https://slack-status.com/
Slack is experiencing widespread connectivity, app, and API issues. Users may experience problems with Slack log-ins, load times, and other API-related features such as messaging, workflows, and threads. Slack is aware of the issue and is working to resolve: https://slack-status.com/
Report: "MIT call centers unavailable"
Last updateThis incident has been resolved.
Service has been restored to all impacted call centers. IS&T will continue to monitor the situation.
All MIT call centers routing through Zoom are currently unavailable. IS&T is working with Zoom to restore service as soon as possible. Calls made to the following departments may fail: MIT Health Admissions Atlas Service Center Benefits Payroll Student Financial Services Teachremote Support
Report: "Duo SMS/Phone call authentication delivery failures"
Last updateDuo has declared this incident resolved. More information from Duo is available here: https://status.duo.com/incidents/h7lht3g1zv9w
Duo is currently experiencing SMS/Phone Call delivery failures. Push authentication is not impacted and can be used as an alternative authentication method. Duo has identified the issue and are working to deploy a fix. More information from Duo is available here: https://status.duo.com/incidents/h7lht3g1zv9w
Report: "ServiceNow Ticket Generation"
Last updateThis incident has been resolved.
Emails sent to teams using ServiceNow ticketing queues on Thursday, January 30, between 7:30 p.m. and 9:55 a.m. Friday, January 31 EST, were not generating tickets as expected. Ticket generation for newly received emails has been restored. Any emails sent during the outage window (that did not generate ServiceNow tickets) are being reprocessed to generate their respective ServiceNow tickets. IS&T is continuing to monitor the situation.
Report: "MIT Wikis Service"
Last updateThis incident has been resolved.
A fix has been implemented and IS&T is monitoring the service.
IS&T has identified a load issue on MIT Wikis service (https://wikis.mit.edu) and is applying changes to address it.
Report: "MIT infrastructure services unavailable - including Touchstone login"
Last updateThis incident has been resolved.
A fix was implemented and infrastructure services are restored. IS&T is monitoring services to confirm resolution.
IS&T is aware that several services, such as Touchstone login, Moira and LDAP are unavailable due to an infrastructure failure. IS&T has identified the issue and is working with vendor support on a resolution.
Report: "ServiceNow Ticket Generation"
Last updateThis incident has been resolved.
Emails sent to teams using ServiceNow ticketing queues on Thursday, January 9, between 12:00 a.m. - 10:00 a.m. EST were not generating tickets as expected. Ticket generation for newly received emails has been restored. Any emails sent during the outage window (that did not generate ServiceNow tickets) have been reprocessed to generate their respective ServiceNow tickets. IS&T is continuing to monitor the situation.
Report: "MIT's Webex service to be retired August 30"
Last updateThis incident has been resolved.
MIT's Webex service will be retired on August 30, 2024. No new MIT accounts will be created after June 7, 2024. For video conferencing, use MIT's Zoom service: https://mit.zoom.us
Report: "MIT Secure WiFi Issue"
Last updateThe issue impacting MIT Secure has been resolved. If you are still experiencing trouble, please reboot your device and try again. If issues persist, contact servicedesk@mit.edu.
Report: "Trouble Connecting to Exchange Online"
Last updateMicrosoft has declared this issue resolved.
Microsoft has applied a fix and is monitoring the situation.
Microsoft's Outlook email service is experiencing connectivity issues. More information from Microsoft is available here: https://x.com/MSFT365Status/status/1860973220662280356
Report: "Email Delivery Delays to External Addresses"
Last updateThis incident has been resolved.
IS&T is investigating reports of delivery delays and rejections to yahoo.com, aol.com and verizon.net addresses. Microsoft has been engaged to help investigate the issue.
Report: "Microsoft Outlook performance issues"
Last updateThis incident has been resolved.
Microsoft has applied a fix and shared the following update. Please take note of the action users need to take to resolve the trouble: "We've applied a configuration update and our testing indicates that this action has successfully mitigated impact. However, affected users will need to take action to apply the changes we've made and remediate the problem: - Outlook client and app users should restart their client or app to apply our changes. Outlook desktop client users may need to perform this action twice due to caching issues. - Outlook on the web users should refresh their sessions. If that does not mitigate the issue, users are encouraged to clear their browser cache and refresh their Outlook on the web session. We're working with impacted customers and are continuing to perform tests across the affected infrastructure to confirm that impact has been successfully addressed."
Microsoft's Outlook email service is experiencing significant performance issues. Microsoft believes it has identified the problem and is preparing to apply a potential solution. More information from Microsoft is available here: https://x.com/MSFT365Status/status/1844429360909988135.
Report: "Microsoft 365 services unavailable"
Last updateThis incident has been resolved.
Microsoft 365 services are recovering, and they have made the following update available: "We've worked with the third-party Internet Service Provider (ISP) and confirmed that a change within their managed-environment resulted in impact. The ISP has reverted the change and we're now seeing signs of recovery. We're continuing to monitor network telemetry data to ensure a full recovery."
Microsoft is reporting, via X, that users may be unable to access multiple Microsoft 365 services: https://x.com/msft365status/status/1834209876379042186?s=46&t=plkhHK12y7WoKRX_fWu9Yw IS&T is monitoring the situation and will provide updates as they become available.
Report: "DNS Resolution Issues"
Last updateThis incident has been resolved.
A fix to DNS has been implemented and we are monitoring to confirm resolution. Any lingering issues may be a result of a local cache and should recover shortly.
IS&T is aware of DNS resolution issues that are affecting multiple services and systems at MIT. We are currently looking into this and will have an update as soon as possible.
Report: "canvas.mit.edu - Some users may be experiencing slowness"
Last updateInstructure has resolved this issue successfully.
Instructure has implemented a fix and we are monitoring the results to verify that Canvas access is no longer impacted. Any updates from Instructure can be found at https://status.instructure.com.
Some users may experience slowness when accessing https://canvas.mit.edu. Instructure is continuing to investigate this issue with the Canvas service. Any updates from Instructure can be found at https://status.instructure.com. MIT will update 3down as we receive additional information from Instructure.
Report: "Recurring ServiceNow service interruption"
Last updateThis incident has been resolved.
ServiceNow service has been restored. IS&T will continue to monitor the situation.
The ServiceNow platform is experiencing another service interruption. IS&T has confirmed that the interruption is impacting multiple ServiceNow customers. We will closely follow the event and provide updates as they become available.
Report: "ServiceNow service interruption"
Last updateThis incident has been resolved.
ServiceNow service has been restored. IS&T will continue to monitor the situation.
IS&T has received reports that some community members cannot log in to the ServiceNow platform. We have confirmed that this service interruption is impacting multiple ServiceNow customers. We are closely following the event and will provide updates as they become available.
Report: "MIT Guest network unavailable"
Last updateThis incident has been resolved.
IS&T's infrastructure team has identified the issue and deployed a fix. MIT Guest should now accept connections, and IS&T will actively monitor the network's performance.
The MIT Guest wireless network is down campus-wide. IS&T is actively working to isolate the issue and restore service.
Report: "MIT Touchstone to be powered by Okta starting June 17"
Last updateThis incident has been resolved.
This change has been implemented and we are monitoring the results.
IS&T will update MIT’s Touchstone single sign-on (SSO) service configuration on June 17 so that all Touchstone-enabled systems will use the new version of the service, now powered by Okta. Learn more: https://ist.mit.edu/news/touchstone-okta
Report: "eShip Global and receipts.mit.edu unavailable"
Last updateThe issue regarding eShip Global and receipts.mit.edu was resolved last night around 11pm. We apologize for any inconvenience this may have caused.
The application problems with eShip Global, receipts.mit.edu are known and IS&T is working to resolve the issue as quickly as possible. IS&T will update the status as soon as more information becomes available.
Report: "Atlas timesheet access unavailable"
Last updateThis incident has been resolved.
Update: The certificate for http://hecps1web01.mit.edu has been renewed. Users should now be able to access timesheets via Atlas. If you still experience an error, please contact the IS&T Service Desk: servicedesk@mit.edu or 617-253-1101
Timesheet access through Atlas is currently available. Users will encounter an error indicating the certificate for http://hecps1web01.mit.edu has expired. IS&T is actively working on resolving the issue.
Report: "Crowdstrike Issue Causes Windows Blue Screen Error"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
A recent worldwide Crowdstrike update is causing a Windows OS blue screen error on all versions of the Windows operating system running the Crowdstrike software. Crowdstrike has released an update to resolve the issue. To apply the update to an impacted machine, restart it. If you continue to experience difficulty following a restart, the following steps are a workaround solution: 1. Boot Windows into Safe Mode or the Windows Recovery Environment 2. Navigate to the C:\Windows\System32\drivers\CrowdStrike directory 3. Locate the file matching “C-00000291*.sys”, and delete it. 4. Boot the host normally. The steps above require administrative access to complete. IS&T is working to restore central services that rely on Microsoft Windows. Crowdstrike has posted a statement on the incident: https://www.crowdstrike.com/blog/statement-on-falcon-content-update-for-windows-hosts/ If you require assistance with the workaround, obtaining admin credentials, or a Bitlocker recovery key, please contact the Service Desk at 617-253-1101 or servicedesk@mit.edu.
Report: "Dropbox Access Issues"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
MIT's Dropbox environment is unavailable from some Dropbox clients. IS&T has reported this issue to Dropbox support and is monitoring the situation. Further details and status can be found at the Dropbox status page (https://status.dropbox.com/).
Report: "MIT Sites Authentication"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
A login issue is impacting the MIT Sites service (https://sites.mit.edu). IS&T has opened a ticket with the vendor, who is investigating. Public content that does not require touchstone authentication is unaffected.
Report: "Zoom Phone Outage"
Last updateThe issue was identified and resolved. Details can be found here: https://status.zoom.us/incidents/j8jmzp10p36m
IS&T is aware of an issue reported with Zoom Phone and is following up with Zoom. More details can be found here: https://status.zoom.us/incidents/j8jmzp10p36m
Report: "MIT's Buy2Pay system (Coupa) is down"
Last updateThis incident has been resolved.
Services are beginning to restore and we are actively monitoring the situation.
MIT’s Buy2Pay system (Coupa) is down. IS&T and Coupa resources are investigating. We will provide an update when more information becomes available.
Report: "W91 Data-Center: Network Equipment Failures due to Power Issues in West Campus"
Last updateThis incident has been resolved.
As a result of the power issues this morning that affected West Campus, various network equipment in the W91 data-center has failed. IS&T is working to replace each piece of failed equipment and restore service.
Report: "Warehouse Load Failures"
Last updateThe cause of the load failures have been corrected.
Data Warehouse is actively addressing the issues that led to load failures last night. While some of the data may be currently stale, we are diligently working to restore to normalcy. We apologize for any inconvenience and will provide an update once everything is resolved.
Report: "Wi-Fi: "MIT SECURE""
Last updateThis incident has been resolved.
IS&T is currently investigating reports it has received regarding some users experiencing difficulties connecting to the "MIT SECURE" Wi-Fi network.
Report: "Forwarded Email Delays"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
IS&T has identified an issue causing delays in delivery of some forwarded email.
Report: "MIT Cognos (reports.mit.edu)"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
IS&T is investigating an issue with MIT Cognos (reports.mit.edu) where users are unable to authenticate.
Report: "MIT Travel / Concur"
Last updateThis issue has been resolved.
Intermittent issues occurring with logins through the SAP Concur website and SAP Concur mobile app. Affected users may receive the following error: “An error occurred while processing your request”, when attempting to log in. The Concur Incident Response Team (IRT) is currently investigating and will provide an update in one hour or sooner should a significant change occur. Current status can be found on open.concur.com.
Report: "Wi-Fi: "MIT GUEST""
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
IS&T has received reports and confirmed users unable to access sites on the Internet after registering on the "MIT GUEST" Wi-Fi network.
Report: "tableau.mit.edu currently unavailable"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results. Thank you again for your patience.
IS&T has identified the issue and is implementing a fix. Thank you for your patience.
IS&T is aware of and investigating an issue with the service at tableau.mit.edu.
Report: "Wikis Space Permissions"
Last updateThis incident has been resolved.
A fix has been implemented. If you continue to have permissions issues with MIT Wikis, please contact the IS&T Service Desk.
The issue has been identified and a fix is being implemented.
IS&T is investigating an issue related to space permissions and access on wikis.mit.edu.
Report: "Instructure"
Last updateThis incident has been resolved.
Partial System Outage
Report: "“Data Warehouse – Status of SAP Data”"
Last updateThis incident has been resolved.
To: All Data Warehouse users, This is a notification that some of the January 11th data received from various data sources is not yet available in the warehouse. The data that has been impacted includes, but may not be limited to: - Financial data – cost objects, fund centers, project wbs, etc - Roles data - Payroll data - SAP Lookups / additional master data - Purchasing / change log data - Balances / Budgets data - MITSIS data - COEUS data - Budget data There was a database resource allocation issue that caused the problem. This has been addressed and technical resources are working on refreshing the warehouse with additional January 11th data. The warehouse data is expected to be up to date this evening. Please visit http://3down.mit.edu/ for updates during the outage. If you have any questions about this system outage please feel free to reach out to warehouse@mit.edu. Thank you for your patience and understanding during this time.
Report: "Instructure"
Last updateThis incident has been resolved.
Partial System Outage
Report: "MITnet: Mutliple Services Impacted Due to Inability to Resolve Internet DNS Hostnames"
Last updateAn issue related to a vendor's maintenance resulted in the inability to resolve various hostnames served by that vendor's DNS. This impacted multiple services on MITnet that relied upon resolving those hostnames. Action was taken by IS&T to remedy the issue while the vendor's maintenance was completed.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
IS&T is aware and is currently investigating an issue that is preventing DNS resolution of some Internet sites. This issue appears to be impacting a number of services.
Report: "Issue with newly provisioned HID Mobile IDs"
Last updateHID and Apple have implemented a fix to resolve this issue. MIT Mobile ID provisioning has been re-enabled
HID and Apple have implemented a fix to correct this issue. MIT Mobile ID provisioning has been re-enabled. IS&T is monitoring the resolution to make sure there is no further impact.
IS&T has been made aware of an issue concerning University HID Mobile IDs that may be impacting our community. HID reports that Apple Wallet Mobile IDs provisioned after December 18, 2023, may be unable to engage with card readers to provide access. HID is actively collaborating with Apple to implement a fix with a resolution in place by December 22nd, 2023. If you’ve provisioned a new mobile ID since December 18, 2023, and are experiencing issues with access please contact the ServiceDesk at 617-253-1101 or servicedesk@mit.edu IS&T will provide more updates as soon as they become available.
Report: "“Data Warehouse – Status of SAP Data”"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
To: All Data Warehouse users, This is a notification that some of the data we receive from SAP has not been refreshed since the SAP Support Pack Upgrade that occurred this weekend. During the scheduled maintenance outage, SAP’s Year-End Support Packages were installed, bringing MIT’s SAP implementation up to the support package level required for annual Accounts Payable and HR/Payroll system compliance, however there were changes made that impacted the extract process. The data that has been impacted includes, but may not be limited to: - Financial data – cost objects, fund centers, project wbs, etc - Roles data - Payroll - SAP Lookups / additional master data - Purchasing / change log - Balances / Budgets The SAP teams are working to resolve this issue. Please visit http://3down.mit.edu/ for updates during the outage. If you have any questions about this system outage or the maintenance being performed, please feel free to contact Kevin Lyons at klyons@mit.edu Thank you for your patience and understanding during this scheduled system maintenance.
Report: "MIT OIDC Service Down"
Last updateThis service has been decommissioned.
An issue with OIDC authentication service hosted at https://oidc.mit.edu has been identified. IS&T is investigating.
Report: "tableau.mit.edu service degraded"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results. Tableau production services should be accessible to all users at this time.
The issue has been identified and a fix is being implemented.
We are currently in contact with Tableau support regarding an issue with licensing in our production environment.