Historical record of incidents for Pulsant Service
Report: "INC0101000 - Multiple clients have reported routing issues that are causing outages"
Last updateThis incident has been resolved.
Pulsant have implemented a workaround by updating our routing to bypass the upstream provider.Investigation is ongoing with our upstream provider.If you are still encountering issues please contact Pulsant support.
Pulsant are currently investigating a routing issue that is affecting multiple clients.It is currently believed to be caused by an upstream provider.If you believe you are affected by this outage please contact Pulsant support(0345 119 9900).
Report: "Outage Investigation"
Last updatePulsant Infrastructure engineers have located a change that has now been rolled back. Pulsant are now seeing recovery alerts.If you are still experiencing any impact please contact Pulsant support.
Pulsant are currently aware of a service outage.Our Network Infrastructure team is currently investigating the issue.
Report: "INC0101000 - Multiple clients have reported routing issues that are causing outages"
Last updateThis incident has been resolved.
Pulsant have implemented a workaround by updating our routing to bypass the upstream provider. Investigation is ongoing with our upstream provider. If you are still encountering issues please contact Pulsant support.
Pulsant are currently investigating a routing issue that is affecting multiple clients. It is currently believed to be caused by an upstream provider. If you believe you are affected by this outage please contact Pulsant support(0345 119 9900).
Report: "Outage Investigation"
Last updatePulsant Infrastructure engineers have located a change that has now been rolled back. Pulsant are now seeing recovery alerts. If you are still experiencing any impact please contact Pulsant support.
Pulsant are currently aware of a service outage. Our Network Infrastructure team is currently investigating the issue.
Report: "DRaaS Issue Identified at Edinburgh SC-1 (South Gyle)"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
We are currently investigating an issue with DRaaS at Edinburgh SC-1. Updates will be provided periodically while a fix is implemented.
Report: "Fibre fault located at SE-4"
Last updateThis incident has been resolved.
Pulsant's Third-party fibre provider has repaired the fibre break. We will continue to monitor. If you believe you are still being impacted please contact Pulsant Support.
Pulsant's Third-party fibre provider has assessed the fibre fault and found multiple breaks. Repair plan is under review. Client circuits are stable and being continually monitored.
Pulsant's Third-party fibre provider has assessed the fibre fault and found multiple breaks. Next steps are to excavate a pit to allow the fibre repair. We are currently awaiting an ETA to begin the work.
Pulsant engineers have been preforming testing and have located the fibre fault. A Third party has been engaged to attend site on 01/04/25 to assess and repair damaged cabling.
The investigation into the fibre fault is ongoing. Additional Pulsant resources have been engaged to assist. Please update the Pulsant support team if you are seeing an impact.
Pulsant have been made aware of a fibre fault in Reading SE-4. We have observed a number of alerts and are actively investigating. This is currently believed to only be a loss of resilience. If you believe you are seeing any impact please contact Pulsant support.
Report: "UPS fault in Pulsant Datacentre SC-1 Data hall 6"
Last updateThis incident has been resolved.
Emergency maintenance has been successfully completed, and UPS unit fault has been resolved. Further action is underway due to the identification of battery autonomy degradation as a result of the fault. Pulsant engineers are actively monitoring UPS status in Datacentre SC-1 data hall 6 following the work and until the follow-up activities are completed. No client impact is anticipated.
Pulsant Datacentre engineers have located a fault with a UPS unit in Datacentre SC-1 data hall 6 leading to a loss of resiliency. Emergency work is to be completed between 8:00 to 17:00 on 09/02/2025. No client impact is anticipated.
Report: "Pulsant Network Issues Identified"
Last updateThis incident has been resolved.
A fix has been implemented and we are seeing services back online from our monitoring systems. If you are experiencing further issues, please contact Pulsant support. We will continue to monitor.
Investigations are still underway currently and updates will be provided as troubleshooting continues. We appreciate your patience at this time.
We are currently investigating network issues affecting a number of clients. Updates will be provided as soon as possible.
Report: "Emergency Network Maintenance in Maidenhead SE-2 IP Fabric - Wednesday 26th February 21:00 GMT - Thursday 27th February 00:00 GMT"
Last updateEmergency Network Maintenance in Maidenhead SE-2 IP Fabric successfully completed with full resilience being restored.
Please be aware of the following emergency network maintenance. What: The Network Infrastructure team will be performing a core network maintenance on our IP Fabric switches located in Maidenhead SE-2, in response to a device failure. As with any maintenance activity, there is an element of risk, although there is no expected impact as this is a resilient service. Why: This work is required to resolve a failed device in our IP fabric at the recommendation of the vendor. When: The maintenance will take place during the following window: Start: Wednesday 26th February 21:00 GMT End: Thursday 27th February 00:00 GMT If you have any questions, please raise a ticket by emailing support@pulsant.com or by calling our support team directly.
Report: "Virgin Media Outage"
Last updateLatest update from Virgin Media- We're pleased to advise that our Supports Teams have now restored services impacted by this outage. We apologise for any inconvenience this issue may have caused. Please re-test your services and let us know if you are experiencing any further issues. Root cause investigations are ongoing and RCA analysis will be provided in due course. Monitoring remains in place for a period of time to ensure service stability.
Latest update from Virgin Media - Services from VMO2 continue to improve and the majority of services are recovering, please re-test your services. Please update your Pulsant case to advise if services have recovered and remained stable.
Latest Update from Virgin Media 14:19 - We're aware that some customers are experiencing intermittent issues with their services. We apologise for any inconvenience and are working to fix this as a priority. While some customers are seeing their service restored, we don't yet have full recovery and teams remain focused on that.
Virgin Media have confirmed they are experiencing multiple outages ongoing. Some Pulsant clients are experiencing stability to services now, however no specific update to the Pulsant fault reference have been received. Therefore Pulsant cannot confirm if incident is fixed or if stability will continue.
Pulsant are aware of an ongoing Virgin Media outage affecting several Pulsant clients VPN connections and degraded connections. Pulsant is in contact with Virgin Media and will updated ASAP.
Report: "Potential Fibre Fault between IXN LON1 and Telehouse West."
Last updateThis incident has been resolved.
A Fix has been implemented and a cable has been patched at Telehouse west. Service has now restored. We will continue to monitor this and update if any further issues are experienced.
We are currently investigating a potential fibre line fault between third party Data Centres, IXN LON1 and Telehouse West, Cases have been raised with providers and we will provide updates as and when we receive them.
Report: "SE-3 Reduced Management functionality to VM's"
Last updateFull resiliency has been restored. Should any future issues occur, please contact Pulsant Support
A fix has been implemented and we are monitoring the results.
Pulsant are aware of ongoing reduced management functionality for VM's within rack B06. Engineers are working to restore full service ASAP. Apologies for the inconvenience at this time.
Report: "SE-3 Reduced Management functionality to VM's"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Pulsant are aware of ongoing reduced management functionality for VM's within rack B06. Engineers are working to restore full service ASAP. Apologies for the inconvenience at tis time.
Report: "Critical Vulnerability Affecting VMware vCenter Server and VMware Cloud Foundation"
Last updateThis incident has been resolved.
Pulsant Cyber Security are aware of Critical Vulnerabilities impacting VMware vCenter Server and VMware Cloud Foundation. These include a heap-overflow vulnerability (CVE-2024-38812) with a CVSSv3 score of 9.8, and a privilege escalation vulnerability (CVE-2024-38813) with a CVSSv3 score of 7.5. Exploitation of these vulnerabilities has been observed in the wild. Impacted Products: VMware vCenter Server (versions 7.0, 8.0) VMware Cloud Foundation (versions 4.x, 5.x, 5.1.x) Vulnerability Details: Heap-overflow vulnerability in vCenter Server (CVE-2024-38812): Severity: Critical (CVSSv3 9.8) Description: This vulnerability in the DCERPC protocol allows remote code execution when an attacker with network access sends a specially crafted packet to vCenter Server. Resolution: Immediate application of the latest patches from the "Response Documentation" is essential. Privilege escalation vulnerability in vCenter Server (CVE-2024-38813): Severity: Important (CVSSv3 7.5) Description: This vulnerability can enable an attacker to escalate privileges to root by sending a specially crafted packet to vCenter Server. Resolution: Application of the latest patches from the "Response Documentation" is required to remediate this issue. Response Documentation : https://support.broadcom.com/web/ecx/support-content-notification/-/external/content/SecurityAdvisories/0/24968
Report: "Pulsant Support telephone issues"
Last updateThis incident has been resolved.
Telephony issues now resolved. We will continue to monitor this and provide updates if issues re-occur.
We are currently experiencing issues with our telephony system and calls to the support line are not going through as expected. If required, please raise a case with us via the Pulsant Portal - https://portal.pulsant.com/ Alternatively raise a case with us via the Pulsant support email address - support@pulsant.com We apologise for any inconvenience and will provide updates in due course.
Report: "Loss of resilience following 3rd Party planned maintenance - Slough Area"
Last updateThe 3rd party vendor has confirmed restoration of full resilience to services by the resplicing of the fractured fibre and are now seeing bi-directional traffic
Pulsant is aware that following 3rd party planned maintenance , at present there is a loss of resilience on a link within the Slough area. Pulsant will update progress to restore full resilience as quickly as possible.
Report: "LN-1 (Croydon) Data Centre - Pulsant Cloud Loss of resilience"
Last updateThis incident has been resolved.
Full resilience has been restored and being monitored closely. Pulsant engineers investigating to understand root cause.
Pulsant engineers have identified an possible upstream switch failure, resulting in loss of resilience. Investigations are ongoing to restore full resilience as quickly as possible.
Report: "SE1 (Milton Keynes) Firewall Issues Identified"
Last updateNetwork Operations Engineers have successfully replaced a device within SE-1 Data Centre and full resiliency has been restored.
Network Operations Engineers have identified a Firewall fault within SE1 Milton Keynes Data Centre and are working to resolve. Currently there should be no client impact, please contact Pulsant support if you suspect otherwise. Updates will be provided in due course.
Report: "Emails being received issue"
Last updateThis incident has now been resolved.
Pulsant are still experiencing issues with cases being created/updated when sent via Email. We urge all clients to raise cases via the Pulsant portal or by contacting Pulsant support. Portal - https://portal.pulsant.com/ Contact - 0345 119 9999 We apologise for the inconvenience and will provide updates as soon as possible.
These issues have now been resolved and any delayed cases are being worked through urgently. We will continue to monitor and provide updates when required.
We are currently experiencing an issue with our ticket logging system wherein emails are not creating cases or updating cases as expected. If you require assistance urgently, please contact Pulsant Support on 0345 119 9999 or via the Pulsant Portal - https://portal.pulsant.com/ We apologise for the inconvenience this may be causing you. Updates will be provided as soon as possible.
Report: "Unexpected interruption to service - SOFTWARE LIFECYCLE | core.ld5 software upgrade - *Extension to maintenance window*"
Last updateAfter close monitoring, Pulsant are confident that services have remained stable and resolving the incident. Thank you for your continued patience.
Please be advised that the following maintenance is now complete. Please accept our sincere apologies for any inconvenience caused. If you have any questions, please raise a ticket by emailing support@pulsant.com or by calling our support team directly.
Following scheduled maintenance - SOFTWARE LIFECYCLE | core.ld5 software upgrade - 09-DEC-2024 2000-2300hrs Please be advised that the following maintenance window is being extended due to an unexpected outage caused by a software bug. A workaround is in place, however, to ensure stability further emergency work is necessary. Start: 09/12/2024 20:00 GMT End: 10/12/2024 03:00 GMT
Report: "Intermittent Connections - LD5 Slough"
Last updateFull resiliency has been restored as of 1600hrs on December 4th, 2024. Pulsant engineers shut down a LINX connection and reviewed/modified BGP configuration.
A workaround has been implemented and Pulsant continue to monitor closely until fix can be applied
Pulsant are confident the flapping connection has stabilise with isolating some routes. Close monitoring will continue until full resiliency is restored.
Engineers are currently working to isolate the fault the by shutting down LINX and a transit provider to try stablise the connection. Please be aware this means a current loss of resilience for the service during this time, whilst engineers continue to apply a fix.
Pulsant are aware of ongoing intermittent connection issues to some services connected to a Pulsant core device in LD5. Troubleshooting is ongoing to stabilise services as quickly as possible.
Report: "Pulsant Monitoring Incident 23/11/24"
Last updateThe monitoring incident has now been resolved. Pulsant will continue to monitor for 24 hours. If you are experiencing any difficulties please raise a support case or call on Pulsant support on 0345 119 9900.
The monitoring incident has now been resolved. Pulsant will continue to monitor for 24 hours. If you are experiencing any difficulties please raise a support case or call on Pulsant support on 0345 119 9900.
Pulsant have identified a monitoring incident that is currently being investigated. It is not believed to be client affecting, However if you are experiencing any difficulties please raise a support case or call on Pulsant support on 0345 119 9900
Report: "Citrix EU Connection Issues"
Last updateThis incident has been resolved.
Current update from Citrix - Status is UP. Post mitigation most of the impacted customers are able to launch apps and desktops. We continue to monitor.
Citrix Status page update 'We have identified the root cause and are applying mitigations now. Some of the impacted customers should see successful DaaS launches as we they are recovering. https://status.cloud.com/incidents/651542
Pulsant have been made aware of an ongoing incident impacting Citrix EU Customers ' Few EU customers could not launch apps and desktops through DaaS' For up to date information - https://status.cloud.com/incidents/651542
Report: "Dark Fibre Network Issues"
Last updateThis incident has been resolved.
Pulsant's Third-party provider has located and replaced faulty equipment. Pulsant are seeing the wavelength services as restored. Please retest connections and report any issues to Pulsant Support.
We are currently investigating an issue on our Dark Fibre network, specifically wavelength services passing through Telehouse North to Global Switch. We are currently working towards a resolution and will provide an update as soon as possible.
Report: "Degraded service between Manchester and Reading Data Centres"
Last updateThis incident has been resolved.
Pulsant have re-instate the Manchester Linx after a fix was applied and we will continue to monitor. Any queries or issues please contact Pulsant support.
Pulsant have identified the source of the packetloss issue and a fix has been applied. Steps to remove the work around and re-instate the Manchester Linx will take place today (09/10/24).
Pulsant workaround is still in place to mitigate client issues and continue to investigate the technical cause of the intermittent connections. Subject has been updated to reflect investigations. Any queries or issues please contact Pulsant support.
A work around has been put in place by Pulsant to remove the Manchester to Zen Linx connection to mitigate client impact.
Pulsant are aware of a wider issue outside of the Pulsant network. Clients utilising ZEN ISP to access the Pulsant infrastructure may experience an intermittent connection. Please see Zen Status page https://servicealerts.zen.co.uk/
Report: "Unplanned interruption to service at SE-1 (Milton Keynes)"
Last updateServices have remained stable throughout monitoring and the issue has now been resolved. If you experience any further issues please contact Pulsant Support
A fix has been implemented and we are now monitoring service.
We are currently investigating an unplanned interruption of service at our SE-1 Data Centre. Updates will be provided periodically to address progress. Please contact Pulsant support if you are experiencing issues.
Report: "Pulsant Cloud performance issues"
Last updateThis incident has now been resolved. Please contact Pulsant support if you are experiencing any further issues
Pulsant have identified performance issues on Pulsant Cloud for a small number of clients. The root cause of this has been identified and resolved. This will be monitored closely, however please reach out to Pulsant Support if you experience any further issues.
Report: "Pulsant experiencing intermittent issues with emails"
Last updatePulsant have resolved all email issues.
Pulsant are currently experiencing intermittent issues with sending and receiving emails. Please use the client portal or if urgent please call Pulsant support. General enquiries 0345 119 9900 Sales 0345 119 9911 Support 0345 119 9999 Finance 0345 119 9900
Report: "Unplanned interruption to service in LN-1 DataCentre"
Last updatePulsant can confirm that all services have now restored and are stable. Please contact Pulsant support if you are experiencing any further issues
Pulsant have confirmed a restored level of service to all impacted clients, engineers are carrying out remedial works to restore full resiliency to all clients.
A fix has been implemented and we continue to monitor the status of this. Please contact Pulsant Support if you are experiencing any further issues.
Pulsant believe that services are starting to recover and clients are being contacted to test.
An unplanned interruption to service in LN-1 DataCentre has been identified. Engineers are currently troubleshooting and further updates will be provided in due course.
Report: "Third party issue between at Rotherham YH-1"
Last updateFull resiliency has been restored to affected clients at YH-1. If you experience any further issues, please do not hesitate to contact Pulsant support.
Pulsants Third party have advised they have now resolved the issue and Pulsant have confirmed resiliency has been restored. Pulsant will continue to monitor services
Pulsant's third Party have advised, engineers have identified the fault location leading to an inaccessible street cab . The team will be re-dispatched during normal business hours. Pulsant continue to monitor and chase for an ETA of a fix.
Third party engineers have made measurements and are now moving to the suspected damage location. Pulsant will update you as further information becomes available
Pulsant are aware of an issue at Rotherham YH-1. Third party engineers have investigated and identified the issue and Pulsant are currently awaiting an ETA for a fix. Currently Pulsant clients out of YH-1 are running at a lack of resiliency
Report: "Pulsant Cloud - brief interruptions under investigation"
Last updateThis incident has been resolved.
Services remain stable. Work to upgrade software on Pulsant NE-1 cloud has been scheduled for tonight 29/08. All affected clients have been sent comms to advise of work.
Services remain stable, investigations are still ongoing between Pulsant and 3rd party vendors to restore full resiliency.
Services remain stable, investigations are still ongoing between Pulsant and 3rd party vendors to restore full resiliency.
Services remain stable, investigations are still ongoing between Pulsant and 3rd party vendors to restore full resiliency.
Services remain to be stable, however ongoing investigations between Pulsant and 3rd party vendors continue to restore full resiliency.
Pulsant have received reports of brief interruptions to service for Pulsant Cloud. Service appears stable and Network Operations Engineers are currently reviewing logs.
Report: "Third Party Fibre break around the Newcastle area"
Last updateThird party engineers have repaired the fibre break and service has been restored. If you have any further issues please contact Pulsant Support.
Third party engineers have repaired the fibre break and service has been restored. If you have any further issues please contact Pulsant Support.
Pulsant are aware of an ongoing fibre break issue around the Newcastle area. Third party engineers are currently en route to the site to investigate further.
Report: "DUO Notifications - SMS Delivery Issues"
Last updateDUO have resolved the SMS delivery issue and have advised full functionality has been restored. If you have any further issues please reach out to Pulsant Support
Pulsant are aware on an earlier issue where DUO were investigating an issue causing SMS delivery to UK numbers. This looks to be resolved now , but monitoring continues. For the most update information please visit - https://status.duo.com/
Report: "Pulsant Telephone Issues"
Last updateThe incident has now been resolved.
A work around is in place for our telephone system and support engineers are able to take calls. We apologise for any inconvenience this has caused.
We are currently experiencing an issue internally which is effecting our telephone system. If you are experiencing issues reaching us, please contact us via Email - Support@Pulsant.com Alternatively contact us through the Pulsant Portal - https://portal.pulsant.com/ We apologise about the inconvenience.
Report: "Virgin Media Issue - Loss of service between Sheffield & Leeds areas"
Last updateVirgin Media have resolved the fibre break. Pulsant Clients should not be experiencing any further issues. If any further issues are experienced, please engage Pulsant Support
Virgin Media engineers have restored most of the impacted services but they are still investigating some outstanding network alarms related to the outage
Update from Virgin Media; The Network Engineers have tested the fibre span between Leeds and Sheffield and have identified a fibre break. Documentation has been reviewed and the Network Engineers remain engaged, are currently troubleshooting further.
Pulsant are aware of an ongoing Virgin Media issue causing a loss of service on a transmission span between Sheffield and Leeds areas
Report: "Pulsant Portal Issues"
Last updateThis incident has been resolved.
A fix has been implemented and service has now restored. We will monitor this closely and update if service degrades further.
We are currently experiencing issues with the Pulsant Portal. Please contact Pulsant Support if you are experiencing issues on the following numbers: General Enquiries 0345 119 9900 info@pulsant.com Sales 0345 119 9911 sales@pulsant.com Support 0345 119 9999 support@pulsant.com Finance 0345 119 9900 info@pulsant.com
Report: "Pulsant experiencing intermittent telephone issues"
Last updatePulsant have resolved the telephone issues and are able to take calls again.
Pulsant believe this issue to be resolved, and can once again take phone calls. Pulsant will continue to monitor.
Pulsant is currently experiencing intermittent issues with our telephone line. Please raise any cases via email or the portal whilst we investigate.
Report: "Dark Fibre Network Issues"
Last updateThis incident has been resolved.
Third party suppliers have successfully replaced the faulty cross connects. These have been tested and service looks to be restored. Monitoring of stability will continue until the morning (02/08/24).
Third Party suppliers have advised Pulsant a fibre cable has been replaced helping to mitigate the service degradation. Work is being continued to replace a second fibre cable. Which is expected to restore service. Pulsant will update further as and when this information is received.
Pulsant are continuing to work with Third Party suppliers, at present client services are believed to be up however service degradation maybe experienced due to low light levels. Further remedial actions will be required where the service will be taken offline to fully repair. However, Pulsant do not have ETA for works to take place. Pulsant will update further as and when this information is received.
Pulsant have identified outstanding issues on the core network, remedial work is on going with our third party vendor to remediate these issues. Further updates to follow
Third Party Fibre Engineers have located a fault and have replaced the affected equipment. Pulsant engineers are currently running checks over the network to confirm service restoration. A further update will be provided shortly.
We have engaged our third party vendor and remedial works is being carried out. A further update will be provided shortly.
We are currently investigating an issue on our Dark Fibre network, specifically wavelength services passing through Telehouse North to Global Switch. We are currently working towards a resolution and will provide an update as soon as possible.
Report: "Degraded service at Medway SC-2"
Last updateFollow Engineers have replaced cabling in affected Data center and services have been full restored
Pulsant have been made aware of traffic issues in Medway SC-2, we have observed errors on a link and a dynamic routing protocol switch between states, this has been isolated and physical cables are being checked.
Report: "Multiple Service down following global Windows update"
Last updateAll Pulsant clients affected by the Crowdstrike outage have been contacted by Pulsant and remedial steps completed to help restore services. For any further information regarding this outage, please refer to your Crowdstrike customer support portal.
Latest update from Crowdstrike - Full statement from George Kurtz, the CEO of Crowdstrike: "Crowdstrike is actively working with customers impacted by a defect found in a single content update for Windows hosts. "Mac and Linux hosts are not impacted. This is not a security incident or cyberattack. "The issue has been identified, isolated and a fix has been deployed. "We refer customers to the support portal for the latest updates and will continue to provide complete and continuous updates on our website. "We further recommend organisations ensure they’re communicating with Crowdstrike representatives through official channels. "Our team is fully mobilised to ensure the security and stability of Crowdstrike customers."
CrowdStrike has issued a workaround - 1. Boot Windows into Safe Mode or the Windows Recovery Environment 2. Navigate to the C:\Windows\System32\drivers\CrowdStrike directory 3. Locate the file matching “C-00000291*.sys” and delete it 4. Boot the host normally
CrowdStrike have identified the fault and potential fix. Please refer to your CrowdStrike portal for further information. Please note Pulsant does not use or support CrowdStrike services and all support is best endeavours.
Initial investigations indicate that following a 3rd party Windows update, clients that use 3rd party service Cloud Strike will be experiencing a significant impact. Latest update from CrowdStrike - “Our Engineers are actively working to resolve this issue and there is no need to open a support ticket.” Further updates will follow as they are received.
Pulsant are aware of ongoing issues where initial investigations have indicated a corrupt update on Windows hosted devices and is causing widespread impact. Pulsant will provide further updates shortly
Report: "Virgin Media Major Core Failure - London Area"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
Pulsant are aware of a Virgin Media Major Core Failure within the London area. Services are starting to recover and close monitoring will continue.
Report: "Pulsant Phone System Fault"
Last updateThis incident is now resolved. Pulsant phone lines are fully operational.
Pulsant has identified an ongoing phone fault, where audio both incoming and outgoing is failing. A Major Incident has been raised and our 3rd party vendor engaged and investigating a workaround. At present please raise all cases via the Pulsant Portal - https://portal.pulsant.com/
Report: "Newcastle Pulsant Cloud Issues Identified"
Last updateThis incident has been resolved.
A fix has been applied and all service has restored. Close monitoring will continue and updates will be provided if the status changes.
Pulsant have implemented a change and are seeing the final stages of recovery of service. A further update will be provided once all service restoration has complete.
Pulsant continue to work towards resolution currently. A further update will be provided in 30 minutes.
Pulsant continue to work towards a resolution and expect to have service restoration promptly, unfortunately an ETA cannot yet be provided. A further update will be provided in 30 minutes.
The cause of this issue has been identified and a solution is being worked towards. Our next update will be provided in 30 minutes.
We have identified an issue with the Pulsant Cloud in Newcastle. We are investigating this currently and an update will be provided imminently.
Report: "Reduced Resiliency Across Reading South and Manchester Infrastructure"
Last updateThis incident has been resolved.
Third party supplier NEOS have confirmed that all works have been completed and service has been restored. Please accept our apologies for the inconvenience caused during this time.
Third party supplier NEOS are experienced an unplanned fibre break, between Reading South and Manchester which is currently reducing resiliency. Traffic has been re-routed which should prevent any impact on service, however backups may be limited for the duration. A further update will be provided as soon as possible.
Report: "Third Party Major Incident - GTT Outage"
Last updateA successful monitoring period has been conducted and no further issues have been reported.
Further investigation has highlighted this issue was limited to another 3rd party supplier within the wider set up. Initial traceroutes lead this to be a GTT issue and due to Pulsant having a direct relationship with this vendor, and urgent case was raised and subsequently escalated. However, it was later identified when Pulsant engineers observed the traffic had changed to route towards Telia and n F5 Silverline impacting a specific IP range. Pulsant engineers then raised the issue to F5 Silverline to investigate routers within the Telia network. Soon after this escalation, services were restored, leading Pulsant to believe the issue lay within the Telia/Aerlion network. At this time, no root cause has been identified or provided to Pulsant. This matter has been stressed with urgency for update. Pulsant will continue to monitor services and escalate for root cause.
GTT have analysed routing and although trace routes stop at GTT, this is because they are learning the route to the problem subnet via another 3rd party carrier (Telia). Pulsant have raised a case with our Network Scrubbing Vendor, who will raise a case with Telia on Pulsants behalf. Apologies for any inconvenience caused and thank you for your patience whilst Pulsant continue to investigate this issue.
Pulsant are still awaiting further updates from GTT. Thank you for your patience whilst we continue to escalate this issue with GTT.
Pulsant have received confirmation from GTT that the escalation has been accepted and passed to the principal team. Next updated expected on or before 1300.
Puslant are aware and enagaged with Third party vendor(GTT) regarding the outage. Pulsant engineers are escalating the incident for a comprehensive update and ETA for fix.
Report: "Issue Identified On Core Network At Milton Keynes SE-1 Data Centre"
Last updateAll services have now restored as expected. Please contact Pulsant support if there are any further issues being experienced.
A fix has been applied and full service has restored as expected. We will continue to monitor this.
Pulsant have identified a failed switch on the core network at Milton Keynes SE-1 Data Centre. Initially this was understood to be a loss of resilience, however this has now been confirmed to be affecting clients on a single fed configuration. Work is currently being carried out to rectify this issue and updates will be provided in due course.
Report: "Zayo Fibre break between Carlisle and Moffat"
Last updateUpdate from Zayo - Our OSP team have confirmed they are hands off since approximately 23:00 BST 12/04/2024. We continue to see service restored following the damaged section of cable being replaced.
Update from Zayo - The 2nd end of the cable has been identified and preparations are underway. An additional team are beginning to lay new cable sections between 2 cable ends and excavation works remains ongoing to create the cable junction boxes.
Zayo continue to work to resolve the issue. Excavation work is ongoing, with crews preparing one end of the cable to be set back in preparation of installing a new joint. Further updates to follow when available.
Update from Zayo - Engineers have identified the fault location, there has been tree felling with heavy machinery and this has damaged the subduct in multiple locations Cabling teams are on site and we are currently awaiting plan of action due to the multiple damage points. Further updates to follow
Update from Zayo - Further testing has pinpointed the fault location 3km from the engineers current location. Testing teams are remobilizing to the fibre chamber nearest to this location. Further updates to follow.
Pulsant are aware of a third party partner experiencing an issue between Carlisle and Moffat. Investigations have identified a fibre cable break. Engineers will shortly be onsite at the fault location and work will begin to remediate the issue. Pulsant are in contact with Zayo and will provide further updates when available.
Report: "BT Copper broadband services"
Last updateThis incident has been resolved.
We are aware that issues are still being experienced and this has been escalated to BT. We will provide updates as soon as possible.
We have received multiple reports of outages from clients on BT copper broadband, and BT has been duly made aware of these occurrences. These disruptions have been attributed to adverse weather conditions, leading to fluctuations in connections characterised by drops and intermittent restores. Service restoration is estimated to be completed by Monday. Updates will be provided as soon as possible.
Report: "DNS Name Server Issues"
Last updateThis incident has been resolved.
Service has now been restored and we will continue to monitor this closely. Please contact us directly if you have any further issues. https://portal.pulsant.com/
We are currently addressing DNS name server issues to restore service as soon as possible. We acknowledge the impact on VPN, website, and mail flow and are actively working towards resolution.
Report: "Network issues identified at Newcastle Central DC (NE-1)"
Last updateThis incident has now been resolved and all services are back online. Please contact Pulsant support if you are experiencing any further issues.
Investigations have ruled out issues with the Pulsant core and attention is now on Pulsant Cloud. Troubleshooting continues with Cloud and Storage engineers and another update will be provided as soon as possible.
We are continuing to investigate this issue.
Pulsant have identified network issues originating from Newcastle Central DC (NE-1). These are currently being investigated by senior network engineers and updates will provided frequently. Please contact Pulsant support if you have any queries on 0345 119 9999 or on the Pulsant Portal - https://portal.pulsant.com/
Report: "Openreach network issues."
Last updateWe can confirm that this is now resolved. This was due to power issues in Edinburgh and confirmation has been received that full service has restored.
We are continuing to investigate this issue.
We have been informed this morning that Openreach have carried out planned works, which have effected services we have not anticipated. Multiple clients have reported outages and we are reaching out to network providers to provide further updates. We will continue to monitor this and update accordingly. The expectation is currently that their planned works should be complete by 06:00 on 11/01/2024.
Report: "Citrix Workspace - login issues 30/11/2023"
Last updateThis incident has been resolved.
Workspace Experience is currently experiencing an issue that would impact End-Users using Active Directory for authentication. End-Users impacted are unable to login into the Workspace Experience Service. Current Status: Citrix Engineering has mitigated the issue and monitoring the recovery of the service. For further information and updates please see - https://status.cloud.com/incidents/546865
Pulsant have been made aware of an issue with Citrix Cloud Workspace. Current update from Citrix below: Workspace Experience is currently experiencing an issue that would impact End-Users using Active Directory for authentication. End-Users impacted are unable to login into the Workspace Experience Service. For further information and updates please see - https://status.cloud.com/incidents/546865