Is GearHost Down Right Now? Check if there is a current outage ongoing.

We have seen no issues since our last update, so we are closing this incident.

Our Denver OPS team has successfully restored network connectivity to all regions. We are actively monitoring the situation and will keep the incident open until we are comfortable with the results. If you encounter any further issues, please open a support ticket at support@gearhost.com.

The Denver OPS team continues to identify wedged tables and process throughout the network. We are continuing to make progress through each access layer device. We ask that customers report back their current status to assist in the effort.

The Denver OPS team has identified the issue, and a fix has been pushed out. We ask that all customers verify their connectivity and let us know if you're still experiencing any issues.

The Denver OPS team is continuing to investigate this issue.

The Denver OPS team is continuing to investigate this issue.

The Denver OPS team continues to investigate the issue. We have removed bouncing peers which could be contributing to the issue. Additionally, we continue to isolate the issue by power cycling one core router at a time.

The Denver OPS team has identified a routing issue in the Denver market. IP Cores were impacted, causing a reset of the routing process on some routers. Routing and connectivity has returned but we are still experiencing brief interruptions.

Our networking team has been alerted to a large-scale network outage currently impacting the Denver network area. This outage is affecting a significant number of people and data centers in the Denver region. Our networking team is actively collaborating with our on-site data center partner to address this issue and ensure the stability of our services in the affected area. Please be assured that this incident is entirely unrelated to the outage experienced in the past few days. We understand the frustration and inconvenience this situation may cause, and we are working diligently to resolve it as quickly as possible. If you have any immediate concerns or require assistance, please do not hesitate to reach out to our support team at support@gearhost.com

We are pleased to report that the recent service issues have stabilized, and we are confident in marking them as resolved. The hard work and dedication of our team have paid off, and we want to extend our gratitude for your patience throughout this challenging period. As we move forward, we are committed to providing you with transparency and insights into what transpired. In the coming days, we will be posting a Root Cause Analysis (RCA) on this platform. This detailed report will outline the events and factors that led to the outage and the steps we have taken to prevent similar incidents in the future. We understand the importance of continuous improvement and learning from our experiences. Your feedback and support have been invaluable, and we will use these insights to enhance our services further. Once again, we apologize for any disruption this may have caused and thank you for entrusting us with your business. If you have any immediate concerns or require further assistance, please don't hesitate to reach out to our support team at support@gearhost.com. Thank you for your understanding and cooperation.

We want to keep you updated on our ongoing efforts to fully restore all services following the recent outage. While a significant portion of our CloudSites and CloudServers are now online, we are actively working to address the remaining issues. As of now, there are a few CloudSites that are still experiencing issues, and we want to assure you that our team is dedicated to resolving these as swiftly as possible. Furthermore, we are aware of performance issues affecting MSSQL8 and MSSQL3. To tackle these problems head-on, we are in the process of pushing updates to these servers. These updates are designed to improve performance and ensure a smoother experience for our users. We understand the importance of having all services running seamlessly, and we appreciate your patience as we work diligently to achieve that goal. If you encounter any ongoing issues or have specific concerns, please do not hesitate to reach out to our support team at support@gearhost.com. Once again, we apologize for any inconvenience this outage may have caused, and we are committed to providing you with the best service possible. Thank you for your understanding.

We are pleased to inform you that significant progress has been made in resolving the extended outage we experienced earlier. As of now, we have successfully restored all mail servers and database servers to full functionality. Additionally, we have brought a substantial portion of our CloudSites and approximately 80% of our CloudServers back online. Our dedicated team continues to work diligently to ensure that all services are fully operational. If you are still experiencing any issues with our services, we kindly request you to open a support ticket by emailing us at support@gearhost.com. Our support team is standing by to assist you and address any lingering concerns. We understand the inconvenience this outage may have caused, and we are committed to providing you with the best possible support during this time. Thank you for your patience and understanding as we work to restore normalcy, and we apologize for any disruption you may have encountered.

Dear Valued Customers, We want to provide you with an important update regarding the extended outage we have been experiencing. We understand how disruptive this has been for you, and we sincerely apologize for the inconvenience caused. The good news is that we have made significant progress in resolving the issue. Our dedicated team has been working tirelessly to address the underlying problems, and we are now in the process of pushing out a fix and restoring our servers. Here's what you need to know: Mail Servers: We are actively working on bringing our mail servers back to full functionality. While there may still be some residual delays, we anticipate a swift resolution, and your email services should be operational shortly. Customer Websites and Databases: We are pleased to report that customer websites and databases are gradually coming back online as we speak. Please expect some intermittent access as the restoration process continues, but we are committed to ensuring full functionality is restored as quickly as possible. We understand that you may have numerous questions and concerns about this incident. Rest assured; we are committed to providing you with a detailed Root Cause Analysis (RCA) once we have completed our investigations. This will help shed light on the events that led to this outage and the steps we are taking to prevent future occurrences. Your patience and understanding during this challenging time are greatly appreciated. We are doing everything in our power to ensure that your services are fully restored as quickly as possible. Please stay tuned to this status page for further updates, and feel free to reach out to our support team if you have any immediate concerns. Once again, we sincerely apologize for any disruption this outage has caused and thank you for your continued trust in our services.

The issue has been identified and a fix is being implemented.

We are currently investigating an issue in our Denver Datacenter. We will provide an update when we have more information

This incident has been resolved.

MySQL2 and MySQL3 servers are back online and working as expected. Some users were migrated to new servers and were notifeid via ticket/email. if you have questions please open a support ticket. We will post a more detailed postmortem in the next 24 hours.

We have found the root cause and are working to bring both servers back online.

We are looking into our MySQL02 & MySQL03 servers. Select users are reporting issues with databases hosted on these servers. We will provide an update once we know more.

The maintenance is complete.

We are doing emergency maintenance on our MySQL02 server in our Denver datacenter. You will see intermittent connectivity issues. We'll update this posting once this maintenance is complete. We don't anticipate more than 30 minutes of downtime.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

The issue has been identified and a fix is being implemented.

We are currently investigating an issue with CloudSite Availablity. We will provide updates once we have more information.

This incident has been resolved.

We are completing some emergency maintenance on GearHost.com and the My.GearHost.com Portal. Productions CloudSites, Databases, and Mial Servers are unaffected and online. You will not be able to log in until this maintenance is complete.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

The issue has been identified and a fix is being implemented.

Our team is currently investigating network latency some customers are having in specific regions. We'll provide an update with more information soon.

This incident has been resolved.

We have postponed the free CloudSite deletions as some customers were not receiving our notification email. Free CloudSites will start getting deleted 10/01/2021. Please upgrade your plan or migrate data off. Once deleted we will be unable to recover files.

Today we are announcing the end of the free CloudSite plan. As of today June 3rd, 2021 the free CloudSite plan will be removed from the GearHost Portal. For now, any existing free CloudSites will stay active for at least 30 days. 30 days from today all customers that do not have a paid service will lose their free CloudSite whether its actively used or not. Please read the rest of our blog: https://www.gearhost.com/blog/free-cloudsite-plan-end-of-life

This incident has been resolved.

The Engineers have identified a DDoS attack destined for a customer and have diverted the traffic. The performance issues should be resolved at this point. We are monitoring the fix.

Our datacenter partner has their Engineer currently investigating intermittent connectivity and packet loss. Right now performance is degraded but some traffic is working fine.

This incident has been resolved.

Our team is currently investigating the error users are receiving when searching for documents. We will provide an update shortly.

This incident has been resolved.

Our team has identified the issue and is working on a fix. In the meantime, if you notice your CloudSites are taking a while to destroy please open a support ticket from our portal. Once the overall issue is resolved we'll update you via ticket and ensure you are not billed for any CloudSites that were destroyed late.

Our engineers are currently investigating CloudSite Destroy times. An update will be provided ASAP.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

Our network team is currently investigating an attack on the GearHost homepage and our Portal login. We will provide more information once we fix this. This is not affecting user services. Just the home page and log in.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

The issue has been identified and a fix is being implemented.

We are currently investigating this issue.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

Our engineers are in the process of completing some emergency maintenance on our Mail1 server. We apologize for the convenience on the short notice. This is to help with the overall performance issues on mail1 the past few weeks.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

We are currently investigating this issue.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

We are continuing to investigate this issue.

We are currently investigating this issue.

This incident has been resolved.

The issue has been identified and a fix is being implemented.

Our team is currently investigating an issue with our mail servers. Mail is being sent and received but is delayed. We will provide an update shortly.

The maintenance is complete.

Maintenance is complete. We are continuing to monitoring all systems.

Our network team is completing some emergency maintenance at this time. You may experience network blips and slow load times. We will update this once maintenance is complete.

Our network team is completing some emergency maintenance at this time. You may experience network blips and slow load times. We will update this once maintenance is complete.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

The issue has been identified and a fix is being implemented.

Our engineers are currently investigating an ongoing network issue that is affecting a small number of our customers. We will post and update when we have more information.

## Situation Summary: On Tuesday Oct 13th at approximately 3 AM MST GearHost began experiencing a routing blackhole through our upstream provider \(Zayo IP\). This was due to an equipment failure on the regional transit providers router which was outside of GearHost’s control. Due to the nature of the failure, routing protocols did not recognize the outage and traffic destined to and from the internet was blackholed in the peer router. Once the issue was identified, GearHost de-peer’d from the affected upstream at all peering points which restored regular traffic for GearHost customers. ## Customer Impact: Partial or total loss of connectivity ## Mitigation Strategy: This outage was due to traffic being dropped by a routing peer while maintaining routing protocols. Normally dynamic routing would detect an outage and internet traffic would route around it. When an issue with an upstream provider drops or “blackholes” traffic without sending routing updates, the only way to mitigate it is to identify where the traffic is being dropped and manually intervene with routing changes at our borders. ## Activity that ultimately restored service: Depeering with Zayo IP at the blendwidth border routers. ## Identified Root Cause: Upstream provider equipment failure dropping traffic while maintaining dynamic routing protocols

The implemented fix has resolved the overall issue. We will provide a post mortem once we gather all information. Thank you all for your patience and understanding. We are working internally and with our partners to ensure this does not happen again.

A fix has been implemented and we are monitoring the results.

The issue has been identified. It is at the ISP level. We are currently awaiting more information. We will provide an ETA when possible.

Our engineers are looking into the issues some users are experiencing. We will provide an update as we get them.

Our engineers are aware of the 400 errors some users are experiencing in the portal. We have a fix being pushed out. Things should start functioning as normal soon.

We apologize as this was not updated when this was completed. Total downtime was about 28 minutes for most customers. We apologize greatly for this and please open a ticket if you would like any further information.

We are currently resetting the edge nodes for CloudSites within DEN1. All CloudSites within DEN1 will receive a "The service is unavailable." message for the next 5 minutes or less. We apologize for this issue. Please let us know if you have any questions by opening a support ticket. We will update this incident shortly when completed.

We apologize for the issue. This issue has been resolved. Please contact us with any questions by opening a support ticket. Thanks again!

We are currently investigating an issue where customers in DEN1 are not able to create CloudSite instances. We will update you shortly on the progress as we fix this shortly. Thank you again!

This has completed and been resolved. Thank you again and our apologies for the issue!

We are currently resetting the front end reverse proxy nodes that server your sites on CloudSites DEN1. This is due to an issue in some of the base code that is being fixed. All CloudSites in DEN1 will show "The service is unavailable." for the next 10 min. We apologize for this unscheduled downtime.

We have been monitoring the fix for about 24 hours. We have not seen any more issues. We are considering this issue resolved.

A fix has been implemented and we are monitoring the results.

We are currently investigating a network latency issue at our DEN1 Datacenter. We are working with our providers now.

This incident has been resolved.

MSSQL03, and MYSQL03 are not fully functional. We are still working with MSSQL04.

The issue has been identified and a fix is being implemented.

Our engineers are currently investigating some problems with our MSSQL03, MSSQL04, and MySQL03 servers.

This issue has been resolved. We apologize greatly for the problem and we will post a full root cause analysis on Monday.

We are continuing to investigate this issue.

We are currently investigating an outage with our network edge devices that are currently unavailable creating an outage for US9 (Denver) customers. We will update shortly.

This issue was a result of a network configuration issue and has been restored. We apologize for the greatly issue.

We are working on an issue with Mail2. We apologize and should have this back online shortly.

This issue was a result of a network configuration issue and has been restored. We apologize for the greatly issue.

We are aware and working on a database outage with the MSSQL08 cluster. We should have this back online shortly.

This incident has been resolved.

Power has been restored and we are working on getting everything back online.

Our engineers have contacted our datacenter partner and have been informed this is a power related issue. Vendors have been dispatched and are onsite looking into the problem. Updates will be posted when more information is provided.

Our engineers are currently looking into the connectivity issues some users are receiving. We will provide updates as we get them.

This issue has been fully resolved. We sincerely apologize for this major outage we experienced today. The outage that lasted 4 hours 10 minutes and 42 seconds was due to a problem within our core services platform. We immediately went to work in fixing the issue which has been fully resolved. In order to prevent this issue from happening again we've fixed the core problem to ensure our platform is resilient against this issue within our core networking equipment going forward. We fully understand that our customers rely on GearHost for 100% uptime and the ultimate in cloud hosting performance. We failed you today in offering that 100% uptime. Unfortunately this happens to the best of us in the industry regardless of Microsoft, Amazon, Google, etc but we learn from every experience and that is no exception to today. We will continue to offer you the uptime and performance you rely on and want to thank you for being a loyal GearHost customer.

The fixed is being pushed out now. Once all services come back online we will give one final update.

Our engineers have identified the issue, and are working on a fix as we speak.

Our engineers are on-site and looking into the overall issue. Once we have more information we will update you.

Our team is currently looking into the on going issues users are having. We will update you shortly.

This incident has been resolved.

We are continuing to work on a fix for this issue.

Cloudflare is currently experiencing major network issues. Please check their status page on progress. Once this is resolved we will post a notification here. https://www.cloudflarestatus.com/

This incident has been resolved.

The overall issue has been identified and resolved. We are still working on select nodes so things in the control panel might be slow but all sites at this point should be up and functioning.

As a note, this can also impact our login process.

We are currently looking into the ongoing performance issues on select cloud site nodes. Until this is resolved sites might load slow or give out 502 errors. Once we have more information we will post it here.

Our engineers have now resolved this problem. We apologize the problem.

We are still working on the issue and we will provide an update to this any any downtime issues shortly.

We are continuing to investigate this issue. Our engineers are making progress and do not expect systems to be down much longer.

We are also getting reports of select cloud sites not working properly. Our engineer team is still looking into the overall problem. When we have more information we will post it here.

We are currently investigating the ongoing login issues for my.gearhost.com. We will post updates here as we get them.

This incident has been resolved.

We are continuing to investigate this issue.

We are working on the portal login issues now. We will post updates here as we get them. Cloudsites are not affected by this.

This incident has been resolved.

We are continuing to investigate this issue.

Our team is aware of the timeouts users are experiencing when navigating my.gearhost.com We are actively working on a solution. Updates will be posted here until this is fully resolved.

This incident has been resolved.

DNS Service has been restored sites using our DNS servers are online. We are still working on the environment as a whole. Our main website and ticketing system should be back online shortly as well. If you need to open a support ticket for the time being please send an email to: help@gearhost.com

Our engineers are actively working on the issues with the portal and DNS servers. We should have this finished within an hour to ultimately fix the issue at hand for good.

We are aware of the cloud site issues that are back now. Our team is working on the fix . We are also working on database servers: den1.mssql05 & den1.mysql04

The portal is back online and working as normal. DEN1.MSSQL05, and DEN1.MYSQL04 servers are still having problems that we are actively working on. These should be back up and running shortly.

We have cloud sites back online now. We are still working on the portal issues that are still ongoing.

As an update, our Engineers are working on the overall issues we are experiencing now. This is high priority issues and its possible cloud sites will be down while we investigate this. We apologize for the inconvenience and are working hard to get this resolved.

Our engineers are still working on the issue at hand. We do not have an ETA on the fix but this is a high priority issue. We apologize for any inconvenience this has caused and thank you for your patience and understanding.

Our engineers are currently investigating an issue with our my.gearhost.com portal. We are aware of the 400 errors some users are receiving. For the time being changes done as far as scaling, stopping/starting and FTP will not work. Cloudistes themselves are loading fine. We will publish updates as we have them.

This incident has been resolved.

A fix has been pushed and cloudsites are coming back online. We are still monitoring the system and are not ready to mark this as resolved. Once we feel comfortable and gather more information we will update here.

As an update, our engineers are still working on the overall issue. Once we have more information we will provide an update.

Our engineers are working on the problems users are experiencing with our cloud site platform. We will publish updates here as we learn more.

This incident has been resolved.

We are continuing to work on a fix for this issue.

We have fixed the issue and are now bringing services online however we do not expect to be 100% for another few hours. We are working as fast as possible on this and understand how important this is to everyone. We apologize and appreciate your patience as we get things back to normal right away.

We have identified the issue and are working on the issue now. Updates shortly.

We are currently investigating a major outage with DEN1. This seems to be with our upstream provider at the moment. We are working with them to resolve this. Updates shortly.

Our team is confident that we have completely resolved this issue. Although outages were short and intermittent we understand the inconvenience and frustration. We are working internally to make sure this does not happen again. If you have any questions please open a support ticket from your portal.

A fix has been pushed out and we have not seen any outages in the past 20 minutes. We will continue to monitor the system until we feel confident this is permanently fixed.

The investigation is still ongoing. We are making improvements and should have this completely resolved soon.

We are seeing improvements at this time. We are still monitoring the system and will mark this resolved once a permanent fix is pushed.

Our engineers are currently looking into the 503 Service Unavailable Errors select nodes are receiving. Any updates will be published here.

This incident has been resolved.

We pushed out the fix and cloudsites are back online. Our Engineers are still monitoring the system.

Our engineers are still working on the solution. Once the fix is put into place we will publish an update here.

Our engineers have identified the problem and are working on the fix now.

Our engineers are investigating the outages users are receiving on our cloudsite platform. We will update you with more information shortly.

In an effort to make things easier we have restored the MSSQL1 database cluster. There was about a 3 hour window from when the failure occured to when the backups took place. If you need data between this time please open a support ticket and we can provide you with a database that has no loss in that time period. Please accept our apologies for this long outage. We worked closely with Microsoft to get this resolved for not only GearHost but other providers like us. On a side note performance of your databases has also dramatically increased. Enjoy!

We have worked with Microsoft however the patches applied have rendered the MSSQL1 cluster offline so we are migrating customers to new clusters. This will be completed in the next few hours however if you would like your database moved more quickly please open a support ticket. Please note only paid databases are being migrated at this point. Free databases will be migrated after paying customers. No data has been lost. You will receive a support ticket email with details shortly.

We are working with Microsoft and this should be resolved within the next 90 minutes. We greatly apologize for the delay. Rest assured no data is lost and if you need your database working ASAP please open a ticket and we'll migrate your database to another cluster for you.

Our Engineers are still working hard on this. We appreciate your patience during this matter. This is a high priority problem, we have our top Engineers working on a solution.

We have ran into an issue with the MSSQL01 SQL Server Cluster. If your database is on this cluster then you will have errors trying to connect to your database. All data is intact however the cluster is having an issue with SQL Server 2017. We are working hard on this and everything should be online shortly.

Our engineers are confident to say that this has finally been resolved. We thank you for your patience. If you are still experiencing problems please open a support ticket.

Our engineer team published a new fix last night that should resolve the ongoing outages we have been having. We will continue monitoring our system for the next few hours to confirm the fix is working.

The fix that was published did not resolve the issue permanently. We are working closely with Microsoft for a solution. We will update you here as we gather more information.

A fix has been implemented. Our Engineers will need to wait at least an hour to confirm if the fix works.

Outages are still occurring, we have managed to limit the downtime as much as we can. Our Engineers are making great progress and working as hard and as fast as they can to get this resolved. Thank you for your patience.

We are aware of the continued outages that occur. Our Engineers have managed to limit them for the time being. We will continue working on this until it is resolved.

Our Engineers are still working on this. Outages started occurring again early this morning. We are making progress and plan on having this resolved soon. Thank you for your patience.

We are aware of the ongoing issues with our Cloudsite Environment. Our engineers are working around the clock to resolve the issue. As of 7PM MST everything appears to be back to normal. Our team is still monitoring the infrastructure and will publish updates here going forward. If you have any questions or concerns please open a support ticket. Responses will be delayed as we have had a huge influx of inquiries. We apologize for any inconvience that this causes and we will continue working around the clock until this is permantly resolved.

This incident has been resolved.

We are making some progress on this problem. Outages may still occur but we should have this resolved shortly.

Our engineers are currently investigate an issue with our cloudsite infrastructure. While we are doing this cloudsites might go down but should come back up shortly after. We will provide updates here when we have more information.

This incident has been resolved.

We have found an issue that requires immediate attention to our MySQL clusters. We are currently running some emergency maintenace on all MySQL clusters to resolve this issue. You may experience some database connectivity issues during this time but no more than 15 min at a time. We expect to have this resolved within 30-45 min.

This issue has been resolved and stability going forward will be much better. We apologize for any inconvenience this caused. If you have any questions please create a support ticket.

Service does appear to be restored. Our admins will continue to monitor this, it is very likely that this might go down again. This is expected and required to ensure stability moving forward.

We are aware and working on our mail1 server issue. We apologize for any inconvience. Our admins should have this resolved soon. If you have any questions please create a support ticket.

Service has resumed and our Engineers have resolved the issue. If you are still experiencing problems please create a support ticket.

A fix has been pushed out. Service should restore in the next 5 to 10 minutes. We will continue monitoring this server for the remainder of the day.

More issues have started. We are aware and actively investigating.

Email service has been restored. You might see a few more hiccups, just know we are aware of the issue. We will continue monitoring this throughout the day.

Our engineers have identified the problem and are working on the solution.

Our engineers are currently looking into the issues with our mail2 server. We will provide an update when we have more information.

Updates have been completed. Service will resume as normal. If you experience any issues please open a support ticket.

We will begin updating mail1, mail2, mail3, and mail4 to the latest version of SmarterMail. The expected downtime per server can take anywhere from 5 - 10 minutes. We appreciate your patience during this time.

This incident has been resolved.

Our engineers are looking into the portal issues that users are experiencing. We should have this resolved shortly.