Historical record of incidents for Mosio
Report: "Network Disruption"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are experiencing high latency on one of our upstream carriers. We are monitoring the situation and will update as developments occur.
Report: "www.mosio.com corporate site offline"
Last updateThe incident has been resolved.
From our host: > We continue to work closely with the NetApp North America leadership team and senior engineers to address the current situation involving our NetApp-based products and services. We'll continue to provide updates throughout the evening and aim to provide a more detailed update tomorrow morning.
Our hosting provider for our corporate site (not the platform where client data is hosted) is currently offline. This is a major incident at the host and they are working on a fix. The site has been temporarily redirected. To login to your account, please go to https://biz.mosio.com/
Report: "Intermittent Issue - Email Notifications"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
Our downstream email service is having intermittent email connectivity, notification emails may not send. A fix has been implemented and we are monitoring the results.
Report: "Network Disruption"
Last updateThis incident has been resolved.
Issue has been identified and our engineers are monitoring the fix.
We are currently investigating an issue with our primary data center.
Report: "Primary Datacenter Network Disruption"
Last updateOur engineers have confirmed the issue is resolved.
Issue has been identified and resolved, our engineers are monitoring the results.
Some users may experience slow performance, our engineers are investigating.
Report: "Intermittent Service Disruption"
Last updateThis incident has been resolved.
Our engineers have identified the issue and a fix has been implemented, we are monitoring the results
We are continuing to investigate this issue.
Some users may experience slow performance, our engineers are investigating.
Report: "Network Disruption"
Last updateThis incident has been resolved, we will continue to monitor updates from our data center.
Network disruption has been rectified, continuing to monitor.
Network disruption has been partially recovered, monitoring status.
We are currently investigating an issue with our primary data center.
Report: "Network Disruption"
Last updateThis incident has been resolved, will continue to monitor updates from our data center
Systems are operational, continuing to monitor system status
Service is restored, continuing to investigate
Our data center is experiencing a network disruption. Engineers are investigating.
Report: "Service Disruption"
Last updateThis incident has been resolved. We will continue to monitor and investigate as we determine the root cause.
Services are coming back online, we are continuing to monitor.
We are continuing to investigate this issue, there appears to be a major network disruption at our primary data center.
Mosio is experiencing a disruption at this time and we are currently investigating this issue.
Report: "Service down"
Last updateThis incident has been resolved.
Clients seeing a maintenance message should refresh the page, as service are now back up.
We have identified the cause of the issue and are continuing to monitor. All services should be restored.
Some servers are still experiencing problems. This is affecting user login, but not sms processing.
Services should be restored, but we are continuing to monitor.
Mosio is experiencing a disruption at this time and we are working to restore service.
Report: "Server Incident"
Last updateThis incident has been resolved.
This morning one of our server clusters that manages running scheduled tasks went down. We are investigating the cause. Some surveys may not have sent on time, and delivery receipt processing is behind. Services are all up and running, and we are monitoring the situation.
Report: "Mosio Recovery Test"
Last updateThis test incident is now complete.
This is a test incident, associated to DEV-31. Mosio is conducting a disaster test. No services are affected.
Report: "API Load Balancer issue"
Last updateThis incident has been resolved.
The load balancer controlling access to api.mosio.com went down at about 10:38 am PT. Networking was notified and services restored fully by 11:10am. We're continuing to monitor the network.
Report: "Data center network disruption"
Last updateNo further incidents.
The data center has informed us that network is currently stable, they are investigating the root cause. We'll continue to monitor.
The network appears to be responding normally, we are monitoring the status.
Mosio has received a notice from our data center. Clients may experience intermittent timeouts when accessing the Mosio platform until this is resolved. Incoming text message processing may be delayed slightly, texts will be requeued and processed as the network allows. > Current Status: Service Disruption > Started: 1/11/2019 10:41am (-0800) > Affected Infrastructure > Locations: Primary Data Center > Update: > We are experiencing a major network disruption at our network border. We are investigating and will update as event occur.
Report: "Network Incident"
Last updateAt our host, a switch stack failed as a parallel set of units at 9:55am PT, bringing down the network. This pair was immediately removed from the network, and the network started to reconverge. Network was full operational again by 10:30am PT.
The network problems have been restored as of 15:55:00 PT.
At approximately 10:14am Pacific time, Mosio observed a network incident causing general slow operation to the web portal and API. We're working to resolve it ASAP.
Report: "Outage in incoming message processing"
Last updateThe updates have been made and the system is back online
We anticipate the system to be back online in 20-30 minutes.
This outage is affecting the outgoing sms queue. We've taken the main front-end off line to prevent any work being lost while we fix this issue.
A brief outage will occur as we update systems that control incoming message processing. You may experience a slight delay in messages being processed during this time. We anticipate this change to take less than an hour. The web portal and API will also not be accessible/online during this period. We apologize for the trouble and will be back up as soon as possible.
Report: "Database errors"
Last updateSystems have been stable for a while now, this incident is resolved.
Network operations found an IP issue affecting the network connection of the database, we're currently investigating what triggered this. Services should be up and running normally.
Current we're investigating some database errors, we'll update again as soon as we know more.
Report: "Service Outage"
Last updateAround 7am Pacific time, Mosio had a brief outage due to a database issue. Some appointment reminders and access to the platform was affected.
Report: "Issues accessing Mosio platform"
Last updateThe database issue affecting the Mosio platform has been rectified. All systems should be functioning normally.
We've identified an issue causing slowness and period of inability to access the Mosio microboards and platform. We're currently working to rectify this problem. No time estimate on the resolution at this time.
Report: "Network interruption"
Last updateFor a short time (approx 3:44pm to 4pm), the Mosio platform was down due to a brief network outage.
Report: "Load Balancer under attack at Network Host"
Last updateThe DDOS attack has been resolved and null routed. All services should be restored. We're continuing to monitor.
We've updated our load balancer and the site should be accessible now. We're monitoring traffic to check for incoming SMS and delivery receipts are processing normally, and we're monitoring for more DDOS activity.
Our hosting provider has informed us that a load balancer on their network is currently under Denial of Service attack. They are working to resolve the issue, and Mosio may be inaccessible until they are able to solve this. Scheduled outgoing texts from Mosio will still send. Incoming texts and delivery receipts may be delayed.
Report: "Network Interruption"
Last updateThis incident has been resolved.
This morning a network hardware issue is causing intermitted interruption in service. We're investigating and working with our hosting company to pinpoint the problem.
Report: "Database error"
Last updateServices appear to be stable and no further issues have been seen. We'll continue to closely monitor the situation through the night.
All services should be back up.
Currently the Mosio database is experiencing an error. Technical teams are working on restoring availability right now.
Report: "Network Interruption"
Last updateAn upstream DDOS attack briefly affected connections to Mosio's network for a period of about 20 minutes. From our hosting provider: "This incident was a 20 minute DDOS attack consisting of a 10 gigabit flood directed at the shared LB pair. The attack has subsided and our NOC is continuing to monitor."
Report: "Delivery Receipt Processing Issue"
Last updateDelivery Receipts are not processing correctly, and are being queued in the system. Outgoing SMS status will not change to reflect delivery info until this backlog is cleared.