Historical record of incidents for Soomo Learning
Report: "Degraded Performance of Soomo Reporting and Due Date Manager"
Last updateOne of our hosting providers is experiencing degraded performance, and as a result, Soomo users may not be able to generate reports or make updates using the Due Date Manager. We are monitoring this until the issue is resolved.
Report: "Degraded Performance of Soomo Messenger and Help Center Articles"
Last updateThis incident has been resolved.
Soomo’s Messenger and Help Center provider is experiencing degraded performance. Users may not be able to load the Soomo Messenger or our Help Center articles. We are monitoring this until the issue is resolved.
Report: "Significant site availability issues"
Last updateFrom 4:28 p.m. EST to 4:36 p.m. EST, network connectivity to our web platform was degraded. This resulted in users receiving browser errors when attempting to interact with our service. This has been resolved, and all services have returned to normal functionality.
Report: "Significant site availability issues"
Last updateFrom 1:43 p.m. EST to 2:06 p.m. EST, network connectivity to our web platform was degraded. This resulted in users receiving browser errors when attempting to interact with our service. This has been resolved, and all services have returned to normal functionality.
Report: "Degraded Performance of Soomo Messenger and Help Center Articles"
Last updateSoomo’s Messenger and Help Center provider, Intercom, now shows that their services have completely recovered. We believe this incident is now concluded. Please reach out to our Support team at support@soomolearning.com if you experience any further issues.
Soomo’s Messenger and Help Center provider, Intercom, started experiencing degraded performance at 11:00 a.m. ET. Intercom now shows that their services are recovering, but some users may not be able to load the Soomo Messenger or our Help Center articles. We will continue to monitor this until the issue is resolved.
Report: "Connectivity issues"
Last updateSome users may have experienced issues connecting to their webtexts because of an issue with an upstream DNS provider that occurred today between 10:44 a.m. and 10:51 a.m. EST. The issue has been resolved.
Report: "Issues with paper downloading & submission features"
Last updateAWS has indicated that the issues impacting our downloading & submission features have been resolved. Our own internal monitoring and investigation supports this claim. We believe this incident is now concluded. Please reach out to our support team at support@soomolearning.com if you experience any further issues downloading or submitting documents.
AWS has reported that error rates are subsiding, though we are still observing document generation failures related to the issues in the us-east-1 region. We will continue to monitor.
Following increases in automated error reports and user-reported issues with paper downloading and LMS submission within webtexts, we determined that a service outage within the AWS us-east-1 region is impacting our users. Webtext users may experience failures when attempting to retrieve documents (DOCX, PPTX, or XLSX) from the features in webtexts which may be labeled as "Writing Templates," "Spreadsheet Templates," or other. Further, users attempting to submit their work to an LMS may also experience failures, because document generation is required prior to submission. We will monitor this situation and provide updates as we learn more.
Report: "Site availability is reduced"
Last updateOur website, www.webtexts.com, is currently unavailable for some users. The cause of this unavailability appears to be instability with an upstream service provider. Service returned to normal by 5:29 p.m. EDT.
Report: "Site availability is reduced"
Last updateOur website, www.webtexts.com, is currently unavailable for some users. The cause of this unavailability appears to be instability with an upstream service provider. Service returned to normal by 6:18 a.m. EDT.
Report: "Site availability is reduced"
Last updateAfter deploying the workaround, we have not heard any further report of issues reported. Therefore, we will consider this issue resolved for our users.
We have applied a workaround which may allow users to access www.webtexts.com. Please let us know if you are still experiencing issues connecting.
This outage continues, with no expected time to resolve yet.
Our website, www.webtexts.com, is currently unavailable for some users. The cause of this unavailability appears to be a DNS issue that one of our service providers is experiencing. We will update this incident when we have more information about this outage.
Report: "Site availability issues"
Last updateStarting at 9:02 a.m. EDT, and lasting until 9:07 p.m. EDT, network connectivity to our web platform was degraded. This resulted in users receiving browser errors when attempting to interact with our service. The service provider responsible for this incident has indicated the underlying issue is resolved.
Report: "Site availability issues"
Last updateStarting at 1:35 p.m. EDT, and lasting until 1:42 p.m. EDT, network connectivity to our web platform was degraded. This resulted in users receiving browser errors when attempting to interact with our service. The service provider responsible for this incident has indicated the underlying issue is resolved.
Report: "Significant site availability issues"
Last updateOur upstream service provider has reported the issue has been resolved, and all services continues to function normally.
We await our hosting provider's report of full recovery. Webtexts.com continues to function normally.
The hosting provider has identified an issue and is correcting it; site availability appears to have returned to normal.
Site availability is significantly reduced due to an ongoing issue with a hosting provider. We are investigating.
Report: "Upstream service provider failure impacting site availability"
Last updateA failure at an upstream service provider caused site availability issues. Users of the Soomo platform will have experienced pages loading slowly and pages failing to load.
Report: "Significantly degraded performance"
Last updateOn Sunday, July 25, from 10:39 p.m. EDT to 11:19 p.m. EDT, webtexts.com became significantly degraded due to an issue with our background job processing queues. During this time, students were unable to save and submit work in their webtexts, and all users encountered trouble loading webtexts. The issue has been resolved, and all Soomo products and services—including Analytics and grade delivery services—are operating normally at this time. Please email support@soomolearning.com with any questions.
Report: "Unexpected platform unavailability during automated maintenance"
Last updateDuring automated upgrade of a database, our platform became unavailable for 4 minutes, between 6:34 a.m. EDT and 6:38 a.m. EDT. The website and related services were inaccessible to users, and returned error pages during this time.
Report: "Intermittent site unavailability"
Last updateAll our alerts have resolved, and we've received no further reports from users experiencing access issues. If you encounter any further issues, please contact support@soomolearning.com.
We are seeing improvements in DNS resolution, and all our services are operating as expected. We continue to monitor.
We have sporadic reports of users unable to access to our web platform, and it appear the cause is a DNS outage of some kind. We are investigating, and will update this page with more information when it becomes available.
Report: "Degraded Performance 7/28"
Last updateDue to an issue with one of our service providers, students and instructors may have received failed web requests on Tuesday, July 28, 2020, from 4:32 a.m. to 6:14 a.m. ET. For example: - students accessing the webtexts through a browser or mobile app may have experienced a delay in loading a page - scores to an LMS may have been delayed The issue is now resolved, and all student scores are up to date. No work was lost. If any instructor or student experiences anything unexpected, please let us know by contacting support@soomolearning.com
Report: "LMS Grade Delivery"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Intermittent site outage"
Last updateThe same service provider from earlier in the day experienced another outage, intermittently preventing students and instructors from accessing https://www.webtexts.com/ for 9 minutes. Service was restored at 3:57 p.m. EDT, after failing shortly after 3:48 p.m. EDT. Email support@soomolearning.com with any questions.
Report: "Site outage"
Last updateOne of our service providers experienced an outage today, preventing students and instructors from accessing https://www.webtexts.com/ for 12 minutes. Service was restored at 12:25 p.m. EDT, after failing shortly after 12:13 p.m. EDT. Email support@soomolearning.com with any questions.
Report: "Site outage"
Last updateA platform deployment led to about 10 minutes of time during which our main web site, https://www.webtexts.com/, was inaccessible. Service was restored at 11:59 a.m. EDT, after failing shortly after 11:50 a.m. EDT. All site users were affected. We will update this incident with more details as our investigation proceeds.
Report: "Identity service inaccessible"
Last updateOn Saturday, September 8, starting at 4:12 p.m. MDT, and ending at 4:48 p.m. MDT, our identity service, which is called "glue" internally, experienced degradation in connectivity to its primary database. This prevented some users from progressing from our core platform, which was unaffected, to our legacy platform at courses.soomopublishing.com. During the period of degradation, we observed requests from 40 distinct IP addresses attempting to pass through the identity service to the Soomo Learning Environment. Some of these requests may have succeeded, but most users during this period of time would have noticed either slowness, or an inability to enter the legacy platform. We continue to monitor the service closely, and have acted to limit the impact of future connection degradation by increasing the minimum parallelism of the service. Where we had previously been running at minimum a single service instance, we now ensure that at least 2 are running at all times.
Report: "Site availability issue"
Last updateWe have corrected the issue with the affected database, and restored the Soomo Learning webtext platform to regular functioning. Students attempting to save work during the outage may have received errors indicating their work was not saved. Any attempts to save work that did receive acknowledgement of success, however, will have been successfully saved. Sync operations will be undertaken over the next hour, at which point Course Analytics and LMS Grade Delivery will be fully up-to-date for any work successfully saved during the outage.
We are continuing to investigate the issue and will post an update as soon as more information is available. Note that the affected database is not the primary store of record of student work, but is a secondary store that is used to capture operational details and track work queued for background execution, such as grade generation and email delivery.
Due to an issue with one of our databases, students are experiencing difficulty accessing webtext content. We will post updates as the situation evolves.
Report: "Test incident"
Last updateThe non-issue is resolved.
We have identified the issue. It's not a problem, because this is only a test.
This is a test incident to see how things work with the latest HipChat integration.
Report: "Access via SNHU Brightspace is currently closed"
Last updateStudents are now arriving normally from SNHU Brightspace, and we consider this issue to be resolved.
SNHU has tracked the source of the issue and reports that it is resolved. We have reopened LMS access from SNHU Brightspace. Please contact us if you are still experiencing any issues!
After identifying a security issue with student and instructor launches originating from SNHU Brightspace, we have closed access via the LMS. We are standing by to restore access once SNHU has confirmed the affected systems have been corrected.
Report: "Site availability issue"
Last updateThe webtexts.com website was inaccessible to web users for the period between 8:50 a.m. EST and 8:55 a.m. EST.
Report: "An Amazon AWS outage is affecting our users"
Last updateAll remaining issues have resolved! Please contact support if you have any questions or are experiencing any difficulty.
Good news! Your webtext should no longer be missing images or links, and paper downloading should be functioning normally. In addition, new students should be able to sign up successfully. Grade delivery and Soomo Messenger are still affected.
Students who are subscribing to a new webtext will experience an error that prevents them from proceeding any further, as our terms of service are presented from content stored at Amazon AWS.
Grade delivery for students with gradebook sync is suspended due to the ongoing AWS outage. Grades are queueing and will be delivered when service is restored.
Due to some issues with Amazon AWS, your webtext pages may be missing certain images or links. Affected functionality may include: * Images on webtext pages * Transcript downloads * Downloading papers from writing templates We will post updates as the situation evolves.
Report: "Degraded service (Retroactive)"
Last updateOur site had trouble serving requests between 1:18am EST and 5:25am EST on Wednesday, Dec 14. Specifically, 15-18% of requests appear to have failed. This would appear to a user as a error page or an error message if they were trying to save responses. We continue to communicate with our service providers in an effort to determine the ultimate cause of this service degradation.
Report: "Service Interruption for WGU Users"
Last updateWe have released an update that addresses this issue. Please contact Soomo Support by email at support@soomolearning.com if you encounter any problems accessing your Soomo Learning resource.
We have identified the problem and are working to resolve it. We will continue to post updates here until the issue is resolved.
We are still investigating the situation.
We are still investigating the situation.
We are currently investigating access issues reported by users at WGU. Status updates will be posted here.
Report: "Content Delivery Network Disruption"
Last updateOn April 21, between 8:00 a.m. and 12:15 p.m. EDT, some users experienced page display issues related to an operational failure at one of our hosting partners. We have made changes to our platform that reduce the likelihood this problem will recur. In addition, monitoring has been added so we can respond more rapidly should the problem occur again.
Report: "Course Analytics Timing Data Backlog"
Last updateOn April 21, between 4:00 AM EDT and 7:30 AM EDT, as a result of a database issue, we built up a backlog while processing user timing data for Course Analytics. During this period, timing results displayed at Course Analytics will not have been updated to reflect student activity. No data was lost, and the backlog was cleared by 7:30 AM EDT.