Historical record of incidents for Sapling Intelligence
Report: "Increased multilingual usage leading to some timeouts"
Last updateIncreased load to multilingual handling as well as increased latency when sending Amplitude events led to degraded latency for other endpoints.
A fix has been implemented and we are monitoring the results.
Report: "Latency spike"
Last updateA shortage of available pods resulted in latency spike starting around 10:20 PDT
Report: "Increased latency"
Last updateIncrease in latency due to upgrades to libraries for error classification pipeline.
Report: "Cluster capacity reached"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Report: "Non-edits services unavailable / degraded perforamnce"
Last updateDue to Linkerd issues, services outside of /edits (primarily autocomplete and AI detection) were degraded / unavailable.
Report: "Memory utilization spike"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
Report: "Rephrase service down"
Last updateThis incident has been resolved.
We have identified the issue and are resolving
Report: "Edits API and SDK incompatibility"
Last updateSDK would display error from 3/20 5pm to 3/21 11am Pacific Time for empty edits array due to a backend inconsistency.
Report: "Degraded performance"
Last updateFrom 6:30 to 9AM PT, there was degraded performance due to issues with server database and caching system.
Report: "Cluster update resulting in downtime"
Last updateThis incident has been resolved.
Issue has been resolved.
We are currently investigating the issue.
Report: "Degraded API performance"
Last updateDue to some configuration issues when scaling our servers, users may have experienced degraded API performance.
Report: "Load balancer issues"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Filtered edits"
Last updateFrom around 11:30pm to 1:30pm PT most suggested edits were filtered. This has been resolved.
Report: "Degraded edits performance"
Last updateHigher latency than usual from 6/27/2023 10:30pm PT to 2/28/2023 8:30am PT.
Report: "Downtime"
Last updateDowntime on 1/23 from 8:45pm to 9:45pm PT
Report: "Degraded edits performance"
Last updateDegraded edits performance with timeouts from 1/5/2023 9pm PT to 1/6/2023 9am PT
Report: "High latency"
Last updateFrom around 8am to 10:30am PT there was higher latency than usual. All systems are now functioning normally again.
Report: "Sapling login errors"
Last updateThis incident has been resolved.
We have resolved the issue. Some users may need to clear their cache in order to receive updates. Contact support@sapling.ai with any questions.
Some users are unable to sign into applications with their account information. We have identified the cause and are deploying fixes.
Report: "Degraded Suggest performance"
Last updateFrom 4:30pm to 6:15pm PT on 2022-08-10, Suggested response functionality was down.
Report: "High latency"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We have redeployed some systems to try and resolve this issue.
Report: "High latency"
Last updateFrom 1300 to 1315 AM latency was high and the Sapling service was inaccessible.
Report: "Website editor pages nonfunctional"
Last updateSeveral pages (including /grammar-check, /spell-check) were nonfunctional.
Report: "Higher than usual latency"
Last updateHigher than usual latency from 11am to 1am PT. This has been resolved.
Report: "High latency"
Last updateIncreased latency of Sapling's endpoints, in particular for website.
Report: "Sapling unreachable"
Last updateThis incident has been resolved.
We are continuing to work on a fix for this issue.
The issue has been identified and a fix is being implemented.
Report: "High latency"
Last updateLatency was increased for roughly 90 minutes due to increase in networking requirements. Sapling has increased networking bandwidth and issue resolved at roughly 12:10pm PT.
Report: "Snippets and autocomplete not working"
Last updateThis incident has been resolved.
Autocomplete issue should be resolved. We are awaiting Chrome Webstore for snippets issue.
The issue has been identified and a fix is being implemented.
Report: "Downtime"
Last updateDatabase overload leading to downtime.
Report: "Unusually high latency"
Last updateHigh latency due to configuration of search module.
Report: "Unusually high latency"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "API Slowdown"
Last updateThis incident has been resolved.
Report: "Unusually high latency"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
Report: "Cluster maintenance"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Unusually high latency"
Last updateThis incident has been resolved.