Historical record of incidents for Cuboh
Report: "Service Outage Due to Database Value Unintentionally Modified"
Last updateThis incident has been resolved.
On January 22nd a database value was unintentionally modified during a release, causing a service outage that lasted approximately 8 minutes. Everything was quickly rolled back, and the system stabilized.
Report: "DoorDash menu serve requests issue"
Last updateDoorDash excess of menu serve requests overwhelmed our systems and brought down our servers from ~8:30PM to 8:45PM PST. Issue has been resolved by 8:45PM PST.
Report: "Services Outage - Square 86ing and GH Driver webhook issues"
Last updateSquare 86ing endpoint and GH Driver webhook issues caused instability in our services from ~10:30AM to 4:30PM PST. The issue was resolved and no longer occurred after 4:30PM PST.
Report: "Package Upgrade Related Outage"
Last updateIncident has been resolved on October 21st - There was a package upgrade in our latest release which has caused a system outage. This outage lasted for 32 min (From 10:56AM PST to 11:28AM PST).
On October 21st there was a package upgrade in our latest release which has caused a system outage. This outage lasted for 32 min (From 10:56AM PST to 11:28AM PST).
Report: "Elevated API Errors"
Last updateOur partners have informed us about an issue with orders being rejected by the Cuboh cloud infrastructure. The team was able to swiftly identify the root cause and resolve the problem.
Report: "Services Connections Outage (Network issue)"
Last updateWe experienced a network issue affecting outbound connections, which caused Cuboh to be unable to connect to our services. This resulted in the inability to access the App or Dashboard. Issue happened on June 24th from 2:27pm until 2:51pm.
Report: "Database Capacity"
Last updateWe experienced a temporary service interruption due to our database reaching its capacity limit. We swiftly restored the service and identified the root cause of the issue. We apologize for any inconvenience.
Report: "Delay in Menu Management Services"
Last updateThis incident has been resolved.
It appears that this incident has been resolved. We will maintain close monitoring of the situation to ensure ongoing stability.
We are currently investigating an issue affecting our menu management services. Our team is actively investigating the root cause and working towards a resolution. We apologize for any inconvenience caused and appreciate your patience. Updates will be provided as soon as possible. Thank you for your understanding.
Report: "Cuboh 86'ing and restaurant Order Control Service"
Last updateThe security or software updates mandated by our upstream provider necessitate reboots, and these updates are inevitable. Unfortunately, some of the microservices provided by Cuboh failed to reconnect appropriately following the update, and the issues went unnoticed until the regular usage of Cuboh services commenced during restaurant opening hours.
Report: "Menu Publishes"
Last updateThis incident has been resolved and all menu pushes will publish as expected.
Some menu management publishes are stuck and not publishing. Our engineering team is looking into the issue and will update this page with details.
Report: "86’ing items on Mobile App"
Last updateThis incident has been resolved.
Issue has been resolved
Our team is actively working to resolve the situation and the underlying problem with 86’ing items via the mobile application. We apologize for any inconvenience this may cause and assure you that we are making every effort to restore full functionality as soon as possible. We appreciate your patience and understanding. Rest assured, we are committed to providing you with a seamless experience, and we will keep you updated on the progress.
Report: "Order Acceptance & POS injection latency"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being deployed.
Report: "Uber Eats order creation, acceptance and pos injection latency"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
Report: "Uber Eats order creation, acceptance and pos injection latency"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
Report: "Cuboh-Reporting Service Error Display"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
We are currently investigating an issue involving our Analytics and Reporting service.
Report: "Uber Order Acceptance & POS Injection"
Last updateThe incident was identified as a slow down in Cuboh infrastructure service workers. The backlog of scheduled tasks has been processed and everything is back to fully operational.
We are currently investigating reports of Uber Order Acceptance & POS injection issues.
Report: "Cuboh-Core Service Outage"
Last updateThe Cuboh engineering team has resolved the incident. All services operational.
The Cuboh engineering team has put forward a fix and is currently monitoring the issue.
Cuboh Core is having trouble processing new orders. The engineering team has identified the issue and is working towards a fix.
Report: "Elevated Cuboh REST API Errors"
Last updateAll customers unable to login. Orders were no longer coming into the system and the server(s) were responding with a 502 error on the health check.
Report: "Cuboh-Core Hardware failure"
Last updateOrders incoming to cuboh-core were unable to be injected into the POS database infrastructure. Our upstream provider identified this as a hardware issue.