LoyaltyLion

Is LoyaltyLion Down Right Now? Check if there is a current outage ongoing.

LoyaltyLion is currently Operational

Last checked from LoyaltyLion's official status page

Historical record of incidents for LoyaltyLion

Report: "Partial API outage and delays in data processing"

Last update
resolved

This incident has been resolved. All our systems are operational and the data backlog has been cleared.

monitoring

A fix has been implemented in our caching layer. We continue to monitor the results.

identified

Our systems remain stable. We are still working through the data processing backlog whilst continuing to monitor.

identified

An issue in our caching layer led to elevated error rates and response times. We have identified the issue and stabilised our systems. We're now working through the data processing backlog while monitoring.

Report: "Delays in data processing"

Last update
resolved

This incident has been resolved.

investigating

We are currently investigating an issue with delays in data processing, this could cause delays to tier evaluations.

Report: "Job queue partial outage"

Last update
resolved

We observed a performance degradation in one of our job queueing subsystems. As part of recovery to normal operations, we - paused processing on customer tier evaluation between 2024-03-02T13:30 UTC and 2024-03-02T19:00 UTC - paused processing on outbound webhook delivery between 2024-03-02T14:30 UTC and 2024-03-03T14:30 UTC - implemented controls on unusual traffic from Shopify Tier assignment and webhook delivery are now functioning as normal. We plan to gradually deliver the webhooks from the paused period over the next few days.

Report: "SDK outage"

Last update
resolved

Our SDK components went offline due to an issue with our CDN provider. We migrated to our backup CDN and full functionality was restored. This only impacted shopper-facing functionality (i.e. claiming rewards on-site), no API or backend requests were impacted

Report: "Increased API and platform latency"

Last update
resolved

This incident has been resolved.

monitoring

The situation has been resolved, we're continuing to monitor

identified

We've taken steps to triage and performance is stabilising.

investigating

We're investigating increased API and platform latency. The merchant account is unaffected.

Report: "Data Processing Delays"

Last update
resolved

We've caught up with the backlog of jobs and our platform is back to normal.

identified

Our data processing infrastructure is running behind which is causing delays data synchronisation and events such as email sending, customer search and integrations. We've identified the issue and we're working on it.

Report: "Data Processing Delays"

Last update
resolved

This incident has been resolved.

identified

Our background job processing infrastructure is running behind which is causing delays in events such us email sending, customer search and integrations. We've identified the issue and we're working on it.

Report: "Data Processing Delays"

Last update
resolved

Our background job processing infrastructure is running behind which is causing delays in events such us email sending and integrations. We've identified and addressed the problem, and we're working through the backlog of jobs.

Report: "Partial API and platform outage"

Last update
resolved

This incident has been resolved.

investigating

We're further increasing capacity to account for additional traffic over the BFCM period

investigating

We are currently investigating this issue.

Report: "Elevated platform and API response time"

Last update
resolved

A misconfigured cache caused elevated response times for our platform and API routes.

Report: "Elevated platform response time"

Last update
resolved

This incident has been resolved.

monitoring

We've identified the issue and applied a fix. We're currently monitoring to make sure our systems are fully recovered.

investigating

We are currently investigating elevated response time in our API and platform.

Report: "Elevated platform response time"

Last update
resolved

All systems are back to normal. We'll continue to monitor and perform a root cause analysis.

investigating

Most functionality has been restored. We're still working on a few background services.

investigating

Shopper-facing functionality has been restored. We're continuing our investigation in order to restore all services.

investigating

We are currently investigating elevated response time in our API and platform.

Report: "Partial API outage"

Last update
resolved

The situation has now been resolved

investigating

We are continuing to investigate this issue.

investigating

We're currently investigating elevated error responses from the LoyaltyLion API

Report: "API and platform outage"

Last update
resolved

We saw an outage beginning at 23:58 BST on May 1st. Service was partially restored at 00:34 BST May 2nd and normal service levels resumed at 01:38 BST. We're still investigating the root cause of the outage and will update this incident as we learn more.

Report: "Partial API and platform outage"

Last update
resolved

Between 17:10-17:20 API and Platform endpoints experienced a partial outage. Some API requests may have failed during this period. By 17:20 normal service was restored.

Report: "Merchant account sign in issues"

Last update
resolved

Shopify merchants unable to sign in for ~90 minutes; no shopper-facing functionality was impacted

Report: "Partial API and platform outage"

Last update
resolved

This incident has been resolved.

identified

The issue has been identified and a fix is being implemented.

Report: "Partial API and platform outage"

Last update
resolved

This incident has been resolved.

identified

The issue has been identified and a fix is being implemented.

Report: "Partial API and platform outage"

Last update
resolved

We are currently investigating this issue.

Report: "Degraded merchant account & API performance"

Last update
resolved

This incident has been resolved.

monitoring

We've rolled out our fix and are monitoring the results

identified

We are continuing to work on a fix for this issue.

identified

We are continuing to work on a fix for this issue.

identified

We've identified the root cause of the issue and are working on a fix.

investigating

We're currently experiencing degraded performance on the merchant account; load times for both customer facing functionality and aggregate information in the merchant account are elevated.

Report: "Job processing delays"

Last update
resolved

We've caught up with our backlog and all delayed jobs have now been processed.

monitoring

We've just rolled out a fix and have resumed background job processing; we'll give another update when we've cleared the backlog.

identified

We've identified the root cause of the issue; we've triaged the problem and are working on a permanent fix.

investigating

We're currently investigating an issue relating to our background job processing. You may see delays in the following areas: * Customer email delivery * Launching loyalty tiers * Imports and exports Core customer-facing functionality including earning points, claiming rewards, and customer UI is unaffected.

Report: "Partial API and platform outage"

Last update
resolved

This incident has been resolved.

investigating

We are continuing to investigate this issue.

investigating

We are continuing to investigate this issue.

investigating

We are currently investigating this issue.

Report: "Elevated response times for API and platform services"

Last update
resolved

This incident has been resolved.

investigating

We are continuing to investigate this issue.

investigating

Our API and SDK platform is currently experiencing degraded performance

Report: "Elevated response times for API and platform services"

Last update
resolved

This incident has been resolved.

investigating

We are continuing to investigate this issue.

investigating

We are currently investigating this issue.

Report: "SDK functionality impaired"

Last update
resolved

This incident has been resolved.

monitoring

SDK components should now be back online. We're monitoring the situation and will deploy additional resources as needed.

investigating

We are continuing to investigate this issue.

investigating

LoyaltyLion's on-page SDK components currently have impaired functionality. They may not render, or will render as though a customer is not logged in. We're investigating the issue.

Report: "Partial API & Platform outage"

Last update
resolved

Some API and Platform requests will have failed between 19:07 - 21:03 UTC.

Report: "Partial API and platform outage"

Last update
resolved

For a period of about 10 minutes our API and platform experienced degraded functionality and may have returned error responses for API calls and authenticated platform requests.

Report: "Outage"

Last update
resolved

This incident has been resolved.

identified

We are continuing to work on a fix for this issue.

identified

Our merchant and shopper facing platform and API are currently experiencing an outage. We've identified the problem and are working to restore service shortly

Report: "Merchant account outage"

Last update
resolved

We've resolved the issue and all merchant-facing aspects of LoyaltyLion are now operational.

investigating

Merchant-facing aspects of LoyaltyLion are currently experiencing issues. All shopper-facing aspects are unaffected. Engineers are investigating.

Report: "Shopify embedded POS app outage"

Last update
resolved

The Shopify apps team have fixed the issue and LoyaltyLion and all other POS apps should be working again. You don't need to update the Shopify POS app.

identified

Shopify are currently experiencing an issue with embedded POS apps. The LoyaltyLion embedded app and any other POS apps you have installed may fail to open and will time out with an "Application failed to launch" message. We have raised this issue with Shopify and it has been acknowledged; a fix should be incoming.

Report: "Merchant account outage"

Last update
resolved

We had a temporary outage in the merchant account which affected the rules area. Access was restored promptly and no data was lost.