Searchspring Public

Is Searchspring Public Down Right Now? Check if there is a current outage ongoing.

Searchspring Public is currently Operational

Last checked from Searchspring Public's official status page

Historical record of incidents for Searchspring Public

Report: "Indexing issue"

Last update
resolved

This incident has been resolved.

monitoring

We are continuing to monitor for any further issues.

monitoring

A fix has been implemented and we are monitoring the results.

identified

The issue has been identified and our teams are working on implementing a fix. We’ll provide more updates as soon as we have additional information. We will provide another update in 30 minutes or less.

investigating

We are currently investigating an indexing issue for customers on the new Shopify connector. Our teams are actively working on a resolution and will provide an update within the next 30 minutes. We appreciate your patience.

Report: "Issue Accessing SMC"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

We are continuing to investigate this issue.

investigating

We are currently investigating an issue preventing users from accessing the Searchspring Management Console (SMC). Our teams are actively working on a resolution and will provide an update within the next 30 minutes. We appreciate your patience.

Report: "Shopify: Products Missing from Collections"

Last update
resolved

We have been monitoring the data that we are receiving from Shopify and are now satisfied that the undocumented API changes they made have been reverted. For customers who we had to temporarily disable live indexing, this functionality has been fully restored on your sites. We appreciate your patience during this time, and we’ll continue to keep a close eye on the situation to ensure consistent performance.

monitoring

It appears that Shopify has rolled back the undocumented API changes that they made overnight, as we are now receiving data and collections have been restored. As we have not yet received a confirmation or update from Shopify, we are continuing to monitor the situation. Once we are confident that additional changes aren't being made by Shopify, we will mark this issue as resolved.

identified

We are currently awaiting an update from Shopify regarding API changes that they've made. Search is operational, however we are not receiving properly formatted Collection data from Shopify. Additionally, product data may be stale. We will provide additional information as it becomes available to us.

identified

Shopify has begun making changes to resolve the API issue which started last week. As a result of those changes, we are currently experiencing issues with data collection from their platform. Our team is currently investigating the root cause of the issue. We will provide another update within the next hour.

identified

Shopify has acknowledged the issue on their end is working towards a solution. They have not yet provided us with a timeline. Once they have implemented a fix, we will be able to evaluate if Live Indexing can be re-enabled for customers who were previously running it.

identified

We are continuing to work on a fix for this issue.

identified

We are still waiting on a technical response from a third-party provider. While we await their response Live Indexing is disable, however normal indexing functionality was restored with our previous status. Our next update will be once we've received a response from the third-party provider.

identified

We’ve identified the issue and implemented a workaround while we await a technical response from a third-party provider. We’ll keep you informed and provide an update as soon as we have more information.

identified

We continue to work on a fix to resolve the issue. We will update you again in approximately 30 minutes.

identified

We continue to work on a fix to resolve the issue. We will update you again in approximately 30 minutes.

identified

Work continues on the issue and we will update you again in another 30 minutes.

identified

Our team is still working to resolve the issue for all impacted customers, and we appreciate your patience. We will provide another update in 30 minutes or less.

investigating

We are currently experiencing an issue impacting a subset of Shopify customers, where products may be missing from collections. Our team has identified the issue and our teams are working on resolving the issue as quickly as possible. We will provide another update in 30 minutes or less.

Report: "Data feed issue with some Big Commerce customers"

Last update
resolved

The source of the problem has been addressed and all customers who were impacted have either already been re-indexed, or are in the process of indexing. As those indexes complete, your site will function as expected.

monitoring

We identified the issue as being a change in the default delimiter for handing BigCommerce data feeds. This impacted our ability to read the data feed structure for BigCommerce customers. We have corrected the issue and are re-indexing customer's who encountered the error, once the index is complete the problem should be resolved.

identified

We are currently investigating an issue that is impacting the data structure of some BigCommerce customers. We believe we have found the source of the issue already and are currently working on resolving it.

Report: "Product Exclusions for Some Shopify Clients"

Last update
resolved

The incident has been resolved and all affected sites are back to normal product exclusion numbers.

identified

We have detected an issue impacting a subset of Shopify clients, where more products than expected are being excluded. This is due to a recent change on Shopify’s end. Our engineering team is actively investigating the issue and working towards a resolution. We will provide an update within the next 30 minutes.

Report: "Indexing Degraded"

Last update
resolved

We have identitied and resolved the issue causing the degraded state of our indexes. The indexing queue is returning to normal.

investigating

We are currently investigating an issue causing a slowdown in indexing. You can expect an update in 30 minutes or less once we have more information.

Report: "Search Outage"

Last update
resolved

Systems have recovered and are back to operational in all areas. We are closing out this incident thank you for your patience during this time.

monitoring

We have identified and resolved the issue affecting our systems. Recovery is currently in progress. Our team will continue to monitor the situation closely until the systems have fully recovered. We will provide an update within the next 30 minutes or sooner with more information.

investigating

We are currently seeing 504 errors across all autocomplete and search requests, preventing search results from being returned. Our team is actively investigating and will provide an update in 30 minutes or sooner as more information becomes available.

Report: "Indexing Degraded"

Last update
resolved

We have identified and resolved the issue. Indexing has returned to a normal state.

investigating

We are currently investigating a degraded state of indexing where some sites are not completing successfully. We will update you here in 30 minutes

Report: "Regional Issues for AU"

Last update
resolved

All previously impacted services have now recovered and the issue has been cleared. Our team is still monitoring the situation as we work to migrate all traffic back to it's original regions.

identified

Indexing remains paused for the AU region as we continue to work on implementing corrective measures. We will post an update in approximately 60 minutes

identified

Indexing for the AU region is currently paused as we implement corrective measures. The systems are in the process of recovering, and we are working diligently to restore full functionality. We will post an update in approximately 60 minutes.

identified

We have identified the issue and are in the process of taking corrective actions to resolve it. We will post another update in approximately 30 minutes.

investigating

We are continuing to investigate this issue.

investigating

We are currently investigating an issue affecting the AU region. An issue was identified with the clusters in this region, causing search calls to return errors. We have successfully diverted traffic to a failover cluster, and search functionality has been restored. Our team is continuing to investigate ongoing indexing issues in the AU region.

Report: "Degraded Search Performance"

Last update
resolved

The issue has now been resolved.

monitoring

We have identified and resolved the source of the issue. We are now monitoring the situation the ensure normal performance continues.

investigating

We are currently experiencing an elevated number of errors related to our search API. This will impact some traffic in the North America region. We are currently investigating and will provide regular updates in 30 minutes intervals or sooner.

Report: "Searchspring Management Console"

Last update
resolved

This incident has been resolved.

investigating

The issue with the 3rd party vendor has been resolved and the SMC is back and fully operational.

investigating

Our Searchspring Management Console (SMC) is experiencing an issue due to a 3rd party vendor we use. They have identified an outage cause and are working to resolve the issue. Searchspring users may see missing logos, buttons, and other assets. We will continue to monitor their status page and update you here as soon as we know more.

Report: "Reports: Zero Search Results & Product Recommendations Report"

Last update
resolved

Update: All reports are now fully restored. The team has worked hard and taken measures to reduce the likelihood of an issue like this arising in the future. We appreciate your patience as we worked through this issue.

monitoring

We have confirmation of the following: 1. Zero Results Report & A/B Testing reports are fully recovered 2. Product Recommendations Report is still in the process of data recovery We will update you again once we have more to offer.

identified

We received an update from the Engineering team that the Zero Search Results report has been restored through 2/24 so far. Data for Product Recommendations, A/B Testing & VM reports is still in process.

identified

Our engineering team has given us an update and they expect reports to be fully restored by the end of the week. We will update you again once we have confirmation they are back to reporting data as expected. Thank you for your continued patience.

identified

The engineering team has advised that data restoration is still in progress for these two reports. We do not have an ETA yet for when it will be completed. We will update you as we know more.

identified

Zero Result Searches and Product Recommendations reporting: We want to inform you that there is a known delay in the data populating these reports which started on February 16th. Our Engineering team is aware of this issue and assures us that there will be no loss of data. They are diligently working on restoring the data. However, due to the large volume of data involved (in the terabyte realm), we anticipate that this process will take several more days. We are committed to resolving this issue as quickly as possible and we will keep you updated with any developments as soon as they become available.

Report: "Delays in bulk indexing"

Last update
resolved

The intermittent slow-downs have now been resolved.

identified

The engineering team has advised that we are still working on the delays in bulk indexing. Slow down and delays are still being experienced intermittently by some clients. We will update you as soon as we have more information to offer.

investigating

We are currently experiencing intermittent slowdowns in our bulk indexing process. While sites are still completing, you may notice that it is taking longer than usual. Our engineering team is actively investigating the issue to identify the root cause. We are prioritizing this matter and will provide updates as soon as we have more information.

Report: "Indexing Slowness"

Last update
resolved

This incident has been resolved.

monitoring

We are continuing to monitor for any further issues.

monitoring

Indexing has returned to normal. We will continue to monitor but do not expect any further issues and will close out this incident

monitoring

No change from the prior message. The queue remains in the process of recovery and we are monitoring. Another update in 30ish minutes

monitoring

We have identified and addressed the problem, and the queue is recovering. We will update you again within 30 minutes

investigating

We are currently experiencing degraded performance for indexing. Indexing jobs could take longer than expected. We are actively investigating and will provide an update here within the next 30 minutes.

Report: "Partial Search API Outage"

Last update
resolved

This incident has been resolved.

monitoring

We have identified the root cause and the issue is now resolved. Search API service is returning to normal, and the team will be monitoring the systems for the next several hours for any further anomalies.

investigating

We are experiencing a partial outage for a subset of customers where the Searchspring search API is not returning results. We are actively investigating. We will update you here in 30 minutes or sooner.

Report: "Partial Reporting Outage"

Last update
resolved

This incident has been resolved.

identified

We have identified the problem in the reporting data processing system. We can confirm that there is no loss of data. We are in the process of deploying a fix. Once in place, the backfill of data will begin and is expected to take several days to fully complete. We will update you again within the next 24hrs.

investigating

We have identified an issue with some of our reports that have stopped working as of 12/07 for all customers. These reports include Search Insights, Google Analytics Insights, and Product Insights. We are actively investigating and we will update you as we have more or within the next 30 minutes.

Report: "Intermittent Issues with Searchspring Management Console"

Last update
resolved

This incident has been resolved.

monitoring

We recently experienced an outage with a third-party service that was affecting the performance of the SMC. The SMC is now back to operational status. We are actively monitoring for any remaining impact.

investigating

We are currently investigating reports of customers experiencing a slow or non-functional Management Console. We will post an update here in 30~ minutes.

Report: "Partial Reporting Outage"

Last update
resolved

The incident is now fully resolved. No data loss as previously mentioned and all reports should now be restored.

identified

We have identified the problem in our reporting data processing system. We can confirm that there is no loss of data. We are in the process of deploying a fix. Once in place, the backfill of data will begin and is expected to take several days to fully complete. We will update you again within the next 24hrs.

investigating

We are continuing to investigate the root cause and will update you again in another 30ish minutes.

investigating

We are continuing to investigate the root cause and will update you again in another 30ish minutes.

investigating

We are continuing to investigate an issue with some of our reports that have stopped working. Under the Basic Report section, those known to be affected are: * Searches * Filters * Sorts * DYM (not all customers have this enabled) We are actively investigating and we will update you as we have more or within the next 30ish minutes.

investigating

We have identified an issue with some of our reports that have stopped working as of 10/24 for all customers. These reports include reports Searches, Filters, and Sorts. We are actively investigating and we will update you as we have more or within the next 30 minutes.

Report: "Indexing Degraded"

Last update
resolved

This incident has been resolved. Indexing times are returning to normal.

monitoring

We have successfully identified the issue, and indexing has now resumed. Our team will continue to closely monitor the situation over the next several hours to ensure everything runs smoothly. While indexing has resumed, it’s important to note that it may take several hours for all sites to be fully updated.

investigating

We are continuing to investigate and will post another update in 30~ minutes.

investigating

Beginning at about 4:00 am ET, we began experiencing an issue that is currently causing the majority of our customers to be unable to index automatically or manually. We understand the severity of this situation and sincerely apologize for any inconvenience. We are actively working to resolve this issue and will provide an update in 30 minutes. In the meantime, there’s no need to take any immediate action. Our team is doing everything possible to get our services back to normal as soon as possible.

Report: "Shopify Live Indexing"

Last update
resolved

This incident has been resolved.

monitoring

We were experiencing increased error rates with our live indexing system due to errors from Shopify’s API. This was affecting our Shopify customers who are using our live indexing feature. This was causing products to not be updated in our database for these customers. We have applied a change that has resolved this issue and are actively monitoring the situation.

identified

We have applied a change to resolve this issue and are actively making this change for all Shopify live indexing customers and will monitor the situation.

investigating

We are currently experiencing increased error rates with our live indexing system due to errors from Shopify’s API. This is affecting our Shopify customers who are using our live indexing feature. This is causing products to not be updated in our database for these customers. There is no impact on our core search and category page functionality. We are investigating the issue and will provide an update again in 30 minutes.

Report: "Unreliable Search and Category Results"

Last update
resolved

This incident has been resolved.

monitoring

We have identified that Amazon CloudFront had a global outage which they now report resolved. This outage will not impact any services in a long standing way, and we expect all services to return to normal right away. We are monitoring the situation and will make updates accordingly.

investigating

A small percentage of customers are experiencing unreliability in search and category navigation. A third party service we rely on (AWS Cloudfront) is experiencing an outage, that is impacting our customers. This is causing inconsistencies in our ability to provide results on Search and Category pages. Our team is still investigating and you can expect another update in 30 minutes.

Report: "Personalization Services are currently down"

Last update
resolved

After monitoring this issue is now fully resolved.

monitoring

A fix has been implemented and we are monitoring the results.

identified

The issue has been identified and a fix is being implemented.

investigating

We are currently facing an outage in our Personalization Services. As a result, recommendations will not appear on sites utilizing our Personalized Recommendations feature. Please note that the sites themselves should continue to function correctly, with all other features and functionalities unaffected. We will update this page in 30 minutes.

Report: "Reports Unresponsive"

Last update
resolved

We have resolved the issue with the reporting and all reports are now working as expected.

investigating

Reports in the SMC (Searchspring Management Console) are unresponsive. We are currently investigating the cause of this issue and will continue to provide updates in the next 30 minutes.

Report: "AWS Outage Impacting Searchspring Services"

Last update
resolved

Closing this incident

monitoring

AWS is reporting most of their services have recovered. We will continue to monitor for the next several hours and if needed will publish an update but all should be returning to normal.

identified

Amazon Web Services (AWS) is experiencing an issue that is impacting Searchspring services * Shopify Customers using the New Shopify Connector are unable to index at this time. Expected updates in 30 minutes

Report: "Delayed Indexing (resolved) Now Delayed Messaging"

Last update
resolved

Closing incident out as it has been fully resolved.

monitoring

We are fully back to normal with all indexing and messaging. We will be monitoring for the next 12 - 24 hours to ensure all remains stable.

identified

We are close and awaiting an update on a final resolution from our team and expect an update within the next 20 minutes.

identified

Efforts are continuing as we come closer to reaching a resolution. You can expect another update within the hour or sooner if we have something more to report.

identified

The indexing queue is back to normal, indexes are flowing and sites are being updated. We have identified the need to temporarily disable all emails being sent automatically from Searchspring services. These include but are not limited to: * Indexing Failures & Success * Account Signup *Password reset * etc We are working toward a resolution as soon as possible and we will update this page in approximately 30 minutes

identified

We are currently experiencing delays in our indexing system and we’ve identified the issue. The issue is due to an unexpected update from a third party provider that we rely on for email messaging services. We’re working to address this issue and will provide an update again in 30 minutes.

identified

The cause of this issue has been identified and we are working to address this issue. We will provide another update in 30 minutes.

investigating

We are continuing to investigate this issue.

investigating

We are currently experiencing delays in our indexing system. This is affecting a subset of customers. This is causing products to take longer to be updated in our database. There is no impact on our core search and category page functionality. We are investigating the issue and will provide an update again in 30 minutes.

monitoring

We have applied a change to resolve this issue and are actively monitoring the situation.

investigating

We are continuing to investigate this issue.

investigating

We are currently experiencing delays in our indexing system. This is affecting a subset of customers. This is causing products to take longer to be updated in our database. There is no impact on our core search and category page functionality. We are investigating the issue and will provide an update again in 30 minutes.

Report: "Searchspring Managment Console Functionality Issues"

Last update
resolved

The fix previously mentioned seems to have resolved the issues with the Searchspring Management Console (SMC).

monitoring

Update: Third-party, Font Awesome updated their status to still degraded, but "a fix has been implemented and we are monitoring"

monitoring

We have identified an issue with our Searchspring Management Console (SMC). Currently, we are experiencing some issues due to a third-party service we use for fonts and iconography (Font Awesome) which is experiencing an outage. We have seen this causing SMC visuals and functionality to be impacted, sometimes intermittently. We will continue to monitor the third-party status page for updates and will update you here once we know more.

Report: "Indexing Impacted"

Last update
resolved

This incident has been resolved. Indexing times are returning to normal.

monitoring

We are currently experiencing delays in our indexing system. This is affecting all customers. This is causing products to take longer to be updated in our database. We have applied a change to resolve this issue and are actively monitoring the situation.

investigating

We are currently experiencing delays in our indexing system. This is affecting all customers. This is causing products to take longer to be updated in our database. We are still investigating the cause of this issue. We will provide another update in 30 minutes.

Report: "Search and category pages down"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are continuing to monitor the issue.

investigating

We are currently investigating an issue where search and category pages are not showing any results for all customers. We are urgently looking into this issue and will continue to provide updates.

Report: "Indexing Jobs Failing to Start"

Last update
resolved

This incident has been resolved.

investigating

We are currently experiencing increased error rates with our indexing system resulting in indexing failures. This is affecting a subset of our customers. There is no impact on our core search and category page functionality. We are investigating the issue and will provide an update again in 30 minutes.

Report: "Indexing times slower than normal"

Last update
resolved

This incident has been resolved.

monitoring

We are continuing to actively monitor this issue issue and will provide an update in 30 minutes.

identified

We have applied a change to resolve this issue and are actively monitoring the situation.

investigating

We are still working to resolve this issue. We will provide another update in 30 minutes. There is no impact on our core search and category page functionality.

investigating

We are currently experiencing a slower than normal indexing time. Our engineering team is investigating this issue and we will continue to provide updates.

Report: "Increased Errors in Publishing Merchandising Changes"

Last update
resolved

This incident has been resolved. Publishing times are returning to normal.

monitoring

We have applied a change to resolve this issue and are actively monitoring the situation. Please re-publish any campaigns that failed to publish during this incident in order to see them take effect. Publishing merchandising campaigns may take longer than normal to complete due to longer than normal publishing queues.

investigating

We are currently experiencing increased error rates in our Merchandising systems. This is affecting all customers. This is causing updates to merchandising campaigns to not be applied. There is no impact on our core search and category page functionality. We are investigating the issue and will provide an update again in 30 minutes.

Report: "Reports Unresponsive"

Last update
resolved

Reporting is now back up and working as expected.

investigating

Reports in the SMC are unresponsive. We are currently investigating the cause of this issue and will continue to provide updates.

Report: "Personalization Issue"

Last update
resolved

We have put a workaround in place to address this issue and recommendations are now working as expected.

identified

We are continuing to explore options to resolve this issue.

identified

We have identified the issue with SSL and are working to address the issue.

investigating

We've seen occasional successful product recommendations loading but they are not consistent. Our team is continuing the investigation and will provide updates.

investigating

We are continuing to investigate this issue and will continue to provide every 15 - 20 minutes.

investigating

Recommendations are receiving an error on the server that appears to be an issue with an SSL connection. We are continuing to investigate and will provide updates.

investigating

We are currently investigating an issue impacting personalized recommendations. We will continue to provide updates.

Report: "Increased Indexing Error Rates"

Last update
resolved

All services to have returned to normal. We will be doing further investigation to determine the root cause.

monitoring

We have directed traffic for Search API back to the US west coast for west coast customers and are continuing to monitor.

monitoring

The issue appears to have been a networking error which has recovered and indexing appears to be working normally. Indexing times may be elevated due to a larger than normal queue that was built up during this issue. We will continue to monitor the situation.

investigating

We are still investigating this issue. The issue is isolated to a set of our west coast US servers so we have directed all US traffic for these clients to our east coast servers to avoid the possibility of this issue affecting our Search APIs. Clients on this set of servers will continue to see indexing errors.

investigating

We are currently seeing higher than normal indexing error rates for a subset of our customers.

Report: "Increased Indexing Times"

Last update
resolved

Indexing times have returned to normal.

monitoring

There was an issue that caused indexing to temporarily be paused. This caused a longer than normal queue of indexes to be run. While we process through this queue indexing times may take longer than normal.

Report: "Large Indexing Queue"

Last update
resolved

Indexing times are returning to normal. We will continue to monitor.

monitoring

The previous update was sent in error and was a default message. There was no fix that needed to be applied, the indexing queue times are continuing to decrease. We are still exploring the root cause of the higher than normal indexing cause for a small subset of customers.

monitoring

A fix has been implemented and we are monitoring the results.

identified

It appears that there were a small subset clients whose indexing jobs are taking much longer than normal. This in turn created a larger than normal backlog of jobs which increased indexing times overall. It does appear with those jobs completed that indexing times are beginning to return to normal.

investigating

We're seeing a much larger than normal indexing queue, we're investigating to determine the cause of the increased queue size. This is resulting in longer than normal indexing times.

Report: "Indexing Failures"

Last update
resolved

This issue has been resolved and error rates have returned to normal.

monitoring

We have identified the issue and applied a fix to address it. It appears that indexing operations are now completing successfully. We'll continue to monitor the situation.

investigating

We are seeing increased error rates in indexing. We have temporarily paused indexing while we explore this issue.

Report: "Lapse in reporting"

Last update
resolved

We have identified the cause of the missing data that was part of an unrelated release earlier this week. We have rolled back the release and data is once again being reported. Unfortunately, the data has been lost and cannot be backfilled.

investigating

We are currently investigating an issue with a few reports missing data for the 18th & 19th. We will update this page when a resolution has been reached.

Report: "Stuck Indexes"

Last update
resolved

Indexing has returned to normal.

investigating

Accounts continue to index successfully, just slower than normal.

investigating

We are continuing to investigate the slow indexing times and will continue to provide updates.

investigating

A few accounts have successfully indexed but we are still seeing extremely slow indexing times and are continuing to investigate.

investigating

We are currently investigating an issue where indexing appears to be stuck for a subset our customers. We will continue to provide updates regarding this issue.

Report: "Stuck Indexes"

Last update
resolved

This incident has been resolved.

monitoring

We are continuing to monitor the indexing queue to ensure the rolled-out fix resolves the issue.

monitoring

Our indexing queue looks to be stabilizing, however, we will continue to monitor this matter.

monitoring

Our team is continuing to monitor the rolled-out fix.

monitoring

We have noticed a decrease in indexing delays, but are continuing to monitor this matter.

monitoring

We are reopening the previous issue for the Stuck indexes as we have noticed an increase in indexing delays after rolling out a fix. At this time we are continuing to monitor this matter.

Report: "Stuck Indexes"

Last update
resolved

Our team is still monitoring the outcome of the rolled-out fix.

monitoring

We have identified and addressed the issue that was causing anomalies in the indexing process and are currently monitoring this fix.

investigating

We have rebooted some of the systems that were having issues and have noticed some improvements. At this time we are still investigating what caused this issue.

investigating

We are still in the process of investigating this issue where indexes are taking longer than usual to complete.

investigating

We are still investigating why indexes are taking longer than usual to complete.

investigating

Many of our customer's indexes are finishing as expected, but we are seeing longer than usual index completion times.

investigating

At 9:03 AM CST, we have discovered an issue where some accounts are experiencing stuck indexes. We are currently conducting an investigation.

Report: "Indexing Failures"

Last update
resolved

Amazon has reported this issue as addressed and indexing error rates have returned to normal.

monitoring

It appears that AWS has addressed this issue and error rates have returned to zero. Indexing is running successfully and we are monitoring the situation.

identified

Amazon Web Services are reporting increased error rates in some of their services used by Searchspring as part of indexing. We are currently monitoring the situation and working to determine possible next steps to mitigate this issue.

investigating

We are currently seeing widespread indexing failures and are looking into the cause. Core search and navigation features are unaffected.

Report: "Searchspring Management Console Down"

Last update
resolved

There was an issue with a recent deployment causing the Searchspring Management Console (SMC) to be down for all users. We have fixed the deployment and the SMC is now back up and usable once again.

investigating

We are investigating an issue with the Searchspring Management Console being down for all users.

Report: "Slower Than Normal Data Generation"

Last update
resolved

This incident has been resolved.

monitoring

We are continuing to monitor for any further issues.

monitoring

A fix to the bad data has been implemented. The indexing queue is moving along and we will continue to monitor this issue.

monitoring

Fixes have been deployed and they appear to have resolved the issue. Due to a longer than normal queue indexing may still be delayed, but we should work through the queue quickly.

identified

We have found an issue that has introduced some bad data into our database for indexing configuration. We are working on a fix to stop the bad data from being added to the database and then will proceed to fixing the bad data within the database.

identified

We have identified that some of our regeneration servers appear to not be running properly causing a longer than normal queue time. We are working on a fix to address this issue.

investigating

We are currently investigating reports of slower than normal data generation during indexing. It does appear we have a larger than normal queue and are exploring possible causes.

Report: "Amazon Web Services Issues"

Last update
resolved

Amazon is reporting this issue has been addressed. We have seen indexing errors return to normal.

identified

Amazon is still working towards mitigating this issue. We will continue to monitor. Any indexes that fail will likely succeed when retried.

identified

Amazon is reporting that as they work towards fixing this issue they are seeing early signs of recovery. We'll continue to monitor as we are still seeing intermittent indexing failures.

identified

There have been no new updates from Amazon at this time. We are continuing to monitor this issue.

identified

We are still monitoring this issue. It appears for affected clients indexes are failing only roughly 20% of the time.

identified

There are still no updates at this time. We will continue to monitor.

identified

We are continuing to monitor Amazon's status page for updates. We have no updates at this time.

identified

Indexing errors appear to be happening infrequently at this time, but there is still no official update from Amazon at this time.

identified

There have been no further updates from Amazon at this time. We are continuing to monitor the situation.

identified

Amazon is reporting they have identified the issue and are working to address it. This appears to also be affecting the ability to create new template changes for JS Catalog integrations.

investigating

This appears to be a widespread issues across Amazon Web Services affecting many of their services. This still appears to only be affecting indexing on a subset of our customers at this time. We are still monitoring the outage and determining possible next steps.

investigating

We are seeing issues with Amazon Web Services on the east coast. Currently, this appears to only be causing indexing issues for a subset of our customers. Search and other services are working as expected. We are investigating the situation and will provide another update within 15 minutes

Report: "CORS issue"

Last update
resolved

This incident has been resolved.

monitoring

Due to a change rolled out by Shopify, requests to the Searchspring service started to fail. The Searchspring team created a patch to resolve the issue. We will continue to monitor the situation over the next hour to ensure all sites are operating as expected.

identified

We have addressed the reported issue with search and category pages but are still working on a fix for product recommendations. We will provide another update in 15 minutes.

investigating

A release was made by Shopify that adds new headers to the search request. These headers are not in our allowed list of headers so our API is rejecting them. We’re working on adding these headers to our allowed list temporarily to get things working again while we work with Shopify to determine why this change was made. We will provide another update in 15 minutes.

investigating

We are continuing to investigate this issue.

investigating

We are currently investigating an issue that is affecting collection and search pages from loading for some Shopify customers. We will provide another update in 15 minutes.

Report: "Searchspring Management Console Login Errors"

Last update
resolved

We have made a release to remove this third party dependency temporarily. The only visual impact will be the inability for Searchspring to display announcements on the Dashboard page of the Searchspring Management Console.

identified

Our team has identified an SSL certificate issue with a third-party provider. We’re investigating options to remove dependencies on this third-party to restore login functionality and will provide another update shortly.

investigating

Our team is investigating an issue with the login page for the Searchspring Management Console. Our team is urgently looking into this and will provide another update within the next 15 minutes.

Report: "Searchspring Indexing Delay"

Last update
resolved

The backlog of requests due to the earlier issues has been processed and indexing times are normal.

monitoring

The issue causing slower-than-usual indexing processes has been resolved, however some users may continue to see delays while the queue is cleared. Searchspring has increased the resources dedicated to indexing to help work through this queue.

investigating

A subset of Searchspring customers are currently experiencing slower-than-usual indexing times. Searchspring is aware of the issue and working to resolve the issue.

Report: "Indexing Performance Downgraded"

Last update
resolved

This incident has been resolved.

monitoring

Our team has implemented a fix and indexing performance has returned to normal.

investigating

Our team is still actively investigating, but the downgraded indexing performance is starting to return to normal. We will follow-up with an update in the next 15 minutes.

investigating

Our team is currently investigating downgraded indexing performance for a subset of clients. We will follow-up with a status update within the next 15 minutes.

Report: "Too many database connections / Searchspring Management Console unavailable"

Last update
resolved

This incident has been resolved.

monitoring

We are continuing to monitor for any further issues.

monitoring

A fix has been implemented and we are monitoring the results.

identified

The issue has been identified and a fix is being implemented.

investigating

We are experiencing an issue in our database that is causing the Searchspring Management Console to be unavailable for some users. A small set of users are also experiencing issues with their indexing. We're working on a fix.