Historical record of incidents for Coveo Cloud
Report: "[All Regions] Generative Answering Issues"
Last updateWe've identified an issue affecting Generative Answering in all regions that is being caused by one of our infrastructure providers. Customers using this service are currently seeing abnormally elevated error rates. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All Regions] Generative Answering Issues"
Last updateWe've identified an issue affecting Generative Answering in all regions that is being caused by one of our infrastructure providers. Customers using this service are currently seeing abnormally elevated error rates. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[US] ML Model Building Issues"
Last updateWe've identified an issue affecting ML Model Building for a subset of models. Model updates and refresh is currently not possible for the following type of ML Models in the US region: Automated Relevance Tuning, Query Suggest, Product Recommendations, Content Recommendations, Dynamic Navigation Experience and Predictive Query Suggest. Models are still being served normally. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "Partial outage affecting Data Platform ingestion in EU"
Last updateWe have identified an issue coming from one of our infrastructure providers that is affecting data ingestion for the Experience Hub and Experimention Hub for our customers in the EU region. We are actively monitoring the situation and will post regular updates until this is fully resolved.
Report: "[US] Catalog Sources Indexing Delay"
Last updateWe've identified an issue causing indexing delays for Catalog sources in the US region. We have identified the cause and are actively working on a fix. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All Regions] Generative Answering Issues"
Last updateWe're investigating an issue affecting Generative Answering in all regions. Customers using this service are currently seeing abnormally elevated error rates. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All Regions] Search Service Issues"
Last updateThis incident has been resolved. All services have been fully operational since the last update.
A definitive fix has been implemented and we are monitoring the results.
Our initial attempts to mitigate the problem have been successful. We are still working on a permanent solution. Services have been mostly stable for the past thirty minutes, but have continued to experience shorter blips of errors or degraded performance.
We've identified a potential mitigation action and are taking steps to deploy it. Several other services are also impacted.
We've identified an issue causing a partial outage of the Search Service in all regions. Customers are currently experiencing elevated error rates. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[US] Event Ingestion Issues"
Last updateThe service has remained fully operational since the last update. This incident is resolved. Please report any issues through our <a href="https://connect.coveo.com/s/">Help Portal</a>.
The issue has been fixed and we are actively monitoring this service. Thank you for your patience.
We're investigating an issue causing events to be delayed in the US region. Our team will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://connect.coveo.com/s/">Help Portal</a>
Report: "[Australia] Commerce Semantic Encoder Issues"
Last updateThis incident has been resolved.
The issue has relapsed and is now occurring again for a subset of customers in the Australia region. Our team is investigating.
The situation is now stable. We are working on a permanent fix.
Mitigation steps have been taken and we are actively monitoring this service. Thank you for your patience.
We've identified an issue affecting the Semantic Encoder for Commerce on a small number of customers. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[US] Analytics Read Issues"
Last updateThis incident has been resolved and the analytics event backlog has been fully processed. Thank you for your patience.
The incident is being mitigated by our cloud infrastructure provider. We are seeing recovery with most queries now being successful. Analytics data processing has been resumed, though over the course of this incident we accumulated a backlog that will need to be processed. Dashboards and reports are available again but the data they display may not be up to date.
We are continuing to work on a fix for this issue.
The incident with our infrastructure provider is still ongoing. In an attempt to decrease the load on the infrastructure we have temporarily paused analytics data processing workflows in this region. This improves the success rate of queries being made against the service at the cost of a delay in the freshness of the data. We will continue to provide updates until solved.
We've now confirmed that the issues are caused by a problem which has been acknowledged by one of our infrastructure providers. Although a capacity increase appeared to momentarily resolve the issues, we are now seeing intermittent errors again. For now this means the outage is partial and we are continuing to look at potential mitigation actions.
A fix has been implemented and the impact has been mitigated. We are continuing to closely monitor the service.
We are continuing to investigate this issue.
We're investigating an issue affecting the Analytics Read service in the US region. Analytics reports and dashboards in this region are currently unavailable. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All Regions] Generative Answering issues"
Last updateThis incident has been resolved. The service has been operating normally since the last update.
A fix has been implemented the service is back to operating normally. We are continuing to monitor things closely.
We are continuing to work on this issue. Error rates are declining, but a small subset of customers are still impacted.
We've identified an issue affecting the Generative Answering service. A small subset of customers using this service are currently being impacted by elevated error rates, but the majority of queries are continuing to be answered normally. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All Regions] Generative Answering issues"
Last updateThis incident has been resolved. The service has been operating normally since the last update.
A fix has been implemented the error rate has returned to zero in the past few minutes. We are continuing to monitor the service more closely than usual for any further anomalies.
The issue has been identified and a fix is being implemented. There are still some errors, but the error rate has been going down in the past few minutes. Our team is working on this and will continue to post regular updates until solved.
We've identified an issue affecting the Generative Answering service. Customers using this service are currently being impacted by elevated error rates, though a proportion of queries are continuing to be answered normally. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "Degraded performance with Usage Analytics report data in Europe."
Last updateAfter careful monitoring of the situation, we can confirm that the situation is now fully resolved.
The issue has been identified and we're starting to see signs of recovery. We are continuing to monitor this issue until it is fully resolved.
We are continuing to investigate this issue.
Since 7AM ET, we've been experiencing a delay in UA report data (no data loss, just a data delay). Data is being processed, but it is taking longer than usual.
Report: "[EU] Content Refresh Delays"
Last updateThe content backlog has been processed, resolving this incident. Our team is still analysing what went down and depending on the outcome of this analysis, our Support team may end up contacting a small subset of customers to manually resolve some content updates that could not be automatically replayed.
A fix has been implemented and document processing has resumed, but content is still not up to date for a small subset of customers in the EU region. We are monitoring the processing of the remaining content backlog.
We've identified an issue causing refresh delays in our European hosting region. Your content might not be up to date. Our team is working on it and will post updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All Regions] Indexing Pipeline Extension issues"
Last updateA fix has been deployed and has resolved this issue. Thank you for your patience.
Our team has identified a workaround: after adding an extension the page will go blank. However, clicking the "Common" tab will successfully display the extension and allow users to save the configuration. Our team is working on rolling out a permanent fix for this issue.
We identified an issue affecting indexing pipeline extensions. Attempting to add extensions to sources is currently not working. Extensions that were already associated with a source are not affected. Our team is actively working on a fix and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "Delayed data processing affecting Experimentation Hub and Experience Hub"
Last updateThis incident is now resolved, we have caught up on processing all queued data and are doing final checks to ensure integrity.
Our cloud provider has fixed their incident and we are resuming data processing. It will take some time to catch up, we are actively monitoring and will resolve this incident once all data is up to date.
An incident with one of our cloud providers is causing data processing to be delayed in the systems powering the Coveo Experimentation Hub (CEH) and Coveo Experience Hub (CXH). Data collection is unaffected and no data is currently being lost - we expect to catch up once our cloud provider has resolved their incident. Experience & Campaign execution on-site is unaffected. Reporting in the administration interfaces of CEH and CXH is currently out of date but still available.
Report: "[All Regions] Atomic, Headless and React Issues"
Last updateA fix has been deployed and this incident has been resolved.
We've identified an issue affecting the latest versions of Atomic, Headless and Atomic React. Customers using these resources in their implementations might notice failures or unexpected behaviors: https://static.cloud.coveo.com/atomic/v3/* https://static.cloud.coveo.com/headless/v3/* https://static.cloud.coveo.com/atomic/v3.4/* https://static.cloud.coveo.com/headless/v3.4/* https://static.cloud.coveo.com/atomic-react/v3/* https://static.cloud.coveo.com/atomic-react/v3.1/* Our team is currently working on deploying a fix. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All Regions] Generative Answering Issues"
Last updateThis incident has been resolved and the service has been operating normally since the last update. Thank you for your patience.
The capacity problems have been resolved and a fix has been rolled out. We are continuing to monitor the service closely.
We have mitigated the capacity problems but some users may still experience some slowness. We are working on a fix.
We continue to work with our cloud infrastructure provider to increase capacity and have started seeing partial recovery but some users may still see slower than normal response times.
We've identified the issue as being caused by a lack of capacity and we are working with our cloud infrastructure provider to resolve it. Users might notice slower than normal query responses as well as elevated error rates on CRGA queries.
The issue has been identified and we are working on a fix.
We've identified an issue affecting Generative Answering. Our team will post regular updates until solved.
Report: "[All Regions] Delayed Security Provider Refreshes"
Last updateThe upgrade is complete and security provider refreshes are now being processed normally.
Due to an ongoing database upgrade, security provider refresh operations are temporarily disabled. Your existing security identities and ongoing refresh operations were not affected, but new refreshes will be queued for processing and picked up after the upgrade is complete. We expect these operations to be paused for approximately 60 minutes. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All Regions] Delayed source refresh, rescan and rebuild on new operations"
Last updateThe database upgrade is complete and source operations have resumed normally.
Due to an ongoing database upgrade, source refresh, rescan and rebuild operations are temporarily disabled. Your existing content and ongoing operations are not affected, but new ones will be queued for processing. We expect these operations to be paused for approximately 30 minutes. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All Regions] Short Lived Authentication Service Issues"
Last updateBetween 15:53 and 15:58 today (EDT), we recorded elevated error rates impacting the Authentication Service. The service has recovered gracefully and has been operating normally since then. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All Regions] Issues with listed Machine Learning Models"
Last updateAll affected models have been rebuilt. This incident has been resolved.
Affected models are done rebuilding in the Australian and Canadian hosting regions. Some models in the US and European hosting regions are still undergoing rebuilds.
We have identified the root cause and begun rebuilding the subset of affected models. We will give another update once all the impacted models are rebuilt.
We've identified an issue affecting some of the Semantic Search Machine Learning models in all the regions. Our team will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://connect.coveo.com/s/">Help Portal</a>
Report: "Usage Analytics event ingestion issues"
Last updateThis incident has been resolved.
The issue has been resolved by our infrastructure provider. We will continue to monitor the situation to ensure everything is working as intended.
We are following the issue closely with our infrastructure provider.
We've identified a latency issue affecting Usage Analytics event ingestion due to an issue with our infrastructure provider. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All Regions] Generative Answering Issues"
Last updateAll production model rebuilds have now been completed. The incident has been resolved.
The fix has been deployed and validated. We have now begun rebuilding the impacted models but expect this process to take several hours. Live production models are being prioritized for immediate rebuilds while non-production ones will be left to be rebuilt as per their respective schedules in the coming week.
The issue has been identified and a fix is being rolled out.
We are continuing to investigate this issue.
We are investigating an issue impacting the Generative Answering API that is currently affecting a subset of models that were recently updated to the latest GPT-3.5 version, causing some minor variance in the answers returned to some queries. Our team is actively working on this issue and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All regions] Commerce Advanced dashboard data visibility"
Last updateThis incident has been resolved.
Commerce advanced dashboards are showing limited historical data due to a data processing issue. We have identified the issue and are in the process of resolving it.
Report: "Analytics Write API - Europe West Region (Ireland)"
Last updateIn relation to an incident at AWS, Coveo analytics event ingestion services were degraded between approximately 2024-04-24 19:30 UTC and 2024-05-01 02:30 UTC. Analytics reporting and related metrics are affected for this period.
Report: "[EU] ML Query Issues"
Last updateThis incident has been resolved. The service has been fully operational since the last update.
A fix has been implemented and we are monitoring the results.
The root cause has been identified and a mitigation strategy is being implemented.
We're investigating an issue affecting Machine Learning Queries in the EU Region. Users may currently experience elevated error rates for these types of queries. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[US] Catalog Source Refresh Delays"
Last updateThis incident has been resolved. The service has remained fully operational since the last update.
A fix has been implemented and we are monitoring the results. Content updates for Catalog Sources in the US region are now back to near real-time.
We've identified an issue causing refesh delays for Catalog Sources in the US region. Your content for this type of source might not be up to date. Our team is working on it and will post updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "Login with Google Issues"
Last updateBetween 10:30 and 12:00 (EDT) we observed a degradation of the Login with Google functionality. During this time, some users may have been unable to login via this third party, or may have experienced more slowness than normal. The service has now resumed normally and no further issues have been reported since then.
Report: "[All Regions] Content Browser Issues"
Last updateThis incident has been resolved and no further issues have been reported since this incident was first reported.
A fix has been implemented and we are monitoring the results.
We've identified an issue affecting the Content Browser. Users may experience errors when attempting to use it. This only affects the Content Browser in the Coveo Administration UI, and functionality of the Search API is not impacted. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "Login with Google Issues"
Last updateThis incident has been resolved.
Some users seem to have issues with Google login. We are currently investigating.
Report: "[EU] Coveo ML - Models Generator Issues"
Last updateThis incident has been resolved. All models have been rebuilt and the backlog is processed. Thank you for your patience.
Our workaround is functional, and models continue to be rebuilt. We are monitoring the service as it finishes to process the backlog of rebuilds that had accumulated and expect this to finish within the next few hours.
A work around has been implemented, resuming model creation and update in europe. Teams are closely monitoring the status of the models.
We’ve made progress on the this issue and have significantly reduced its scope. It now affects all model creation and update for all europe customers, but existing models are still available and responding to queries. For assistance or inquiries, please reach out to our customer support team through our <a href=“https://connect.coveo.com/s/”>Help Portal</a>. We appreciate your patience and will keep you informed with any further updates.
We've made progress on the this issue and have significantly reduced its scope. It now only affects a subset of customers. For assistance or inquiries, please reach out to our customer support team through our <a href="https://connect.coveo.com/s/">Help Portal</a>. We appreciate your patience and will keep you informed with any further updates.
We've identified an issue affecting the ML Model Generator in the EU region. New model creation and automated model refreshes will experience delays. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://connect.coveo.com/s/">Help Portal</a>
Report: "[All Regions] SearchAPI issues"
Last updateThe service is still fully operational since the last update. Please report any issues through our <a href="https://connect.coveo.com/s/">Help Portal</a>.
We've identified an issue affecting the SearchAPI service, preventing Search Tokens creation in some specific scenarios. Queries aren't impacted. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://connect.coveo.com/s/">Help Portal</a>
Report: "[Canada] Analytics Processing Delays"
Last updateThis incident has been resolved. The service has been fully operational since the last update.
A fix has been implemented by our infrastructure provider and Analytics data processing has resumed normally. The backlog was fully processed and Analytics data in the Canada region is now up-to-date. We are continuing to monitor the service closely.
We have identified an issue with our infrastructure provider that is causing Analytics processing delays in the Canada region. Analytics data and reports may not be up to date in this region, but no data has been lost. Other regions of our cloud are unaffected. We are in contact with them about this issue and will provide updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All Regions] Login with Salesforce Issues"
Last updateThis incident has been resolved. Please report any issues through our <a href="https://connect.coveo.com/s/">Help Portal</a>.
We're investigating an issue affecting "Login with Salesforce", preventing administrators from login to our Administration Console with their Salesforce user. Our team will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://connect.coveo.com/s/">Help Portal</a>
Report: "[EU] Analytics Read Issues"
Last updateThis incident has been resolved. The service has been fully operational since the last update.
A fix has been implemented and we are monitoring the results.
Our team has identified the issue and is working towards resolution.
We are investigating an issue affecting the availability of the Analytics Read API in the EU region. Analytics Reports are currently unavailable.
Report: "Cloud provider outage for app.qubit.com"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We've identified an issue affecting Qubit application. Our team is investigating and will post regular updates until solved. This does not appear to affect out APIs at the moment, only the ability for users to interact with the app. If you need help or to get in touch with us, please visit our <a href="https://connect.coveo.com/s/">Help Portal</a>
We are currently investigating this issue.
Report: "Qubit Platform is experiencing significant issues"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Our cloud provider is still investigating the issue, which is now affecting a growing number of systems.
Our cloud provider is currently investigating the issue. The data pipeline and ingestion is unaffected, however there may be some issues/slowdowns using the application.
Intermittent issues are still being investigated.
A fix has been implemented and we are monitoring the results.
We are continuing to investigate this issue.
This is impacting the building of Coveo Commerce experiences and placements, as well as our stats reporting.
Report: "[All Regions] Short lived Admin Console issue"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
There was a short lived issue where an HTTPS error prevented accessing the Administration Console from 1:03 PM to 1:17 PM EDT. APIs weren't impacted. Our infrastructure provide has provided a fix and we are monitoring the services. If you need help or to get in touch with us, please visit our <a href="https://connect.coveo.com/s/">Help Portal</a>
Report: "Login issue with Advanced Reports"
Last updateThe system has processed all customer accounts and the access issue has been resolved.
A fix has been deployed into production systems. The system is processing all customer accounts to re-enable access, and should finish shortly. We continue to monitor the situation.
A fix for the issue has been created and we are now starting the process of testing and deploying it.
We are continuing to work on a fix for this issue.
The issue has been identified and a fix is being implemented.
We've identified an issue affecting the Commerce and Data Health reports in the Advanced Reports section of the Administration Console. Attempting to access these reports results in a message requesting additional login information, preventing the user from accessing the report. The fix is being identified and worked on. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[US] Slack and ServiceNow Source configuration issues"
Last updateThis incident has been resolved and the service has been fully operational since the last update.
A fix has been implemented and we are monitoring the results.
We've identified an issue affecting source configurations for Slack and ServiceNow in the US region. Attempting to configure these source types will not work at this time. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "Realtime data failing to load in the Coveo Merchandising Hub UI"
Last updateThe incident is resolved, all realtime stats are now loading correctly in the Merchandising Hub. No data was lost during the incident, and Campaign execution was completely unaffected.
We are investigating an issue that is causing realtime data about placements and campaigns to fail to load in the Coveo Merchandising Hub user interface. The actual execution of placements on-site is unaffected.
Report: "[US] Analytics Data Processing and Document Processing Issues"
Last updateThis incident has been resolved.
All services have recovered, and the backlogs have been processed. Please report any issues through our <a href="https://connect.coveo.com/s/">Help Portal</a>.
We are starting to see recovery across affected services, and continue to monitor the situation closely. However, some services have built up a backlog of events that will take some time to process.
We've identified that logging in by email, or by following links in invitation emails to organizations is also impacted.
We've identified that the issue is also impacting crawling operations, so your documents may not be up to date. The Log Browser is currently inaccessible as well. Personalization features might be affected by the outage in US, and in organizations with satellite regions.
We are currently experiencing a data processing issue within the US region that is preventing events collected since 02:50 EST today from being processed accordingly. This impacts mostly reporting and analytics features. We are also seeing elevated error rates on the Push API, preventing documents and identities from being sent to Coveo properly. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[US] Analytics Data Processing Issue"
Last updateThis incident has been resolved.
A fix has been deployed and we are monitoring the results. The service is currently processing a backlog of events. We will update again once all events have been processed.
There has been a delay in applying our fix as we have noticed that other Analytics components (reports, etc) were also affected by this issue. No Analytics events were lost, they are simply delayed. Our team continues to work on a resolution. Thank you for your patience.
The fix is currently being deployed and we expect the issue to be resolved in the next two hours. Thank you for your patience.
We are currently experiencing a data processing issue within the US region that is preventing events collected since 01:00 UTC today (25th May) from appearing with the Event Browser. This will impact data validation efforts using the Event Browser, as events arriving today will not yet be displayed. Our team is working on a fix and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All Regions] Minor Administration Console Issue"
Last updateThis incident has been resolved.
We've identified a minor issue affecting the Analytics report section of the Administration Console. Attempting to access a report will generate an incorrect URL with an extra forward slash after your organization ID. Removing it manually in your address bar and reloading the page will allow you to access the report normally. The fix is being worked on and will be deployed shortly. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "Analytics Data Processing Delays"
Last updateWe've identified and resolved issue which caused a processing delay in Analytics Data between 6:00 PM (April 26th, EDT) and 3:00 AM (April 27th, EDT). No data has been lost, but customers attempting to view their data during this time may have noticed the delay. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "Machine Learning Model building issue"
Last updateThe backlog has been fully processed and this is incident is resolved. Thank you for your patience.
All affected models have been rebuilt. However, model building delays persist in the US region. We will continue to monitor the service until the backlog has been fully processed. All other regions are back to normal.
A fix has been implemented and the affected models are starting to be rebuilt. We will continue to monitor the service until this process is completed, but we expect several hours of delay for all rebuilds currently queued to be processed.
The cause of the issue has been identified and a fix is being implemented. Thank you for your patience. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
We've identified an issue affecting Machine Learning model building. Model building is currently disabled and a subset of models that were rebuilt since April 11, 17h EDT might return results based on data outside of the specified range. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All Regions] Service Provider (SP) initiated SSO issue"
Last updateWe've identified and fixed an issue preventing a subset of customers from logging in to the Coveo Cloud through Service Provider (SP) initiated SSO between 16:40 and 21:00 (EST).
Report: "[US] Intermittent DNS resolution issues"
Last updateWe've identified and resolved an issue involving DNS resolution impacting a subset of customers between 16:44 and 16:51 (EST).
Report: "[US] Elevated API Error Rates - Source, Push API, Activity and Security Cache services"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We've identified an issue causing elevated API error rates impacting the Source, Push API, Activity and Security Cache services that may cause problems when trying to access the Coveo Administration Console. Our team is working on resolving these issues and will post updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help
Report: "Crawling module issues"
Last updateWe've identified an issue preventing some source operations on Crawling Module version 1.72.12. Customers are advised to update to version 1.73.3. You can follow this documentation to do the update: <a href="https://docs.coveo.com/en/3266/index-content/crawling-module-rest-api-reference#updating-maestro">Update Maestro Documentation</a> If you need help or to get in touch with us, please visit our <a href="https://connect.coveo.com/s/">Help Portal</a>
Report: "[US] Analytics Read API issues"
Last updateThe services are still fully operational since the last update. Please report any issues through our <a href="https://connect.coveo.com/s/">Help Portal</a>.
Thanks for your continued patience. The issues have been fixed, and we are actively monitoring the services.
We're starting to see recovery of the Analytics Read API.
Catalog sources indexing is also impacted. No items are lost but there are delays, and your content might not be up to date.
We've identified an issue affecting Analytics Read API, preventing Analytics reports and exports to return data. Analytics events ingestion isn't impacted. If you need help or to get in touch with us, please visit our <a href="https://connect.coveo.com/s/">Help Portal</a>
Report: "[Europe and Australia] Elevated Search API error rates"
Last updateThe services are still fully operational since the last update. Please report any issues through our <a href="https://connect.coveo.com/s/">Help Portal</a>.
The issue has been mitigated, and we're monitoring the services.
We've identified an issue causing elevated error rates on the Search Service in the Europe and Australia regions. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[US] Elevated Search API error rates"
Last updateThis incident has been resolved. The service has been fully operational since the last update.
A fix has been implemented and we are monitoring the results.
We've identified an issue causing elevated error rates on the Search Service in the US region. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[US] Analytics Write Service Issues"
Last updateThis incident has been resolved and the service has been fully operational since the last update.
The Analytics Write service has resumed normal operation and processing of the event backlog is complete. We are continuing to monitor the situation closely.
Our team is continuing to work on fixing this issue and we are seeing signs of recovery, but some events might still be delayed at this time.
We've identified an issue affecting the Analytics Write service in the US region. Analytics events are being successfully accepted but are queued for processing as the service experiences some delays. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://support.coveo.com/">Help Portal</a>
Report: "[All Regions] Salesforce sources refreshes issues"
Last updateThe service is still fully operational since the last update. Please report any issues through our <a href="https://connect.coveo.com/s/">Help Portal</a>.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We’re investigating an issue affecting Salesforce sources refreshes where some operations fail with an “UNKNOWN_FATAL_EXCEPTION” error. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our <a href="https://connect.coveo.com/s/">Help Portal</a>