Historical record of incidents for CleverTap System
Report: "Outage on EU region"
Last updateThe incident has been resolved and all the systems are back to normal.
We have implemented a fix and all the systems are back to normal now. We are monitoring the systems currently.
The issue is still being investigated and we optimising systems. Campaign Delivery and Data exports are still impacted. Please expect the next update in 45 minutes.
We have identified the issue and are working on the fix. Login issue has been resolved. At the moment, impacted components are campaign delivery and Data exports.
We are investigating reports of Dashboard Login issues and query failures impacting our accounts within the EU region. Data ingestion from both API and SDK is processing with delays for these accounts. Please expect an update within 30 - 45 minutes.
Report: "Partial Outage on SG region"
Last updateThe partial outage for some clients in the SG region has been resolved and the system is back to normalcy.
Root cause has been identified and the fix has been deployed. Systems are back to normal and we are currently monitoring closely.
We are investigating reports of Dashboard query failures impacting some accounts within the SG region. Data ingestion from both API and SDK is processing with delays for these accounts. Please expect an update within 30 minutes.
Report: "Partial outage on EU region"
Last updateThe partial outage for some clients in the EU region has been resolved and the system is back to normal operation.
We have identified the cause and are working on bringing the system back to normal level of operation for the affected accounts. ETA: 15 minutes.
We are investigating reports of Dashboard query failures impacting some accounts within the EU region. Data ingestion from both API and SDK is processing with delays for these accounts. Please expect an update within 30 minutes. We apologize for the inconvenience and will update this status page as soon as we have determined the root cause.
Report: "Some of our users are not able to login on EU1 due to underlying Cloudflare issue"
Last updateWe have bypassed Cloudflare for now and dashboard logins are working fine. Systems are back to normalcy. We are keeping a watch on Cloudflare status before moving back the traffic via Cloudflare.
Cloudflare is facing issues with its European endpoints. Some of our customers were not able to login to the dashboard. Campaigns/exports/ingestion is working as normal. We have bypassed Cloudflare and directly routed the traffic to our endpoints. The dashboard is working now. We will update this incident shortly.
Report: "We are upgrading one of the cluster on EU1 region. Affected users on that cluster will not be able to login for next 10-20 minutes."
Last updateThis incident is resolved and all systems are back to normal.
The cluster has been upgraded and systems are back to normal. Users can login and perform the dashboard actions normally. We are observing this for the next few minutes before closing the incident.
We are upgrading the affected cluster in the EU1 region. Please allow us 10-20 minutes to upgrade. Affected users will not be able to use dashboard during this period.
Report: "We experienced a temporary glitch on one of our EU1 cluster. Some users on that cluster could not login for 20 minutes."
Last updateOne of our clusters in EU1 was unresponsive for 20 minutes. Users on that cluster could not login to the platform for 20 minutes between IST 10:30 AM to 10.50 AM (GMT 5:00 AM to GMT 5:20 AM)
Report: "Some of our IN instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaign pickup"
Last updateThis incident has been resolved and all the services are back to normal and the delay is cleared for the affected hosts completely.
The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring the situation and will update here when all delay is cleared.
We are experiencing degraded performance on some of our IN (instances). Data ingestion will be delayed and some of the campaigns will be running slow/delayed. Dashboard queries will be slow/not working for a few customers. We are currently investigating the incident and will update here in the next 30 minutes.
Report: "Some of our IN instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaign pickup"
Last updateThis incident has been resolved and all the services are back to normal and the delay is cleared for the affected hosts completely.
The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring the situation and will update here when all delay is cleared.
We are upgrading the issue to impact: Major as this is affecting the dashboard logins, trigger campaigns and delayed ingestion.
We are experiencing degraded performance on some of our IN (instances). Data ingestion will be delayed and some of the campaigns will be running slow/delayed. Dashboard queries will be slow. We are currently investigating the incident and will update here in the next 30 minutes.
Report: "Unplanned maintenance triggered on one of the data store for one IN Cluster"
Last updateThis incident has been resolved and all our systems are stable and normal. We are closing the incident.
The affected node is back to normal. All our systems are back to normal. We are currently monitoring the services. We will close the incident in a few minutes.
We are continuing to work with the infrastructure team to fix the issue. We are expecting a slight delay in getting this node back online. We will keep updating the status regularly here.
We are currently facing a hardware issue with one the the underlying nodes of one of our IN clusters. The customers on this cluster are facing delayed ingestion, slow/delayed campaign deliveries, and delays in import/exports/reports. We have identified the issue and working with the infrastructure team to bring the node back. We are expecting approximately 2 hours for the systems to get back to normal. We will keep updating the status here.
Report: "Unplanned maintenance triggered on one of the data store in EU region"
Last updateThis incident has been resolved and all our systems are working as expected.
The affected system is back to normalcy. We are currently monitoring this for some time before closing the incident.
The data store is back up now and we are verifying the instance(s) before moving into monitoring status.
We needed unplanned maintenance on one of the data stores. This has resulted in a partial outage for a few of our customers. The campaign deliveries/data exports are partially unavailable for these customers. Currently, we have identified the issue and fixing it. We are bringing up the data store and backup systems and monitoring the performance. The expected time is 1 hour to resolve.
Report: "We are experiencing downtime on our Europe SDK endpoint"
Last updateThis incident has been resolved and SDK ingestion has resumed to normal.
We have deployed the changes which resolved the issue with our Europe SDK endpoint. The ingestion is back to normal and we are currently monitoring the system. We will observe this for some time before closing the incident.
We are currently investigating an issue that is causing outage on our Europe SDK Endpoint. Please note that our SDK has a built-in retry mechanism and the traffic will come back to normal when the issue is resolved. We will provide further updates in 30 minutes.
Report: "Some of the accounts/users are not able to login to EU1 dashboard"
Last updateAll user information and account information is synced. All users can login and conduct their operations normally. This incident is resolved and all components are working as expected.
Update: We have completed the data sync for 90% of the accounts and users. We will be completing the remaining set of users in the next 30 minutes. We will post the update here.
We are currently facing a user information sync issue. A few accounts/users are not able to login to our EU1 dashboard. We are currently fixing the sync issue. The users will be able to login as soon as their information is synced up. We will update here with the progress. As an alternative measure, users/accounts who are facing issues can access the following page to perform their activities: https://eu1.dashboard.clevertap.com/old-login.html All other components of the platform are working fine: 1) Ingestion (SDK/API) is working fine 2) Scheduled campaigns/live campaigns are running fine 3) Import/Export functionality is working fine
Report: "We are experiencing slowness on EU1 dashboard"
Last updateThis incident is marked as resolved and all systems are back to normal.
We have identified the issue and fixed it. The systems are back to their normal status. We are currently monitoring the platform and would update here in some time.
We are upgrading the issue to critical as the following things are affected: 1) Ingestion of data is delayed (SDK/API/sFTP import) 2) Dashboard operations are affected/degraded 3) Campaign delivery is affected We are currently working on bringing the services up. The estimated time is approximately 120 minutes or lesser. We will update the status in the next 30 minutes. We apologize for the inconvenience caused.
We are currently investigating an issue that is causing slowness on the EU1 dashboard. We are investigating this issue and would update the status soon.
Report: "We are experiencing downtime on our Europe SDK endpoint"
Last updateThis incident has been resolved and SDK ingestion has resumed to normal.
We have deployed the changes which resolved the issue with our Europe sdk endpoint. The ingestion is coming back to normal and we are currently monitoring the system. We will observe this for some time before closing the incident.
We are currently investigating an issue that is causing outage on our Europe SDK Endpoint. Please note that our SDK has a built-in retry mechanism and the traffic will come back to normal when the issue is resolved. We will provide further updates in 30 minutes.
Report: "We are experiencing downtime on our API endpoints for Europe region"
Last updateThis incident has been resolved. Our Europe API endpoint is back to normal.
A fix has been implemented and all our Europe API endpoints are up and running. We are monitoring the situation.
We are continuing to work on this issue. We have identified some of the possible causes and working on addressing those. We will update this space in the next 30 minutes with further updates.
We are currently investigating an issue that is causing degraded performance/outage on our Europe API Endpoints. Our customers will see an increased rate of errors during this period. Please allow us some time to diagnose and fix the issue. We appreciate your patience and we will continue to update the status here.
Report: "We are experiencing downtime on our SDK and API endpoints for regions (Europe and India)"
Last updateThis incident has been resolved and all endpoints are back to normal. Data ingestion has resumed to normal.
Our India API endpoints are back to normal and we are monitoring the system for some time. Status update: All our endpoints (SDK as well as API) are up for India and Europe. We will observe this for some time before closing the incident.
We are continuing to work on a fix for this issue.
India SDK endpoints are back to normal and the data is getting processed. We are currently working on India API endpoints and the service is partially back to normal and currently exhibiting degraded performance. We are working on this and will update the status here soon
We are taking more time to identify the exact issue with India endpoints that is causing the downtime. Thank you for your patience and we will continue to update the progress here.
Europe endpoints are back to normal and the data is getting processed. We are currently working on India Endpoints and will update the status here soon.
The issue has been identified and a fix is being implemented. We will update the progress in the next few minutes.
We are currently investigating an issue that is causing degraded performance/partial outage on our Europe and India SDK and API Endpoints. Please note that our SDK has a built-in retry mechanism and the traffic will come back to normal when the issue is resolved. This will also affect the action-based (trigger) campaigns/journeys. We appreciate your patience and we will continue to update the status here.
Report: "We are experiencing downtime on our Europe SDK endpoint"
Last updateThis incident has been resolved and SDK ingestion has resumed to normal.
We have deployed the changes and currently monitoring the system. We will observe this for some time before closing the incident.
The issue has been identified and a fix is being implemented. We will update the progress in the next few minutes.
We are continuing to work with the Amazon AWS team to get the system back to normal. Currently, this issue has affected the ingestion in the Europe region for SDK traffic. This will also affect the action-based (trigger) campaigns/journeys. We appreciate your patience and we will continue to update the status here.
We are currently investigating an issue that is causing degraded performance/partial outage on our Europe SDK Endpoint. Please note that our SDK has a built-in retry mechanism and the traffic will come back to normal when the issue is resolved. We will provide further updates in 30 minutes.
Report: "We are experiencing downtime on our India SDK endpoint"
Last updateThis incident has been resolved and SDK ingestion has resumed to normal.
We have deployed the changes and currently monitoring the system. We will observe this for some time before closing the incident.
The issue has been identified and a fix is being implemented. We will update the progress in the next few minutes.
We are taking more time to identify the exact issue which is causing the downtime. Thank you for your patience and we will continue to update the progress here.
We are continuing to investigate this issue further. So far we have eliminated a few reasons. However, we are taking more time to identify the exact issue which is causing the downtime. We appreciate your patience and we will continue to update the progress here.
We are continuing to investigate this issue further. We are ruling out a few possibilities with the help of Amazon AWS. We will update here as soon as possible.
We are upgrading the severity of the incident to "Major Outage" for SDK ingestion in the India region. We are continuing to work with Amazon AWS team to get the system back to normal. Currently, this issue has affected the ingestion in the India region for SDK traffic. This will also affect the action-based (trigger) campaigns/journeys. We appreciate your patience and we will continue to update the status here.
We are continuing to investigate this issue and working with the Amazon AWS team to bring the services back to normal. We appreciate your patience and we will update the status here in some time.
We are currently investigating an issue that is causing degraded performance/partial outage on our India SDK Endpoint. Please note that our SDK has a built-in retry mechanism and the traffic will come back to normal when the issue is resolved. We will provide further updates in 30 minutes.
Report: "Unplanned maintenance triggered on one of the data store for US Cluster"
Last updateThis incident has been resolved and all our systems are working as expected.
All our systems are back to normalcy. We are currently monitoring this for some time before closing the incident.
One of the datastore in the US cluster has reported a slightly degraded performance and we have taken a downtime for this cluster. During this period - Dashboard reports, campaign delivery, data ingestion, and data exports will be delayed. We will update the progress periodically.
Report: "Some of our IN instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaign pickup"
Last updateThis incident has been resolved and all the services are back to normal and the delay is cleared for the affected hosts completely.
The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update here when all delay is cleared.
We are experiencing degraded performance on some of our IN (instances). Data ingestion will be delayed and some of the campaigns will be running slow/delayed. Dashboard queries will be running slow. We are currently investigating the incident and will update here in next 30 minutes.
Report: "Some of our EU instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaigns."
Last updateAll the services are back to normal and the delay is cleared for the affected hosts completely.
The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update here when all delay is cleared.
Further update: Some of the hosts are taking more time to boot than anticipated. We will update this space in another 30-45 minutes.
We have made progress and worked on the issue which was causing the degraded performance for this cluster. We are expecting another 45-60 minutes to get all systems back to normal.
We have encountered a few unforeseen situations and actively working on getting this issue fixed. Expecting more time to complete this activity. We will update the status in another 45 minutes.
We are continuously working on this issue to get it resolved. We are expecting another 30-40 minutes to get all systems back to normal.
We are experiencing degraded performance on some of our EU (instances). Data ingestion will be delayed and some of the campaigns will be running slow/delayed. We are currently working on this and will provide an update regularly.
Report: "Network connectivity to AWS EU region from India region affected. Dashboard is exhibiting slow performance on some of the networks."
Last updateThis incident is marked as resolved. EU dashboard is back to normal.
The EU dashboard is back to normal. We are currently monitoring this.
Some of our customers are facing slow connectivity/performance on our EU dashboard. We verified from other regions that the dashboard and all other services are running fine. We are verifying the network connectivity issues between the Indian network providers and the AWS EU region. Users from the affected networks will experience slow performance/connectivity to our dashboard.
Report: "Some of our IN instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaign pickup"
Last updateThis incident has been resolved and all the services are back to normal and the delay is cleared for the affected hosts completely.
The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update when all delay is cleared.
We are experiencing degraded performance on some of our IN (instances). Data ingestion will be delayed and some of the campaigns will be running slow/delayed. We are currently working on this and expecting it to come back to normal within 1 hour from now.
Report: "Unplanned maintenance triggered on a few of the data store(s) in SG region"
Last updateThis incident has been resolved.
This maintenance window is complete now and all the services are back online. We are doing the sanity check for the next few minutes before marking the incident as resolved.
We have encountered unplanned maintenance on a few of the data store(s) in the SG region. We have rebooted the affected nodes and some of the customers will be facing the following issues: 1) Delayed ingestion of events 2) Delayed/stopped delivery of campaigns 3) Dashboard not working for the affected customers The expected time to complete the maintenance is 90-120 minutes. We will keep this space updated.
Report: "Our dashboard is showing degraded performance"
Last updateThis incident has been resolved and all our dashboards are back to normal.
We have taken the necessary steps to address the degraded performance of the dashboard. The dashboard is working fine along with the other components of the system. We are observing this for some more time before marking the ticket as resolved.
We are currently experiencing degraded performance for our Dashboard system. Customers may observe slowness/degraded performance while conducting operations on the dashboard. We are currently investigating the issue and working towards resolving this.
Report: "Some of our IN instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaigns."
Last updateAll the services are back to normal and the delay is cleared for the affected hosts completely.
The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update when all delay is cleared.
We are taking further steps and cleaning the system. The expected degraded performance is 40 minutes.
The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update when all delay is cleared.
We are experiencing degraded performance on some of our IN (instances). Data ingestion will be delayed and some of the campaigns will be running slow/delayed. We are currently working on this and expecting it to come back to normal in 1 hour from now.
Report: "Some of our EU instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaigns."
Last updateAll the services are back to normal and the delay is cleared for the affected hosts completely.
The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update when all delay is cleared.
We are experiencing degraded performance on some of our EU (instances). Data ingestion will be delayed and some of the campaigns will be running slow/delayed. We are currently working on this and will provide an update regularly.
Report: "Unplanned maintenance triggered on one of the data store"
Last updateThis incident has been resolved and all our systems are working as expected.
All our systems are back to normalcy. We are currently monitoring this for some time before closing the incident.
We are currently experiencing a partial outage due to unplanned maintenance. A few customers will not be able to use the dashboard system currently. We are working on it. The estimated ETA is 1 hour.
Report: "Some of our EU instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaigns."
Last updateAll the services are back to normal and the delay is cleared for the affected hosts completely.
The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update when all delay is cleared.
We are experiencing degraded performance on some of our EU (instances). Data ingestion will be delayed and some of the campaigns will be running slow/delayed. We are currently working on this and will provide an update regularly.
Report: "Some of our EU instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaigns."
Last updateAll the services are back to normal and the delay is cleared for the affected hosts completely.
The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update when all delay is cleared.
We are experiencing degraded performance on some of our EU (instances). Data ingestion will be delayed and some of the campaigns will be running slow/delayed. We are currently working on this and will provide an update regularly.
Report: "Some of our EU instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaigns."
Last updateAll the services are back to normal and the delay is cleared for the affected hosts completely.
The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update when all delay is cleared.
We are experiencing degraded performance on some of our EU (instances). Data ingestion will be delayed and some of the campaigns will be running slow/delayed. We are currently working on this and will provide an update regularly.
Report: "Planned maintenance on few of the systems in the US cluster"
Last updateMaintenance on these nodes is complete now and all services are back to normal.
We are currently performing maintenance on a few of the nodes in our US cluster. Normal services will continue to function. However, some of the customers may face a slight delay in the ingestion and query performance on the dashboard.
Report: "Unplanned maintenance triggered on one of the data store"
Last updateThis incident has been resolved and all our systems are working as expected.
All our systems are back to normalcy. We are currently monitoring this for some time before closing the incident.
We are currently experiencing an outage. A few customers will not be able to use the dashboard system currently. We are working on it. The estimated ETA is 1 hour.
Report: "Data Ingestion for some customers might be affected (delayed)."
Last updateSystems are back online in full capacity
We are continuing to investigate this issue.
Some customers might be experiencing a delay in the ingestion of data. We are working on it. It should be fixed in a couple of hours.
Report: "Delay in event processing"
Last updateThis incident has been resolved.
Systems are back online in full capacity and affected accounts are processing the backlog and incoming events. We are observing this for any further issues.
We have identified the issue and the fix is implemented. We are expecting the systems to be back online to full capacity in about ~45 minutes. This will normalise the ingestion process for the affected accounts.
We are continuing to investigate this issue.
We are investigating an issue that causes processing delay of incoming events. This issues affects some accounts
Report: "Data Ingestion for some customers might be affected (delayed)."
Last updateThis incident is resolved now and all our systems are back to normal. Ingestion for all customers (who were affected) is back to normal and we do not observe any delay.
We are observing that the data ingestion for the affected accounts is coming back to normal. We are currently observing this process and will mark the ticket as resolved soon.
We are experiencing degraded performance for our ingestion services in the India region. Some customers might be experiencing a delay in the ingestion of data. We have identified this issue and working on it.
Report: "Our dashboard nodes in SG region are experiencing a downtime. Customers in are getting 5xx errors while accessing dashboard."
Last updateAWS team has resolved the underlying infra issue and the nodes are back up online. Customers can access the dashboard and the issue is marked as resolved.
Our SG region dashboard nodes are experiencing downtime due to an underlying AWS issue. We are working with the AWS team to bring the nodes back online. Our customers are facing 5xx errors while accessing the dashboard. Scheduled campaigns + data ingestion is not affected.
Report: "One of our database node is facing an issue. Few of our customers may observe flatline on the dashboard."
Last updateThis incident has been marked as resolved as all data is completely processed and all systems are back to normalcy.
The systems are back to normal and all the data is being processed. We are monitoring this for some time before marking it as resolved.
We observed that one of our dashboard nodes was facing an underlying hardware issue. We have isolated the node and resolved the hardware issue. The instance is recycled and would take approximately 40-50 minutes to come back online. During this time, some of the customers may observe flatline (paused ingestion) on the dashboard reports. During this period the ingested data (for few customers) is held in the cache and will be processed when the underlying node comes back to normal.
Report: "Some of our dashboard nodes are facing a issue. Some customers might face delay/5xx errors"
Last updateThis incident has been resolved and all dashboards are working normally.
We have recycled the affected nodes and dashboard system is back to normal. We are monitoring it for the next few minutes before marking this event as resolved.
We have faced an issue with a couple of dashboard nodes. Some of our customers are facing delay in operations or 5xx errors.
Report: "Intermittent failures of Dashboard access"
Last updateWe have observed the performance for last 30+ minutes and systems are back to normal. This incident has been marked as resolved.
We identified and fixed the issues with dashboard components and it's interactions with underlying systems/databases. This has eased the pressure on the dashboard and the dashboard is stable now. We are currently monitoring the performance of our dashboard and will update if any discrepancy is observed.
Some of our customers from APAC/EU region are facing intermittent issues with dashboard connections. We acknowledge the issue and continuing to investigate dashboard issues. We have upgraded the incident on our side to reflect an outage. This is an AHOD (all hands on deck) situation for us and we are working towards finding and deploying the long term fix. During this period some customers will continue to face access issues/50x errors on the dashboard. We appreciate your patience.
Some of our customers are facing login issues on the dashboard system. We are facing a few issues with some of the dashboard nodes and some of the database calls. We are investigating the issue and working on it to get a long term closure. We will keep updating this page for further updates. Thank you for your patience.
Report: "Dashboard Reports Outage"
Last updateWe recycled the affected hosts and the issue is resolved. We are fixing this for long term solution. We will continue to monitor and report if any issues still persist.
We're experiencing degraded performance in our dashboard. Some of our customers might be facing connection issues. Our engineers and infra team are working to fix this issue as quickly as possible. We truly appreciate your patience and apologize for the inconvenience.
Report: "Degraded performance of dashboard"
Last updateThis issue is marked as resolved and all systems are back to normal.
We have recycled the hosts with degraded performance and the systems are back to normal. We are observing this for some time before marking as resolved.
We are facing degraded performance of our dashboard systems in the EU region. Few customers might face delay/5xx errors while accessing the dashboard.
Report: "Some of our nodes are facing issues. Some customers might face delay/5xx errors in dashboard. API endpoint is also facing issues."
Last updateThis incident has been resolved and we have monitored it for a while. Sincere apologies for the disruption in the service.
We really appreciate your patience and very sorry for the disruption. All the services are back up online and we are currently monitoring them. The accounts and services are catching up on our platform. Few campaigns + reports might take some time to commence. We are currently monitoring the situation and will update if anything is missing.
Update: We are bringing the components back online in a staggered manner. We are observing the entire process and anomalies if any. We are expecting the service to come back to normal in the next couple of hours. We will keep updating the progress here.
Update: We deployed the hotfix on all the instances and recycled the instances. However, the fix has not worked as expected. We are working further on this issue and treating this as an AHOD (all hands on deck). We will continue to update the progress here.
Update: We are still working on the deployment across clusters and recycling the nodes. We will continue to share the updates here.
Update: We are deploying a quick fix to the affected nodes and relevant modules. This will take some time as the new deployment has to be rolled out for the cluster. We will continue to share the updates here.
Update: There are no changes to the previous status as of yet. We are still all hands on deck and continuing to get the services back online. We will continue to share updates every 30 minutes until the issue is resolved.
Update: We are still working on fixing on the issues and experiencing the partial or major outage for some of the nodes. We will update this space with an update shortly.
The issue is identified and we are fixing it by recycling nodes and connections. Few users may still face issues while login.
We are continuing to investigate this issue.
We are currently facing a degraded performance on one of the dashboard nodes. Some customers might face delay/5xx errors while accessing the EU dashboard.
Report: "Some of our EU Dashboard instance(s) are showing degraded performance. Few customers might face delay/5xx errors."
Last updateThe nodes were recycled and all operations are back to normal.
Some nodes in our EU region are showing degraded performance. Few customers might face delay/5xx errors while accessing the dashboard. We have identified the nodes and recycling them.
Report: "Our dashboard nodes are taking time to process the requests"
Last updateThe services are back to normal.
We have recycled the hosts and the dashboard is stable. We are monitoring the performance and will update if any issues are observed.
We have identified the issue with the affected nodes and taking corrective actions to recycle these hosts.
Our dashboard nodes are facing issues and responding 50x error for some of the customers. We are currently investigating and will update with the progress.
Report: "One of our dashboard node is facing an issue. Some customers might face delay/5xx errors"
Last updateThe dashboard nodes are back up online and 5xx errors have been resolved now. We are monitoring for any further discrepancies.
The issue with the nodes is identified and we are recycling those hosts with new hosts.
We have faced an issue with a couple of dashboard nodes. Some of our customers are facing delay in operations or 5xx errors.
Report: "Our dashboard nodes are taking time to process the requests"
Last updateThe dashboard is back to normalcy and all operations resumed.
Some of our dashboard nodes are taking time to load/process the requests. We have identified the issue with one of the cache-store + memory and getting it resolved.
Report: "Unplanned maintenance triggered on one of the data store"
Last updateThis incident has been resolved. Services are back to normalcy. There was no data loss or any other service disruptions observed.
We needed unplanned maintenance on one of the data stores. This has resulted in a partial outage for a few of our customers. The campaign deliveries/data exports are partially unavailable for these customers. Currently, we have identified and the issue and fixed it. We are bringing up the data store and backup systems and monitoring the performance.
Report: "One of our dashboard node is facing an issue. Some customers might face delay/5xx errors."
Last updateThe dashboard login + delay and 5xx errors have been resolved now. However, we are monitoring the status for any further issues.
We have faced an issue with one dashboard node. Some of our customers are facing delay in operations or 5xx errors. The node is back up now and we are monitoring as of now.
Report: "One of our dashboard node is facing an issue. Some customers might face delay/5xx errors."
Last updateWe have faced an issue with one dashboard node. Some of our customers were facing delay in operations or 5xx errors. The node is back up now and we are monitoring as of now.