Historical record of incidents for Hygraph
Report: "Classic UI Content Load Failures"
Last updateWe’re seeing failures to load some pages in the Classic UI due to a global service outage affecting Cloudflare. We’re monitoring the situation and will update as more information becomes available
Report: "São Paulo Region Database Upgrade"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
📅 Date: May 26 - 2025 - Monday⏳ Time: 09:00 - 13:00 CET** Impact Overview **09:00 – 12:00 CET: Read-only mode (no writes, updates, or deletions).12:00 – 12:30 CET: Full downtime (only cached content accessible).12:30 – 13:00 CET: Read-only mode (no writes, updates, or deletions).* Content delivery will continue via our caching layer.* Enterprise customers on dedicated stacks are not impacted**What You Need to Know*** Reading existing content will mostly work as usual.* Cached content remains available.* New content, updates, and deletions will be blocked.* Full service resumes after maintenance.🚀 Action Required: Plan critical write operations outside this window.📢 We’ll provide live status updates during maintenance.Thank you for your patience as we enhance our infrastructure.
Report: "Oregon Region Database Upgrade"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
📅 Date: May 23 - 2025 - Friday⏳ Time: 09:00 - 13:00 CET** Impact Overview **09:00 – 12:00 CET: Read-only mode (no writes, updates, or deletions).12:00 – 12:30 CET: Full downtime (only cached content accessible).12:30 – 13:00 CET: Read-only mode (no writes, updates, or deletions).* Content delivery will continue via our caching layer.* Enterprise customers on dedicated stacks are not impacted**What You Need to Know*** Reading existing content will mostly work as usual.* Cached content remains available.* New content, updates, and deletions will be blocked.* Full service resumes after maintenance.🚀 Action Required: Plan critical write operations outside this window.📢 We’ll provide live status updates during maintenance.Thank you for your patience as we enhance our infrastructure.
Report: "Mumbai Region Database Upgrade"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
📅 Date: May 22 - 2025 - Thursday⏳ Time: 15:00 - 19:00 CET** Impact Overview **15:00 – 18:00 CET: Read-only mode (no writes, updates, or deletions).18:00 – 18:30 CET: Full downtime (only cached content accessible).18:30 – 19:00 CET: Read-only mode (no writes, updates, or deletions).* Content delivery will continue via our caching layer.* Enterprise customers on dedicated stacks are not impacted**What You Need to Know*** Reading existing content will mostly work as usual.* Cached content remains available.* New content, updates, and deletions will be blocked.* Full service resumes after maintenance.🚀 Action Required: Plan critical write operations outside this window.📢 We’ll provide live status updates during maintenance.Thank you for your patience as we enhance our infrastructure.
Report: "London Region Database Upgrade"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
We will be undergoing scheduled maintenance during this time.
We will be undergoing scheduled maintenance during this time.
📅 Date: May 21 - 2025 - Wednesday⏳ Time: 04:00 - 08:00 CET** Impact Overview **04:00 – 07:00 CET: Read-only mode (no writes, updates, or deletions).07:00 – 07:30 CET: Full downtime (only cached content accessible).07:30 – 08:00 CET: Read-only mode (no writes, updates, or deletions).* Content delivery will continue via our caching layer.* Enterprise customers on dedicated stacks are not impacted**What You Need to Know*** Reading existing content will mostly work as usual.* Cached content remains available.* New content, updates, and deletions will be blocked.* Full service resumes after maintenance.🚀 Action Required: Plan critical write operations outside this window.📢 We’ll provide live status updates during maintenance.Thank you for your patience as we enhance our infrastructure.
Report: "Content API Cache Invalidation Delays"
Last updateWe received reports of some responses containing stale content, over both the Content API and in Hygraph Studio. The root cause has been identified, and the stale content has now been successfully refreshed.
Report: "Increase in Management API's Error Rate"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the change.
We are currently investigating an increase in error rate on all of our management API's. This could impact some of the projects and mutations would fail.
Report: "Elevated API Errors"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
We're experiencing an elevated level of API errors and are currently looking into the issue.
Report: "Elevated API Errors in Content API - EU-WEST-2"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Asset Provider Partial Outage"
Last updateThis incident has been resolved.
Our external asset provider is currently experiencing issues and this causes asset uploads to fail. Once we have further information, we will be updating the status of this incident.
Report: "Issue logging into Hygraph in select regions"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Elevated API Errors"
Last updateThis incident has been resolved.
We're experiencing an elevated level of API errors and response time. We are currently looking into the issue.
Report: "Management API issues"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are continuing to investigate this issue.
We are experiencing an elevated error rate on our Management API, leading to potential failures in certain operations. Our team is actively investigating and addressing the issue.
Report: "Asset Provider Partial Outage"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Our external service used for Asset handling is currently experiencing issues. Uploading and fetching assets, as well as project creation and deletion, might not work as expected. Once we have further information we will be updating the status of this incident.
Report: "Elevated API Errors"
Last updateThis incident has been resolved.
We're experiencing an elevated level of API errors and are currently looking into the issue.
Report: "Management API Issues"
Last updateThe incident is resolved, and newly created projects and environment clones are working again. Projects created after the 19th of October at 17:30 CEST might be affected by limited asset upload capabilities, which our team will resolve in the coming days. In the meantime, you can also create a new project to get started again.
We are continuing to investigate this issue and are in contact with our asset provider to resolve this incident as soon as possible.
We are continuing to investigate this issue.
Our external service used for Asset handling is currently experiencing issues. Project creation and deletion might not work as expected. Once we have further information we will be updating the status of this incident.
Report: "Comments Notification Outage"
Last updateThis incident has been resolved.
The notifications have started to work, and we are monitoring the platform.
We are continuing to investigate this issue.
We are currently investigating issues with notifications not being sent for comments. Once we have more information, we will be updating the status of this incident.
Report: "Asset Provider Partial Outage"
Last updateThis incident has been resolved.
Our external service used for Asset handling is currently experiencing issues. Uploading and fetching assets, as well as project creation and deletion, might not work as expected. Once we have further information we will be updating the status of this incident.
Report: "Management API issues"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently experiencing an incident with the Management API, which is causing some users to not be able to see all their projects in the web application. We are working on a fix and will update this page as soon as we have more information.
Report: "London cluster (eu-west-2) webhooks delayed"
Last updateWe have cleared out the backlog and webhooks should resume processing as usual without delays.
We are investigating an incident that caused a backlog of webhooks on the cluster. We've resolved the primary issue and are clearing of the backlog. We will post an update once the issue is resolved
Report: "Asset Provider Partial Outage"
Last updateThis incident has been resolved.
Our external service used for Asset handling is currently experiencing issues. Uploading and fetching assets, as well as project creation and deletion, might not work as expected. Once we have further information we will be updating the status of this incident.
Report: "DNS issues on media.graphassets.com"
Last updateThis incident has been resolved.
We are still actively investigating the issue with certain DNS providers and will provide another update in 48 hours. If you are currently experiencing issues we recommend switching to another provider such as Google (8.8.8.8) or Cloudflare (1.1.1.1).
Right now a few DNS providers do not resolve our asset domain (media.graphassets.com). If you are facing issues requesting assets please switch to another provider, for example Google DNS (8.8.8.8) or Cloudflare (1.1.1.1). We are working on resolving this issue.
Report: "Elevated API Errors"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Elevated API Errors in the us-east-1 region"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Asset Provider Decreased Performance"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Our external service used for Asset handling is currently experiencing issues. Mainly asset transformation, as well as uploads are affected by it. Our team is investigating.
Report: "Asset Provider Partial Outage"
Last updateThis incident has been resolved.
Our asset provider has identified the issue and is implementing a fix
Our external service used for Asset handling is currently experiencing issues. Uploading and fetching assets, as well as project creation and deletion, might not work as expected. Once we have further information we will be updating the status of this incident.
Report: "Elevated API Errors"
Last updateThis incident has been resolved.
We are continuing to work on a fix for this issue.
Opening up writes, monitoring error rates.
Database restart was successful, we are monitoring reads for now.
We are restarting eu-central-1 databases. A brief downtime is expected for it.
We switched eu-central-1 content apis to read only mode, to relieve some pressure from the affected databases.
We are continuing to investigate this issue.
We're experiencing an elevated level of API errors and are currently looking into the issue.
Report: "Elevated API Errors in the us-west-2 region"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
We're experiencing an elevated level of API errors and are currently looking into the issue.
Report: "Elevated Error Rate"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
We're experiencing an elevated level of API errors on the EU-CENTRAL-1 cluster and are currently looking into the issue.
Report: "Elevated Error Rate"
Last updateThis incident has been resolved.
A fix has been implemented and the error rate is recovering, we are monitoring the results.
We've identified the root cause and are implementing measurements to increase the API stability.
We're experiencing an elevated level of API errors on the EU-CENTRAL-1 cluster and are currently looking into the issue.
Report: "Management API Issues"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "CDN Performance Issues"
Last updateThe issue is now fully resolved, also on Fastlys side.
Fastly has implemented a fix. We are continuing to monitor.
We are continuing to monitor for any further issues.
All Content APIs are available again. Our Asset CDN is still affected by the Fastly outage. We will update the status page as soon as this is resolved.
All APIs are recovering. Our Team is continuing to monitor the caching bypass.
Our CDN provider is currently facing issues. Our Team has deactivated this caching layer and is monitoring the APIs. More info on Fastly's status page: https://status.fastly.com/
Report: "Elevated error rates"
Last updateThis incident has been resolved.
Database connectivity has been restored and the services are recovering. We'll continue monitoring.
Errors are caused by an outage in the AWS region that hosts one of our databases. Frontend and Management API are still affected.
Our Team has identified the issue that is causing the error when loading the webapp and is working on a fix.
We are currently investigating this issue.
Report: "Elevated API Errors - US-EAST-1"
Last updateWe're experiencing an elevated level of API errors and are currently looking into the issue. Update: Our Team has resolved the issue, all APIs are working normally again
Report: "Elevated API Errors"
Last updateThis incident has been resolved.
We have adjusted rate limiting configurations and are monitoring the region's performance.
A substantial surge in traffic caused API timeouts.
We're experiencing an elevated level of API errors and are currently looking into the issue.
Report: "Error logging into webapp"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
We are experiencing errors logging into the web app.
Report: "Elevated API Errors"
Last updateThis incident has been resolved.
The EU-CENTRAL-1 endpoints are available again and we see the error rate recovering. Our Team will continue to monitor.
Our team has identified the issue and is working on a resolution.
We're experiencing an elevated level of API errors and are currently looking into the issue.
Report: "Elevated API Errors"
Last updateThis incident has been resolved.
Traffic and API response time are normalizing, we will continue monitoring the situation.
We are currently investigating elevated API errors in the EU-CENTRAL-1 region.
Report: "Login Errors"
Last updateThis incident has been resolved.
We're experiencing an elevated level of errors from our authentication provider.
Report: "Login Errors"
Last updateThis incident has been resolved.
We're experiencing an elevated level of errors from our authentication provider.
Report: "Asset Provider Partial Outage"
Last updateThis incident has been resolved.
Our Asset provider has implemented a fix and we are monitoring the results.
Our external service used for Asset handling is currently experiencing issues. Uploading and fetching assets, as well as project creation and deletion, might not work as expected. Once we have further information we will be updating the status of this incident.
Report: "Management API partial outage"
Last updateThis incident has been resolved.
The third-party API is recovering. We'll continue to monitor the situation.
We are currently monitoring a Management API partial outage due to errors from a third-party service provider.
Report: "Elevated API Errors"
Last updateWe're experiencing an elevated level of Content API errors in our EU-CENTRAL-1 region and are currently looking into the issue.
Report: "Elevated API Errors"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are continuing to investigate this issue.
We're experiencing an elevated level of API errors and are currently looking into the issue.
Report: "Asset Provider Partial Outage"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
Our Assets provider has implemented a fix and we are monitoring the results.
Our Assets provider is still investigating the issue.
Our external service used for Asset handling is currently experiencing issues. Uploading and fetching assets, as well as project creation and deletion, might not work as expected. Once we have further information we will be updating the status of this incident.
Report: "Asset Provider Partial Outage"
Last updateThis incident has been resolved.
Our external service used for Asset handling is currently experiencing issues. Uploading and fetching assets, as well as project creation and deletion, might not work as expected. Once we have further information we will be updating the status of this incident.
Report: "Elevated API Errors"
Last updateThis incident has been resolved.
We're experiencing an elevated level of errors in the management API and are currently looking into the issue.
Report: "Elevated API Errors"
Last updateThis incident has been resolved.
We're experiencing an elevated level of API errors and are currently looking into the issue.
Report: "Asset Provider Partial Outage"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
Our external service used for Asset handling is currently experiencing issues. Uploading and fetching assets, as well as project creation and deletion, might not work as expected. Once we have further information we will be updating the status of this incident.
Report: "Scheduled maintenance in the shared-eu-central-1 region"
Last updateThis incident has been resolved.
We are still working on today's scheduled maintenance in the shared-eu-central-1 region. The region continues in read-only mode while we complete the planned configuration changes.
Report: "Elevated API Errors"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We're experiencing an elevated level of API errors in the shared-eu-central-1 region and are currently looking into the issue.
Report: "Elevated API Errors"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We're experiencing an elevated level of API errors and are currently looking into the issue.
Report: "Management API Partial Outage"
Last updateThis incident has been resolved.
Upon investigation, a general slowdown in request times was caused by a large number of long-running queries. Affected queries have been cleaned up, we will continue monitoring the issue.
We're experiencing elevated response times for the Management API and are currently looking into the issue. The same issue is affecting the UI currently.
Report: "Connectivity Issues"
Last updateOur DNS provider has resolved the issue. We have verified our APIs and have confirmed all systems are operational.
Our DNS provider has provided a fix. We are monitoring and verifying our APIs
Our DNS provider Cloudflare has reported an issue with their network.
We are currently investigating connectivity issues on the APIs.
Report: "Delayed management API migrations"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We have identified the problem and are working to speed up the processing of project migrations.
Project creation and modification is taking longer than usual to complete, which is causing delays applying these migrations. We're investigating what's causing this issue.