Historical record of incidents for Vercel
Report: "npm package installs failing with 5xx errors"
Last updatenpm is experiencing degraded performance. Affected users may see 5XX errors when installing packages, which may cause failed builds. npm status page: https://status.npmjs.org/incidents/dn5mcp85737y
Report: "Vercel Dashboard not accessible"
Last updateAt this time, Vercel Dashboard is inaccessible for all users. We have identified the root cause and are implementing a fix.
Report: "Incorrect Edge Functions data shown in Observability"
Last updateFrom 19:27 to 20:40 UTC, the Observability tab showed wrong status codes and error rates for Edge Functions. We’re working on correcting this data, and the correction should be fully completed in the next 12 hours.
Report: "Vercel Dashboard Errors"
Last updateWe are currently investigating intermittent issues when viewing deployments and projects on the Vercel Dashboard.
Report: "GitHub Deployment and API Errors"
Last updateAll systems normal.
We’re currently experiencing issues with services that rely on GitHub, including login and signup, Deployment, and linking projects. This is due to an ongoing incident on GitHub's side, which is affecting API responses and OAuth functionality. You can follow the incident directly on GitHub’s status page: https://www.githubstatus.com/incidents/d0nm3xcdc5jw. We’re monitoring the situation closely and will provide updates as GitHub rolls out a fix.
Report: "GitHub Deployment and API Errors"
Last updateWe’re currently experiencing issues with services that rely on GitHub, including login and signup, Deployment, and linking projects.This is due to an ongoing incident on GitHub's side, which is affecting API responses and OAuth functionality. You can follow the incident directly on GitHub’s status page: https://www.githubstatus.com/incidents/d0nm3xcdc5jw.We’re monitoring the situation closely and will provide updates as GitHub rolls out a fix.
Report: "Errors loading dashboard"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Some users may experience errors loading the dashboard.
Report: "Errors loading dashboard"
Last updateSome user may experience errors loading the dashboard
Report: "DNS Verification Issue"
Last updateAll domain verification functionality has been restored.
We have identified the cause of this incident and are working on a fix. Scope of impact is limited to domains that are in a configured DNS record set but not yet verified.
We are investigating errors in our DNS configuration UI. It is occasionally showing your existing DNS records instead of the records you should be setting. You may still configure a domain manually: - For apex domains, set an A record to 76.76.21.21 - For subdomains, set a CNAME record to cname.vercel-dns.com
Report: "DNS Verification Issue"
Last updateWe are investigating errors in our DNS verification UI. The information presented contains inaccurate records and should not be used until this incident is resolved.
Report: "Elevated errors while deploying"
Last updateWe have restored functionality to impacted services.
A fix has been implemented and we are monitoring the results.
We have identified the issue and are working on a fix.
You may intermittently experience errors when creating new deployments. We are investigating and will provide updates as we work to resolve the incident.
Report: "Builds degraded"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Builds pushed by the supported git providers may not be deployed. We are continuing to investigate this issue. You can deploy manually using the Vercel Dashboard or Vercel CLI if you need to: https://vercel.com/docs/deployments#deployment-methods
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Builds degraded"
Last updateThis incident has been resolved.
All backlog builds have been processed and new builds should now proceed as normal. We'll continue to monitor the results.
All queued builds are being processed. There’s a backlog, so it may take a few minutes to complete. We'll continue to monitor the results.
A fix has been implemented and we are monitoring the results.
The issue has been identified and we are working on a fix.
We are currently investigating this issue.
Report: "Builds degraded"
Last updateWe are currently investigating this issue.
Report: "Elevated errors while deploying"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are continuing to investigate this issue.
We are currently investigating elevated error reports during some deployments. Existing deployments and live traffic are not affected by this issue. We will share updates as they become available.
Report: "Elevated errors while deploying"
Last updateWe are currently investigating elevated error reports during some deployments. Existing deployments and live traffic are not affected by this issue. We will share updates as they become available.
Report: "Builds with functions in iad1 are failing"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Builds with functions in iad1 are failing"
Last updateWe are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Some messages with attachments are failing to submit to v0"
Last updateWe are currently investigating this issue.
Report: "v0 degraded availability"
Last updateSome users may have experienced issues accessing v0 from 17:04 UTC - 17:10 UTC. This issue has since been resolved.
Report: "v0 degraded availability"
Last updateSome users may have experienced issues accessing v0 from 17:04 UTC - 17:10 UTC. This issue has since been resolved.
Report: "v0 Deployment issues with Radix tabs"
Last updateSome users may have experienced issues deploying from v0 if Radix tabs were used between 15:50 and 17:05 UTC. This issue is now fixed.
Report: "v0 Deployment issues with Radix tabs"
Last updateSome users may have experienced issues deploying from v0 if Radix tabs were used between 15:50 and 17:05 UTC. This issue is now fixed.
Report: "Intermittent Issues Serving Traffic Out of hnd1 (Tokyo, Japan) Region"
Last updateBetween 07:40 and 07:58 UTC, some users experienced increased latency and error rates for traffic served through the hnd1 (Tokyo, Japan) region. The issue has been resolved, and services are now operating normally.
Report: "Intermittent Issues Serving Traffic Out of hnd1 (Tokyo, Japan) Region"
Last updateBetween 07:40 and 07:58 UTC, some users experienced increased latency and error rates for traffic served through the hnd1 (Tokyo, Japan) region. The issue has been resolved, and services are now operating normally.
Report: "Private npm package installs failing with 4xx errors"
Last updateThis issue is now resolved. nppmjs.org have marked the issue as resolved on their status page as of 15:00 UTC.
npm have released a status page incident, and users can monitor further updates here: https://status.npmjs.org
We have observed authentication issues to private registries using npm access tokens. Affected users may see 4xx errors when installing private packages. Manually regenerating tokens appears to resolve this issue. At this time, there is no official statement from npm or GitHub regarding the root cause.
Report: "Private npm package installs failing with 4xx errors"
Last updateWe have observed authentication issues to private registries using npm access tokens. Affected users may see 4xx errors when installing private packages. Manually regenerating tokens appears to resolve this issue. At this time, there is no official statement from npm or GitHub regarding the root cause.
Report: "Monthly performance emails sent in error"
Last updateThis incident has been resolved.
We're investigating some monthly performance emails that were sent in error.
Report: "Monthly performance emails sent in error"
Last updateWe're investigating some monthly performance emails that were sent in error.
Report: "Elevated reports of projects being paused"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
A fix is being rolled out and most of the affected projects were unpaused. We will continue to share updates as they become available.
We are continuing to work on a fix for this issue.
We are continuing to work on a fix for this issue.
The issue has been identified and a fix is being implemented.
We are currently investigating reports of elevated projects being paused despite the specified Spend Limit not being reached, resulting in incorrect notifications and paused deployments. This does not affect actual invoices. We will share updates as they become available.
Report: "Elevated reports of projects being paused"
Last updateWe are currently investigating reports of elevated projects being paused despite the specified Spend Limit not being reached. We will share updates as they become available.
Report: "Vercel Community unavailable"
Last updateAccess to the Vercel Community site has been restored. If you are still unable to reach the site, please try clearing your browser cache or opening in an Incognito/Private window.
The Vercel Community site is currently unavailable to some users. We are investigating and will provide further updates as the incident progresses.
Report: "Vercel Community unavailable"
Last updateThe Vercel Community site is currently unavailable to some users. We are investigating and will provide further updates as the incident progresses.
Report: "Missing OTEL Traces for Datadog Exports"
Last updateThis incident has been resolved.
OTEL traces have returned for Datadog and we are continuing to monitor.
We are currently investigating missing OTEL traces for Datadog exports since ~17:37 UTC. Other providers are unaffected.
Report: "Missing OTEL Traces for Datadog Exports"
Last updateWe are currently investigating missing OTEL traces for Datadog exports since ~17:37 UTC. Other providers are unaffected.
Report: "Vercel Integrations Page is Unavailable"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We are currently investigating an issue where the Vercel Integrations page is down. This affects the Integrations tab in the Vercel Dashboard. Integration connections with your projects are not affected and it is only the Vercel Dashboard that is unavailable. Integrations can also still be viewed from the Storage tab on the Vercel Dashboard.
Report: "Vercel Integrations Page is Unavailable"
Last updateWe are currently investigating an issue where the Vercel Integrations page is down. This affects the Integrations tab in the Vercel Dashboard. Integration connections with your projects are not affected and it is only the Vercel Dashboard that is unavailable. Integrations can also still be viewed from the Storage tab on the Vercel Dashboard.
Report: "Elevated latency in CPT1"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are continuing to investigate this issue.
We are currently investigating the issue.
Report: "Elevated latency in CPT1"
Last updateWe are currently investigating the issue.
Report: "Some Enhanced Build Machines are queued"
Last updateThe issue has now been fully resolved. From 12:15 UTC - 14:57 UTC, a portion of deployments on Enhanced Build Machines were delayed in a "Queued" state. No deployments were lost and all deployments are now building as expected.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
Report: "Some Enhanced Build Machines are queued"
Last updateThe issue has been identified and a fix is being implemented.
Report: "Intermittent issues serving traffic out of Washington D.C. iad1 region."
Last updateNormal routing to our Washington D.C. iad1 region has been fully restored. The incident is now resolved.
We have completed rolling out the fix and are currently restoring normal routing for our Washington D.C. iad1 region.
We are temporarily rerouting traffic from our Washington D.C. (iad1) region to our Cleveland Ohio (cle1) region while we continue to roll out the fix.
We have identified the root cause of service disruption and are currently working on a fix.
We are currently investigating this issue.
Report: "Intermittent issues serving traffic out of Washington D.C. iad1 region."
Last updateWe have identified the root cause of service disruption and are currently working on a fix.
We are currently investigating this issue.
Report: "Delayed runtime logs on bom1 and pdx1 regions"
Last updateThis incident has been resolved.
Log delivery in all regions has returned to normal. We are continuing to monitor
pdx1 is no longer affected. We are still observing some delayed logs in bom1
We have confirmed that Log Drains were unaffected by this incident and continue to operate as normal.
We have identified a delay in log delivery specifically affecting bom1 and pdx1. We will continue to investigate and provide updates as this progresses.
Report: "Delayed runtime logs on bom1 and pdx1 regions"
Last updateWe have identified a delay in log delivery specifically affecting bom1 and pdx1. We will continue to investigate and provide updates as this progresses.
Report: "Increase in INTERNAL_EDGE_FUNCTION_INVOCATION_FAILED errors"
Last updateDuring a 4-minute window today between 12:47-12:51 UTC, we experienced a brief increase in 500 errors affecting a small subset of Edge Functions invocations. The issue was isolated to the following regions: lhr1, bom1, hkg1, cdg1, hdn1, iad1. Edge Middleware and Serverless Functions were unaffected.
Report: "Increase in INTERNAL_EDGE_FUNCTION_INVOCATION_FAILED errors"
Last updateDuring a 4-minute window today between 12:47-12:51 UTC, we experienced a brief increase in 500 errors affecting a small subset of Edge Functions invocations. The issue was isolated to the following regions: lhr1, bom1, hkg1, cdg1, hdn1, iad1. Edge Middleware and Serverless Functions were unaffected.
Report: "Ignore Build Step triggered erroneously on some builds"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results. Deployments created after this time (13:44 UTC) should no longer face the issue.
The issue has been identified and a fix is being implemented.
Some builds are erroneously being cancelled with the message: The Deployment has been cancelled as a result of running the command defined in the "Ignored Build Step" setting.
Report: "Ignore Build Step triggered erroneously on some builds"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.Deployments created after this time (13:44 UTC) should no longer face the issue.
The issue has been identified and a fix is being implemented.
Some builds are erroneously being cancelled with the message:The Deployment has been cancelled as a result of running the command defined in the "Ignored Build Step" setting.
Report: "Blob Storage error rates"
Last updateThis incident has been resolved.
We are currently investigating an increase in 400 errors related to Blob Storage.
Report: "Blob Storage error rates"
Last updateThis incident has been resolved.
We are currently investigating an increase in 400 errors related to Blob Storage.
Report: "Vercel Marketplace and Integrations Pages are Unavailable"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating an issue where the Vercel Marketplace and Integrations pages are down. This affects the Integrations tab in the Vercel Dashboard and https://vercel.com/marketplace Integration connections with your projects are not affected and it is only the dashboard that is unavailable. Integrations can also still be viewed from the Storage tab on the Vercel Dashboard.
Report: "Vercel Marketplace and Integrations Pages are Unavailable"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating an issue where the Vercel Marketplace and Integrations pages are down. This affects the Integrations tab in the Vercel Dashboard and https://vercel.com/marketplaceIntegration connections with your projects are not affected and it is only the dashboard that is unavailable. Integrations can also still be viewed from the Storage tab on the Vercel Dashboard.
Report: "Elevated request latency and errors"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
This issue occurred between 16:20 — 16:26 UTC and has already been resolved. We are monitoring our fixes to ensure the issue doesn't return.
Report: "Increased latency and connection errors in multiple regions"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
Issue is isolated to the following regions: iad1, sfo1, sin1, fra1, cle1, hnd1 We are continuing to investigate.
We are currently investigating this issue and will provide additional updates as new information is revealed.
Report: "Issue with DNS Record Propagation"
Last updateThe incident has been resolved.
We are continuing to monitor for any further issues.
We have pushed a fix and DNS record should be propagated now.
We are continuing to work on a fix for this issue.
We are currently experiencing issue that prevent the creation of new DNS records for new domains. Thanks for your patience and understanding.
Report: "Elevated latency in services (Vercel dashboard, API, v0)"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
The build queues are being processed and we're continuing to monitor the services.
Customers are currently experiencing elevated latency while accessing the Vercel dashboard, using the API or creating new prompts on v0. New builds are currently being queued and Log Drains are delayed.
The build queues are being processed and we're continuing to monitor the service.
Most services have recovered, and we're actively working on clearing the queued builds.
We have implemented a fix and are currently monitoring the service.
We are continuing to investigate. For urgent deployments, the Vercel CLI is unaffected and can be used. https://vercel.com/docs/cli
We're seeing recovery, but some services may still be partially degraded. We’re continuing to work on the mitigation.
We have identified the issue and working on a fix. Customer websites remain unaffected.
We are continuing to investigate this issue.
Customers are currently experiencing elevated latency while accessing the Vercel dashboard, using the API or creating new prompts on v0. New builds are currently being queued and Log Drains are delayed.
Report: "Increased INTERNAL_FUNCTION_SERVICE_UNAVAILABLE Errors"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are continuing to investigate this issue.
We are currently investigating elevated error rates for Vercel Functions or middleware traffic in the fra1, cpt1 and arn1 regions.
Report: "SSL certificate issues causing SSL/TLS errors"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We have identified the root cause of this issue and are actively working on a fix.
We are currently investigating an issue with SSL certificates that may be causing SSL/TLS errors for visitors to sites hosted on Vercel. We are actively working to resolve this matter and will provide further updates as soon as they become available.
Report: "Some Outlook / Microsoft Exchange users are not receiving Vercel login verification emails"
Last updateThe issue affecting the delivery of Vercel login verification emails to some Outlook / Microsoft Exchange users has been resolved. Our monitoring systems indicate that email deliverability has returned to normal levels. If you previously experienced delays, you may need to request a new login verification email.
We have observed that deliverability rates are now improving for customers, and will continue to monitor this issue. Customers may need to request a new login verification email if previous emails have not yet been received.
We're continuing to monitor this issue.
We're continuing to monitor this issue.
We're continuing to monitor this issue.
We're continuing to monitor this issue.
We're continuing to monitor this issue.
We have identified impact is isolated to users of Outlook / Microsoft Exchange. We are monitoring for updates and will continue to share information as it becomes available.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
Some Outlook / Microsoft Exchange users are not receiving Vercel login verification emails. We are actively investigating this issue.
Report: "Traffic rerouted from Stockholm (arn1) to Frankfurt (fra1)"
Last updateThis incident has been resolved.
Normal traffic routing has been fully restored for the arn1 region (Stockholm).
We are beginning to restore normal traffic routing to the arn1 region (Stockholm).
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We’re currently investigating increased request latency in arn1 (Stockholm) region. End-users near this region may be experiencing degraded performance due to the increased latency, as we’re now rerouting traffic to another closest region.
Report: "Vercel Dashboard Observability delayed information"
Last updateThis incident has been resolved.
The Observability dashboard is now displaying new data as expected while previously unavailable data is being populated.
The Observability feature within the Vercel dashboard is currently experiencing a delay of data since 22:15 UTC
Report: "GitHub deployment and API errors"
Last updateThis incident has been resolved.
GitHub has mitigated the issue, and we are monitoring the results.
Due to a problem with GitHub, users may experience delayed deployments made with Vercel for GitHub and issues when using GitHub login. For more information, see the GitHub status: www.githubstatus.com/incidents/nm83zrdky73y
Report: "Intermittent error rates with Vercel Community, Learn and AI SDK authentication"
Last updateThis incident has been resolved.
We have identified the issue and a fix has been deployed.
We are investigating intermittent authentication errors with with Community, Learn and AI SDK
Report: "Vercel Data Cache purge issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently experiencing an issue where the Vercel Data Cache is not respecting manual purge events. On-demand, tag-based, and time-based revalidations are working as expected.
Report: "Error when updating team roles"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating an issue where users encounter a teamRoles property is not supported error when setting or updating team roles.
Report: "Error when purchasing domains via dashboard"
Last updateThis incident has been resolved.
We are currently investigating an issue that is preventing users from purchasing domains via the Vercel dashboard and returning the error code bad_request.
Report: "Delay in Cron Job updates after deploying"
Last updateThis incident has been resolved.
Cron Job updates are now taking effect immediately after deploying as expected. We are continuing to monitor.
Users may experience delays of 30 minutes or more for Cron Job updates to take effect after deploying.
Report: "Elevated error rates with Vercel Community authentication"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are investigating elevated authentication errors with Community
Report: "Vercel Functions and Edge Middleware errors in the sin1 region"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
We are investigating a small percentage of Vercel Functions and Middleware invocations errors in our SIN1 region. Impacted customers may encounter 500 errors with the code INTERNAL_FUNCTION_INVOCATION_FAILED.
Report: "Customers are unable to log in or sign up via email"
Last updateWe experienced issues with email-based authentication from 11:15 to 12:40 UTC. During that time, users were not able to log in or sign up via email for both the Vercel platform and the v0 service. Logins or signups via GitHub, GitLab or Bitbucket were not impacted.
Report: "Log Drains are delayed"
Last updateThe queue has been fully processed and this incident is now resolved.
We are continuing to process the queue.
We are continuing to process the queue.
We are continuing to process the queue.
A fix has been implemented and we are currently processing the queue. Log Drains should now begin flowing.
The issue has been identified and a fix is being implemented.
We are currently investigating an issue where Log Drains are delayed.
Report: "Elevated latencies for VDC and ISR in iad1"
Last updateFrom 20:54:25 to 21:13:20 UTC, Functions executing in the `iad1` region observed elevated Vercel Data Cache timeouts, which may have led to increased function latency and timeouts. During the same window, ISR cache hits in `iad1` also experienced elevated latency.
There were elevated error rates in the iad1 region from 20:54 UTC to 21:13 UTC. The issue is now resolved.
Report: "Errors in the Vercel dashboard"
Last updateThis incident has been resolved.
We've implemented a fix for the dashboard issue and are monitoring the results.
We're currently investigating the errors that users are experiencing in the dashboard.
Report: "Intermittent connectivity issues to Vercel-hosted sites in Spain due to ISP outage"
Last updateThis incident has been resolved.
We have observed restored connectivity in Spain and are actively monitoring for any further issues.
For end users in Spain, we are updating sites using Vercel nameservers, cname.vercel-dns.com and *.vercel.app, to new IP space to mitigate the ISP restrictions. And we have reached out to Telefonica for an update.
We are currently investigating intermittent connectivity to Vercel-hosted sites in Spain due to the Telefonica/Movistar ISP outage.
Report: "Cron jobs not updating for new deployments"
Last updateFollowing a detailed investigation, we have confirmed that our Cron Jobs service and all other systems are operating as expected, and none of our customers are affected.
We are continuing to investigate this issue.
We are currently investigating reports of changes to new cron jobs not being reflected when a deployment is created. Existing cron jobs are not affected. We will provide further updates as soon as they become available.
Report: "Unable to add domain to Preview Environments"
Last updateWe have released a fix and the issue has been resolved.
We are currently deploying a fix for this issue. The impact is limited to Preview Environments at this time.
We are currently investigating this issue as it is impacting Preview environments only at this time.
Report: "Issues displaying projects on Vercel Dashboard"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.