Is OpenNode Down Right Now? Check if there is a current outage ongoing.

**Summary:** On May 14, 2024, OpenNode experienced an incident with our production database, resulting in performance degradation and service disruption. The root cause of the issue was identified as a deprecated API loading excessive data, leading to a database overload. ‌ **Timeline of Events:** * **10:30 PM PST:** Issue Detected * Our monitoring systems alerted us to unusual activity within the production database, indicating potential performance issues. ‌ * **11:30 PM PST:** Service restart * A decision was made to restart auxiliary services to alleviate any immediate issues and restore stability to the system. ‌ * **12:30 AM PST:** Database Workload Issue Identified and Fix Deployed * Upon further investigation, it was determined that the root cause of the problem was a deprecated API that was loading an excessive amount of data into the database, causing an overload. * A fix was promptly developed and deployed to address the issue and mitigate further impact on system performance. ‌ * **1:30 AM PST:** Monitoring Fix and Stability * Additional measures were taken to enhance monitoring systems and ensure the stability of the database environment. ‌ * **2:00 AM PST:** Issue Confirmed Fixed * Following the deployment of the fix, monitoring systems indicated a return to normal database workload and performance levels. * Our internal testing confirmed that the issue was resolved, and normal service operations were restored.

On May 14, 2024, OpenNode experienced an incident with our production database, resulting in performance degradation and service disruption. The root cause of the issue was identified as a deprecated API loading excessive data, leading to a database overload.

The system is now fully caught up and all payment notifications were sent out.

All current payments are being processed and the team is working through the backlog of payments.

Our data processing infrastructure is running behind which is causing inaccuracies in the reporting tools. No data has been lost and the system should be caught up shortly.

Maintenance has been completed and all systems are fully operational.

Due to unforeseen technical challenges, our scheduled maintenance is extended. We apologize for any inconvenience. Updates will follow as we work to resolve this promptly.

This incident has been resolved.

We are continuing to monitor for any further issues.

Entities and Individuals registered in the United States can now onboard with our new provider through the dashboard. Upon completion, automatic conversion and all fiat related services will be reenabled. If you have questions or encounter issues, please reach out to support@opennode.com or visit the Intercom widget on the dashboard

We have recently been informed that one of our banking partners, Wyre, has made the decision to cease operations over the course of the next month. Clients that are onboarded with this provider and rely on fiat-related activities such as conversions will not be able to generate new payments at this time, unless the automatic conversion functionality is turned off. We have already initiated the process of engaging an alternative banking partner to seamlessly address fiat transaction needs. We anticipate having this new partner integrated into our platform within the next few weeks, thereby ensuring that all fiat operations are available and fully operational without any significant interruption.

This incident has been resolved.

We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution.

This incident has been resolved.

Our Exchange Partner has identified a fix and its working on a resolution.

We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution. In the meantime, all conversions and outgoing bank transfers are disabled.

Queue is now clean. Incoming payment webhooks are now being delivered instantly.

Incoming payments webhook queue is almost clean. Webhooks should start to operate instantly soon.

A fix has been implemented, we're monitoring the results.

We're currently investing an issue where incoming payment webhooks are delayed.

This incident has been resolved and the platform is fully operational.

This incident has been resolved and we are monitoring the results. Conversions and bank transfers are now enabled.

We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution. In the meantime, all conversions and outgoing bank transfers are disabled.

This incident has been resolved.

Emails are still being sent and delivered but with significant delays due to an issue our provider.

This incident has been resolved and the platform is now fully operational.

A fix has been implement by our cloud infrastructure provider and we are monitoring the results. Connectivity is coming back up.

This issue has been identified and is related to our cloud infrastructure provider. The connectivity issue is partial (it doesn't apply to all regions).

Our team is investigating an connectivity incident affecting our platform and will provide updates here.

This incident has been resolved and the platform is fully operational.

This incident has been resolved and we are monitoring the results. Conversions and bank transfers are now enabled.

We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution. In the meantime, all conversions and outgoing bank transfers are disabled.

This incident has been resolved and the platform is fully operational.

A fix has been deployed. We are monitoring for any further issues.

Affected lightning payments are now reflecting their updated status and webhooks were sent.

We are continuing to work on a fix for this issue. Please refer to this page for more updates.

The issue has been identified and a fix is being implemented by our engineering team. Paid payments will be updated shortly and webhooks will be fired. Please refer to this page for more updates.

We currently investigating an issue where Lightning payments are taking longer than expected to update its status. Lightning payment webhooks are also being affected.

This incident has been resolved. Conversions and bank transfers are now fully operational.

A fix has been implemented by our partner and we are monitoring the results.

We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution. In the meantime, all conversions and outgoing bank transfers are disabled.

We're seeing an elevated API error rate on outbound Lightning payments.

This incident has been resolved. Conversions and bank transfers are now fully operational.

A fix has been implemented by our partner and we are monitoring the results.

We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution. In the meantime, all conversions and outgoing bank transfers are disabled.

This incident has been resolved. Conversions and bank transfers are now fully operational.

We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution. In the meantime, all conversions and outgoing bank transfers are disabled.

This incident has been resolved. Conversions and bank transfers are now fully operational.

We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution. In the meantime, all conversions and outgoing bank transfers are disabled.

We have identified and resolved the issue causing intermittent issues with our infrastructure.

We are currently investigating an issue that's causing intermittent failures in our platform. Please refer to this status page to get the latest updates on this incident.

Outgoing transfers are now available.

Infrastructure provider is now stable and we're monitoring the activity.

We're being affected by a major outage on one of our infrastructure providers. Outgoing transfers will be disabled during this time.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

We're seeing increased errors in API for payment requests that have auto-conversion enaled. We're waiting for our local currency liquidity provider to fix the issues.

This incident has been resolved.

A fix was deployed by our partner and the errors are decreasing. Monitoring.

We're seeing increased errors in API for payment requests that have auto-conversion enaled. We're waiting for our local currency liquidity provider to fix the issues.

Outbound BTC Transfers via API & Dashboard are now available.

Outbound BTC Transfers via API & Dashboard are temporarily disabled

This incident has been resolved.

We are aware of some timeouts while generate new charges due to one of our exchange partners unexpected downtime.

This incident has been resolved.

Pay by Card service is temporarily disabled

Card payments are now back up.

A high number of card payments being declined. Apple Pay and Bitcoin payments remain stable.

Credit card payments are now operational.

Credit card payments are temporarily disabled. Debit and Bitcoin payments remain active.

We have identified and resolved the issue causing intermittent issues with our infrastructure.

We are currently investigating an issue that's causing intermittent failures in our platform. Please refer to this status page to get the latest updates on this incident.

The incident has been resolved. Lightning payments are now fully operational. Please note: Webhooks were not triggered for some users during downtime. We’ll be reaching out directly to those affected in order to ensure all platforms are synchronized with OpenNode payments data.

We are continuing to investigate an issue with Lightning Network payments. Impact - Payers are able to initiate LN payments, but processing and merchant settlement are currently pending. Please refer to this status page to get the latest updates on this incident.

We are currently investigating an issue with Lightning payments in our platform. Please refer to this status page to get the latest updates on this incident.

We have identified and resolved the issue causing intermittent issues with our infrastructure.

We are currently investigating an issue that's causing intermittent failures in our platform. Please refer to this status page to get the latest updates on this incident.

We have identified and resolved the issue affecting our infrastructure.

We are aware of the issues affecting our platform and API and are currently investigating them. Please refer to this status page to get the latest updates on this incident.

This incident has been resolved.

We're investigating an error on our BTCUSD price quote, displays inconsistent amounts.

We're investigating an error on our BTCUSD price quote, displays inconsistent amounts.

This incident has been resolved.

We are continuing to investigate this issue.

We are aware of some timeouts while generate new charges. We're investigating.

This incident has been resolved.

We are currently investigating this issue.

This incident has been resolved.

The development platform (dev.opennode.co and Lightning Testnet nodes) will suffer degraded performance as we migrate to our new infrastructure.

Development environment is now fully operational and running on the new infrastructure.

The development platform (dev.opennode.co and Lightning Testnet nodes) will suffer degraded performance as we migrate to our new infrastructure.

All systems are operational now.

Expect degraded performance on the production environment.

This incident has been resolved.

We are continuing to investigate this issue.

We're currently performing upgrades to our testnet environment (https://dev.opennode.co). You might encounter issues with testnet payments meanwhile.

All services are now operational.

Expect degraded performance on production environment.