Historical record of incidents for Telnyx
Report: "Message Processing Delays"
Last updateWe are currently investigating this issue.
Report: "Instability in Prog. Voice transcription feature using engine A, due to google incident https://status.cloud.google.com/incidents/ow5i3PPK96RduMcb1SsW"
Last updateWe are currently investigating this issue.
Report: "Service degradation in us-east-1"
Last updateWe are continuing to investigate this issue.
Telnyx Cloud Storage operations on buckets in us-east-1 may be intermittently unavailable. We are investigating this issue.
Report: "Some documents fail to be downloaded"
Last updateMaintenance is occurring on the documents service. During this time, documents uploaded before March 2025 may fail to be downloaded. Maintenance will complete Wednesday June 18, at which point all document operations will succeed again. This impacts: * Documents API * Port orders * Number orders * Invoices
Report: "Service degradation in us-east-1"
Last updateWe are currently investigating this issue.
Report: "call control timeouts/5xx in us central"
Last updateWe are currently investigating this issue.
Report: "Degraded connectivity of programable wireless service"
Last updateWe are currently investigating this issue.
Report: "Push notifications on Android is not working properly"
Last updateWe are currently investigating this issue.
Report: "Storage and AI Assistant Issues"
Last updateTelnyx Storage us-central-1 unavailable AI Assistant API and calling unavailable
Report: "European Wireless Network Maintenance"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Enter scheduled maintenance deatils here.
We will be optimising the core IP network infrastructure at our Frankfurt PoP. This may result in a brief (up to 5 minutes) disconnection of active Wireless data sessions. Sessions are expected to re-establish automatically.
Report: "Data Connectivity Issues When Roaming via IMSI1"
Last updateA fix has been implemented and we are monitoring the results.
We have identified that the data connectivity issue is isolated to the Telus network in Canada when roaming via IMSI1. Recommended Action: Users are advised to manually switch their devices to an alternative available network, such as Bell, Rogers, or SaskTel, where data services are working as expected.
We are currently investigating this issue.
Report: "EU site - Wireguard Maintenance"
Last updateMaintenance was completed as planned, without incident.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
We will be performing upgrades of our Wireguard infrastructure in EU to support continued growth and improve stability. Customers using the Cloud VPN feature including those using Private GWs for Wireless will experience upto a 5 minute drop in the Wireguard connection.
Report: "Scheduled maintenance for Programmable Voice - Voice API/Media Streaming/TeXML in EU/US"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Our Telephony Engineers will perform maintenance on our Programmable Voice, TeXML and Media Streaming services in the Europe/US region. This maintenance should not disrupt service.
Our Telephony Engineers will perform maintenance on our Programmable Voice and Media Streaming services in the Europe/US region. This maintenance should not disrupt service.
Report: "Voice Services Update - All Regions"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Our Telephony Engineers will be performing an update on our Voice Services servers servers across all regionsImpact: This update is not expected to disrupt service.Action Required: If you experience any audio issues or dropped calls during this maintenance window, please report them immediately to Telnyx Support.
Report: "Data Connectivity Issues When Roaming via IMSI1"
Last updateA fix has been implemented and we are monitoring the results.
We have identified that the data connectivity issue is isolated to the Telus network in Canada when roaming via IMSI1.Recommended Action:Users are advised to manually switch their devices to an alternative available network, such as Bell, Rogers, or SaskTel, where data services are working as expected.
We are currently investigating this issue.
Report: "Wireless Core Upgrades"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
As part of our ongoing efforts to enhance network performance and reliability, we will be performing a software upgrade of key wireless componentsImpact:During this period, there may be temporary authentication delays or brief service disruptions for devices. We will take all necessary measures to minimize any impact on your services.Action Required:No action is required on your part. Your devices will reconnect automatically once the migration is complete.If you experience any service issues beyond the maintenance window, please contact our support team. We appreciate your patience and understanding as we work to improve our network.
Report: "Cloud Storage Degradation in us-east-1"
Last updateRoot cause: internal deploy. Short-term remediation: 1. Roll-back of the deploy 2. Hot fix application, testing, and re-deploy Long-term remediation: 1. Alert optimization and deployment monitoring.
This incident has been resolved.
A fix has been implemented and we are monitoring the results.
Cloud Storage us-east-1 temporarily unavailable for bucket creation. We're actively investigating the issue.
We are currently investigating this issue.
Report: "Cloud Storage Degradation in us-east-1"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Cloud Storage us-east-1 temporarily unavailable for bucket creation. We're actively investigating the issue.
We are currently investigating this issue.
Report: "Delays in eSIM activation for wireless product"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "US site - Wireguard Maintenance"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
We will be performing upgrades of our Wireguard infrastructure to support continued growth and improve stability. Customers using the Cloud VPN feature including those using Private GWs for Wireless will experience upto a 5 minute drop in the Wireguard connection.
Report: "Delays in eSIM activation for wireless product"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Number Search and Ordering Maintenance"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Our downstream vendor will be conducting maintenance on their services.During this time, number searching and ordering may be disrupted in the following countries: Italy, Switzerland, Norway, Sweden, Denmark, Portugal
Report: "Scheduled maintenance for Programmable Voice - Voice API/Programmable Voice - TeXML EU/US"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Our Telephony Engineers will perform maintenance on our Programmable Voice and TeXML services in the Europe/US region. This maintenance should not disrupt service.
Report: "Scheduled maintenance for Media Streaming services in EU/US"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Our Telephony Engineers will perform maintenance on our Media Streaming services in the Europe/US region. This maintenance should not disrupt service.
Report: "Wireless - Partial outage on Comfone GTP Proxy"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Network bandwidth issue affecting Denver (DE1) site"
Last updateCalls anchored in Denver (DE1) site were affected. Symptoms: audio quality issues and/or call drops. Start: 16:10 UTC End: 16:15 UTC This incident has been resolved.
Report: "Wireless - Partial outage on Comfone GTP Proxy"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Network bandwidth issue affecting Denver (DE1) site"
Last updateCalls anchored in Denver (DE1) site were affected. Symptoms: audio quality issues and/or call drops.Start: 16:10 UTCEnd: 16:15 UTCThis incident has been resolved.
Report: "Partner Maintenance Wireless - US only"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Our Primary connectivity partner in the US will be performing maintenance on their redundant IP core routers. Only one node wll be impacted at a time, so the impact will be limited to a maximum 30s-second disruption to data sessions during the window.
Report: "Wireless Outage - Data connectivity affecting Frankfurt & Sydney Sites"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Wireless Outage - Data connectivity affecting Frankfurt & Sydney Sites"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Scheduled maintenance for Programmable Voice - TeXML EU/US"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Our Telephony Engineers will perform maintenance on our TeXML services in the Europe/US region. This maintenance should not disrupt service.
Report: "Cloud Storage Service Degradation across sites"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Increased 503s across APIs including Voice, Messaging, and Numbering"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Meta-Llama-3.1-70B-Instruct Chat Completions API Failures Detected"
Last updateThis incident has been resolved.
Chat completion requests for Meta-Llama-3.1-70B-Instruct model are not responding.
Report: "Meta-Llama-3.1-8B-Instruct Chat Completions API Failures Detected"
Last updateThis incident has been resolved.
Chat completion requests for Meta-Llama-3.1-8B-Instruct model are not responding.
Report: "Cloud Storage Service Degradation across sites"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Meta-Llama-3.1-70B-Instruct Chat Completions API Failures Detected"
Last updateThis incident has been resolved.
Chat completion requests for Meta-Llama-3.1-70B-Instruct model are not responding.
Report: "Meta-Llama-3.1-8B-Instruct Chat Completions API Failures Detected"
Last updateThis incident has been resolved.
Chat completion requests for Meta-Llama-3.1-8B-Instruct model are not responding.
Report: "Increased 503s across APIs including Voice, Messaging, and Numbering"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Voice Services Update"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Impact:Our telephony engineers will be performing an update on the Voice Services server across all regions.The update is not expected to cause any service disruption.If you encounter any issues with outbound call connectivity or any disruptions during or after the update, please contact Telnyx Support immediately for assistance.
Report: "Migration of Core wireless component - HSS"
Last updateThe scheduled maintenance has been completed.
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Dear Valued Customer,As part of our ongoing efforts to enhance network performance and reliability, we will be conducting a Home Subscriber Server (HSS) migration and testing for our IoT network.Impact:During this period, there may be temporary authentication delays or brief service disruptions for IoT devices. We will take all necessary measures to minimize any impact on your services.Action Required:No action is required on your part. Your IoT devices will reconnect automatically once the migration is complete.If you experience any service issues beyond the maintenance window, please contact our support team. We appreciate your patience and understanding as we work to improve our network.
Report: "US-east-1 cloudstorage produc down"
Last updateThis incident has been resolved as of 9:45am UTC.
We are currently investigating this issue.
Report: "Wireless Connectivity Issue – Session Establishment Failure for a subset of Public IP Users"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Packet Loss across all sites"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Wireless Outage | SIM Actions are being delayed"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Failing to activate new eSIMs"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Wireless outage"
Last updateThis incident has been resolved.
False positive triggered by alert, systems are stable and we're monitoring.
We are currently investigating this issue.
Report: "Some inbound SMS messages delayed"
Last updateThe issue has been identified and a fix is being implemented.
Report: "Wireless API delays"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Degradation of Wireless Service : Australia"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Meta-Llama-3.1-70B-Instruct Chat Completions API Failures Detected"
Last updateThis incident has been resolved.
Chat completion requests for Meta-Llama-3.1-70B-Instruct model are not responding.
Report: "Experiencing degradation of service on Frankfurt Site"
Last updateWe are currently investigating this issue.
Report: "Network issues between SV1 and DC2"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Prog voice impacted in us-west"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "10DLC API Instability"
Last updateThe maintenance is completed
A fix has been implemented and we are monitoring the results.
A unplanned partner maintenance affected the connectivity.
We are working in a fix.
We are currently investigating this issue.
We are currently investigating this issue. Users may experience 5XX errors on the API for /v2/10dlc/
Report: "Voice SDK connectivity issues in Europe"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Meta-Llama-3.1-70B-Instruct Chat Completions API Failures Detected"
Last updateThis incident has been resolved.
Chat completion requests for Meta-Llama-3.1-70B-Instruct model are not responding.
Report: "Prog voice/TeXML impacted in Europe"
Last updateThis incident has been resolved via a rollback executed at 12:54pm UTC on April 17th. Affected sites were restarted at 1:45pm UTC and improvement was observed.
We are currently investigating this issue.
Report: "Sporadic latency while listing buckets"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
Intermittent latency is observed in us-central-1 and us-east-1 regions of Telnyx cloud storage. Read/write operations, as well as listing buckets on the user portal, may be temporarily inaccessible. We are actively working on mitigating the issue
We are currently investigating this issue.
Report: "Homer-app, used to view sip flow is not responding"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Some updates made from Mission Control portal or API since 7pm UTC are not being honored by any of the voice services due to a database replication issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
We are currently investigating this issue.
Report: "Wireless Service Degradation"
Last updateThis incident has been resolved.
We are actively investigating the issue; however, there is currently no impact on traffic.
We are currently investigating this issue.
Report: "Wireless degradation of Services in the US"
Last updateThis incident has been resolved.
We are facing an degradation in the Wireless service in the US.
Report: "E911 provisioning and deprovisioning degradation"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are experiencing service degradation with E911 provisioning and deprovisioning for US and CA local phone numbers. We are currently investigating this issue.
Report: "Wireless degradation of Services in the US"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are facing an degradation in the Wireless service in the US.
Report: "US/CA Phone numbers provisioning inconsistency"
Last updateMaintenance was completed as planned, without incident.
The issue has been identified as a maintenance in the US routing provider and a fix is being implemented.
We are currently investigating this issue.
Report: "Network packet loss affecting Telnyx SIP Proxies signaling IP addresses"
Last updateThis incident has been resolved.
A fix has been implemented as of 12:20 UTC and we observe the issue is resolved for all IPs.
The issue should now be resolved for the following signalling IPs: - 192.76.120.10 - 64.16.250.10 - 185.246.41.140 - 185.246.41.141 Our team is working on a solution for all IPs.
Upon further checking, there is high packet loss of 10-30% between any public IP in the EMEA and APAC regions and all Telnyx IPs/regions. Public IPs in the AMER region appear unaffected. Our engineering team continue to investigate.
Currently our two main US proxies 192.76.120.10 and 64.16.250.10 are experiencing packet loss. Our engineering team is actively investigating and working on a fix.
We are currently investigating this issue.
Report: "Meta-Llama-3.1-8B-Instruct Chat Completions API Failures Detected"
Last updateThis incident has been resolved.
Chat completion requests for Meta-Llama-3.1-8B-Instruct model are not responding.
Report: "Outbound MMS queueing"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Inference component on home page is off"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Intermittent Inbound call termination issue resulting in 408 Timeout issue"
Last updateThis incident has been resolved.
Report: "voice-sdk-proxy outage"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Cloud storage in us-east-1 is non-responsive"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
Temporary outage of cloud storage services in us-east-1.
Report: "Intermittent availability in Cloud Storage us-central-1"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Meta-Llama-3.1-70B-Instruct Chat Completions API Failures Detected"
Last updateThis incident has been resolved.
Chat completion requests for Meta-Llama-3.1-70B-Instruct model are not responding.
Report: "Service degradation us-east-1"
Last updateThis incident has been resolved. Our engineers implemented a fix at resolved the service at 8:50 UTC today
We are currently investigating this issue.
Report: "Messaging: Delayed SMS deliverability in certain cases"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Voice SDK Client Registration Issues in Non-US Anchor Site"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Calls to Microsoft AA/CQ failing with 480 errors"
Last updateThis incident has been resolved.
We are currently impacted by a Microsoft service outage that is affecting call transfers for service numbers. As a result, Auto Attendant (AA) and Call Queue (CQ) functionality may be disrupted. We have raised an issue with Microsoft and are awaiting updates.
Report: "infrastructure degradation in us central"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Subaccounts of L2 Verified Organization Accounts were limited with access"
Last updateThere was an incident that incorrectly rate limited some sub-accounts that are part of an organization account. This started roughly at 14:00 UTC and was completely resolved by 18:00 UTC.
We are currently investigating this issue.