Historical record of incidents for Uscreen
Report: "Ongoing Cloud Provider Outage"
Last updateOne of our cloud infrastructure providers, Google, is currently experiencing a widespread outage affecting services across the internet. As a result, you may notice: - Slow loading times - Errors accessing certain parts of the platform - Issues uploading content or viewing analytics We’re closely monitoring the situation and will post updates as we learn more. Thanks for your patience as Google works to resolve this.
Report: "Increased Loading Times"
Last updateThe issue impacting loading times has been fully resolved. Platform performance has continued to be stable. Thanks again for your patience and understanding!
We’ve deployed a fix, and the platform is currently recovering. Our team will continue to monitor performance closely to ensure everything remains stable. Thank you for your continued patience!
Our team has identified the root cause of the increased loading times and is working on a resolution. We’ll provide another update as soon as we have more information. Thank you for your continued patience.
We’re currently investigating an issue causing increased loading times for some users. Our team is looking into it and working to identify the root cause. We’ll share more updates as soon as we have them. Thanks for your patience!
Report: "Platform Outage Resulting in 500 Error"
Last update# **What Happened?** On 3/13/2025, we detected a service disruption affecting all users. During this time, some catalog pages and the Uscreen admin area experienced errors, preventing store functionality from working as expected. The issue lasted approximately 19 minutes, with a complete outage of 5-6 minutes before services began recovering. # **What Was the Impact?** * **Total Duration:** ~19 minutes \(15:01 - 15:20 UTC\) * **Full Service Disruption:** ~5-6 minutes * **Degraded Performance:** 15:08 - 15:20 UTC * **Scope:** All stores * **Recovery:** Initial recovery started at 15:08 UTC, with full restoration by 15:20 UTC # **Is Everything Working Now?** Yes, the service has been fully restored and is operating normally. # **What Caused the Issue?** After investigating, we identified that: * A feature in the community section was not optimized for stores with a high number of users. * The system was executing resource-intensive operations, causing requests to take longer than expected. * Under heavy load, the database became overwhelmed, leading to errors. * Our monitoring system did not provide useful diagnostics during the incident, delaying troubleshooting. # **What Are We Doing to Prevent This in the Future?** We’ve taken immediate steps to mitigate the issue and are working on long-term improvements: ## **Immediate Fixes:** * Applied a temporary adjustment to reduce the server load caused by the feature. * Upgraded our monitoring system for better incident visibility and faster response times. ## **Planned Improvements:** * Optimizing the affected feature to handle high-traffic scenarios efficiently. * Implementing measures in our mobile apps to limit excessive requests. We sincerely apologize for any disruption this may have caused and appreciate your patience as we work to enhance system stability.
Our team has identified the issue's root cause and implemented a fix. Thank you for being so patient while the team worked to fully resolve the issue.
Our team has restored service to normal operations, however, they continue to investigate the root cause of the issue. We appreciate your continued patience.
Our engineering team is investigating the issue and is working on implementing a solution. We're starting to see improvements.
Our engineering team is actively investigating the issue and working on a resolution. This affects access to the Admin Area and Catalog pages.
Report: "Modal Window Issues in Admin Area"
Last updateWe experienced an issue with a build release that affected the functionality of modal window popups in the Admin area of Uscreen, causing disruptions for some users. Our team identified the root cause and implemented a fix. The issue has been fully resolved, and normal functionality has been restored for these modal windows.
Report: "Pages Experiencing Slow Loading Times"
Last update# Postmortem **Date of Incident: 1/6/25** ## Summary: We recently experienced degraded performance and limited service interruptions caused by unprecedented traffic growth and an issue within our database infrastructure. A CPU resource leak in our database provider’s system contributed to high resource utilization, compounding the challenge of meeting demand. This incident tested our system’s capacity, and while it caused temporary disruptions, it also highlighted opportunities for immediate and long-term improvements. ## Root Cause * **Increased Demand:** * Platform traffic and user activity tripled compared to typical levels, leading to an unexpected surge in database load. * This spike caused memory saturation and an overabundance of connections. * **CPU Resource Leak:** * A resource leak in the database provider’s infrastructure led to persistent CPU spikes, limiting system efficiency. * This issue prevented the system from scaling effectively to handle workloads. * **Inefficient Resource Allocation:** * Idle database connections and unoptimized queries further stressed the infrastructure, reducing its ability to respond to peak demand. ## Resolution ### **Immediate Actions:** * **Increased Database Capacity:** * Doubled CPU and memory resources in our database instance to handle the increased load. * **Instance Restarts:** * Refreshed instances to eliminate stale connections and stabilize performance. * **Cleared Stale Connections:** * Optimized active connection counts, reducing strain on the system. ### Short-Term Adjustments: * Adjusted query handling to improve load distribution. * Enhanced monitoring tools to identify potential resource leaks sooner. This incident underscores the challenges of balancing rapid growth with infrastructure resilience. By immediately increasing database capacity and addressing inefficiencies, we stabilized the platform for now. Moving forward, we are committed to strengthening our systems through proactive scaling, deeper collaboration with our providers, and better resource management to support your continued success on our platform.
The issue has been successfully resolved. Thank you for your patience during this process.
A fix has been implemented, and we are seeing improvements in the Admin Area and Storefront pages. Our team is actively monitoring the situation and tracking the improvements.
Our team continues to work towards a solution for this issue. Thank you for your continued patience.
Our team continues to work towards a fix for the issue causing slow loading times for the catalog and admin pages.
Our team has identified the root cause of the slowdown affecting the Admin and storefront pages. We are currently working on a fix.
We are currently looking into an issue causing slow loading times for both the Admin and Storefront pages.
Report: "Slower Loading Times"
Last updateThis incident has been resolved.
We've rolled out some updates and performance should be back to normal. Our team will continue to monitor.
Our team is investigating slower loading times in some instances.
Report: "Some web storefronts may be unavailable"
Last update**Incident Summary** On October 12, 2024, users with domains connected to our legacy DigitalOcean load balancer experienced outages due to a large-scale attack targeting DigitalOcean servers. **Impact** Customers using the older infrastructure suffered service disruptions as the load balancer was temporarily disabled. **Root Cause** The legacy DigitalOcean infrastructure, which lacks modern DDoS protection, became vulnerable. **Resolution** We strongly recommend updating domain records to point to our new Google Cloud \(GCP\) load balancers. GCP’s built-in Cloud Armor provides robust DDoS protection, ensuring higher reliability and security. **Next Steps** To prevent future issues, we urge all customers to move to our GCP infrastructure, which offers far superior performance and protection compared to older systems on DigitalOcean. This transition ensures the platform’s resilience against future DDoS attacks and other risks. [For more information regarding this migration please review our help article](https://help.uscreen.tv/en/articles/9492966-migrating-your-domain-to-our-new-servers).
Our 3rd Party Server Partner, DigitalOcean, has restored service. Web Pages should be back up and running now. If your site was impacted by this outage, we highly recommend following our Migration guide and moving your site to our more reliable servers. Please visit https://help.uscreen.tv/en/articles/9492966 for more information.
If you are affected by the issue with DigitalOcean, please follow these steps: 1. Go to your Domain Settings. 2. Click "Use a different domain" and select a Uscreen subdomain. 3. Repeat the process, but this time select "Custom domain" to generate a new set of DNS records.
Our team continues to investigate this issue with DigitalOcean, our 3rd party server partner. In the meantime, you can switch your DNS to our other servers. Please note that DNS changes may take some time to propagate, depending on your DNS host, and in some cases, this can take several hours. Here are the steps to do that: 1. Go to your Domain Settings. 2. Click "Use a different domain" and select a Uscreen subdomain. 3. Repeat the process, but this time select "Custom domain" to generate a new set of DNS records. This will begin the migration to our newer servers.
Our team is currently investigating an issue with our 3rd Party Server Partners regarding some web pages being unavailable. We will continue to update this incident as our investigation proceeds.
Report: "Service availability issues"
Last update**Incident Summary** On October 14, 2024, Uscreen encountered degraded performance across its API \(V1 and V2\), Admin Portal, and Storefront due to an unexpected surge in server load. This resulted in delayed response times and temporary service degradation. **Impact** The performance issue caused slow load times, affecting users' ability to access and use the platform's key features efficiently. **Root Cause** A specific endpoint could not handle the unexpected load increase, leading to performance degradation. **Resolution** Our engineering team acted swiftly to deploy a temporary patch that throttled the affected endpoint, preventing a full outage and ensuring that services remained partially operational. A permanent code update was later released, optimizing the performance of the endpoint and ensuring it can handle higher traffic loads in the future. **Next Steps** We are confident that these improvements, combined with continuous monitoring and proactive load management, will ensure the platform’s stability and resilience, even under higher usage demands. The recent updates safeguard against similar incidents and enhance the overall user experience on Uscreen.
This issue has been resolved.
Our team has implemented a fix for this issue and all platform functionality should be restored. Our team will continue to monitor. Thank you for your patience.
We identified the issue and applied a fix to improve performance as a quick measure. Our team will continue to work on the root cause.
Our team is continuing to investigate the issue and work on implementing a fix. Thank you for your continued patience.
We have identified the problem
We’re investigating a slow loading issue affecting both the Admin portal and the storefront.
Report: "Mobile and TV Apps are experiencing an error"
Last updateOur team has rolled out a fix for this issue. All mobile and TV apps should be loading as expected now.
Our team has identified a root cause for this incident and are preparing a fix. We'll keep this incident updated.
Our team is investigating an issue with Mobile and TV apps, experiencing an issue with loading the catalog. Web pages are unaffected. Please have impacted users login via a web browser in the meantime.
Our team is investigating an issue with Mobile and TV apps, experiencing an issue with loading the catalog. Web pages are unaffected. Please have impacted users login via a web browser in the meantime.
Report: "Some storefronts are unavailable"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented by our 3rd party partner, DigitialOcean and we're seeing sites come back online. Our team will continue to monitor.
We continue to monitor the situation with our 3rd party partner, DigitialOcean. We will continue to update this incident.
Our 3rd party server provider, DigitalOcean, is investigating the issue on their end. We will continue to monitor the situation. If your store is impacted, we highly recommend updating your DNS settings and migrating to our newer, more reliable servers.
We're investigating an issue with our servers that may impact stores with outdated DNS records. Our team is working on a solution with our 3rd party partners. We will continue to update this incident.
Report: "Slow loading times for the Admin area and Storefronts"
Last updateOur team has identified the issue and promptly implemented a quick fix. All loading speeds should resume to normal.
We’re investigating a slow loading issue affecting both the Admin portal and the storefront. We’ll provide an update as our team continues its investigation.
Report: "500 Error on Web Catalog"
Last updateThis issue has been resolved. All pages are loading as expected.
A fix has been implemented and pages should be loading now. Our team will continue to monitor.
Our team has identified an issue causing some pages to display a 500 error. They are currently working on a quick fix to resolve this problem. Apps are unaffected.
Report: "Issues with Live Stream and Video On Demand Playback"
Last updateOur third-party CDN partners have resolved all issues with live and on-demand video playback.
We are continuing to monitor for any further issues.
Our third-party CDN partners have identified the issue and are actively working to resolve it. We expect playback issues to be resolved, and our team is also continuing to monitor the situation on our end.
Our third-party CDN partners are currently experiencing an issue that is affecting live and on-demand video playback. Our team is actively monitoring the situation.
Report: "Slow loading and 500 errors"
Last updateWe’ve resolved the ongoing issues. We appreciate your patience while our team worked on this.
We’ve deployed a fix, and we’re already noticing performance improvements. Our team will continue to monitor the situation closely.
Our team has identified the root cause of the errors and is actively working on deploying a solution.
Our team is currently investigating slow loading of storefronts and 500 errors on the Admin portal.
Report: "Error "Rate Exceeded""
Last updateWe are sharing more details on the issue that happened on June 23rd, which affected the Uscreen Admin Area and some Uscreen websites. Between 01:25 and 01:45 UTC, our customers might have seen a “Rate exceed” message when trying to access the Uscreen Admin Area or their Uscreen website. ## **Summary of the Issue** The problem was caused by an enormous number of requests to our live chat service, which our system couldn’t handle due to previous scalability rules. ## **Preventive Measures** To prevent this from happening again, we have improved our scalability rules to handle loads similar to what we experienced during the issue. We are sorry for any inconvenience this caused. Thank you for your patience and understanding.
The incident has been resolved. Thank you for your patience.
A fix has been implemented and videos should now be loading properly. We'll continue to monitor.
You might experience issues with live chat, the rest of the platform should work well.
We've identified the root cause of the issue and are preparing a quick fix. Thank you for your continued patience.
We are currently investigating an issue that is causing "Rate exceeded" errors when accessing the Uscreen Admin Area. We apologize for any inconvenience this may cause and appreciate your patience as we work to resolve this issue. Thank you for your understanding.
Report: "Videos are not loading from Catalog Page"
Last updateWe wanted to provide a detailed postmortem of the issue that occurred on June 17th, affecting video loading on the web. ### **Summary of the Issue** Our investigation began at 17:07 UTC and was resolved by 18:14 UTC. During this period, you may have experienced problems with videos not loading properly from the catalog. ### **Timeline of Events** 1. **17:07 UTC - Investigating:** We began investigating reports of videos not loading from the catalog on the web. 2. **17:30 UTC - Identified:** We identified the root cause as a recent deployment, which included a feature condition that erroneously caused redirects when users clicked on videos, redirecting them back to the catalog. 3. **17:33 UTC - Monitoring:** A fix was implemented, and videos began loading properly. We continued to monitor for any further issues. 4. **18:14 UTC - Resolved:** The issue was fully resolved. ### **Root Cause and Resolution** The problem was traced to a deployment today that included a feature condition for redirects. This condition mistakenly caused redirects back to the catalog when end-users clicked on videos. Our team quickly identified and implemented a patch to fix the redirect issue. ### **Preventive Measures** To prevent similar issues in the future, we will ensure all redirect features are applied with proper feature flagging. This will help avoid erroneous redirects and ensure smoother deployment processes. We apologize for any inconvenience this issue may have caused. Your patience and understanding are greatly appreciated.
This issue has been resolved. Thank you for your patience.
We are continuing to monitor for any further issues.
A fix has been implemented and videos should now be loading properly. We'll continue to monitor.
We've identified the root cause of the issue and are preparing a quick fix. Thank you for your continued patience.
🔎 Investigating: We are currently looking into an issue where videos are not loading from the catalog on the web. Thank you for your patience as we look into resolving this issue.
Report: "Service performance issues"
Last updateWe wanted to provide a detailed postmortem of the service outage that occurred on Saturday, June 15th, from 16:11 UTC to 20:11 UTC. ### **Summary of the Issue:** The outage was caused by issues with our Load Balancer. While not every store was impacted, those with older DNS configurations experienced interruptions. ### **Background:** Last year, we upgraded our Load Balancer Services to utilize Google Cloud Services, offering enhanced reliability and security. This upgrade ensures faster and more reliable service for our customers’ catalogs. However, stores still using our older DNS configuration were affected during this outage. ### **Steps Taken:** 1. **Immediate Response:** Our team quickly identified the Load Balancer as the root cause and worked to restore service. 2. **Resolution:** Service was fully restored by 20:11 UTC. 3. **Preventive Measures:** We added another layer of WAF at the edge using Fastly, in addition to the Google Cloud Armor security layer. ### **Next Steps for Affected Stores:** Starting this week, to prevent future issues, stores using the older DNS configuration will see a new banner on their dashboard. The banner provides steps to confirm domain ownership and transfer DNS configurations to our new servers. This process takes several hours but will not result in downtime for your members. For those who do not manage their DNS settings, please coordinate with the team member responsible for this task. **Attached is an example of the banner you will see.** We apologize for the inconvenience caused and appreciate your understanding and cooperation in making these necessary updates. 
This incident has been resolved.
Fixed applied and currently in monitoring. You might receive a message in the Dashboard in order to update your domain DNS settings; please follow the step-by-step instructions there.
Users with outdated DNS settings getting the error. If you use an old DNS, please update your domain DNS settings.
Service responses have been stable for the past 32 minutes. We keep monitoring.
We are back online. Continue monitoring.
We are still working on the issue.
We saw no issues in the past 25 minutes. We will continue monitoring.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
We are currently investigating an issue with performance & availability of our services. We'll post updates as soon as they are available. Thank you for your patience.
Report: "Service performance issues"
Last updateThis incident has been resolved.
Our team has applied a fix. Monitoring the issue.
The issue has been identified and a fix is being implemented.
We are currently investigating an issue with performance & availability of our services. We'll post updates as soon as they are available. Thank you for your patience.
Report: "Issue Loading Admin Area"
Last updateThis issue has been resolved. We have implemented a fix, and the admin area has remained stable and available without any issues.
A fix has been implemented, and we have noticed an improvement in loading the admin area. We will continue to monitor.
Our team is currently investigating issues with loading the admin area. We will update this status regularly.
Report: "Content Loading Errors"
Last updateCertain storefronts were facing problems with loading content on the catalog and community in some regions. This was due to an issue that we identified on our CDN \(content delivery network\) post-deploy. However, we have already rolled out a quick fix to address this problem. All content should load without any issue now. Moving forward, our CDN will be improved to prevent loading issues caused by new updates.
Certain storefronts were facing problems with loading content on the catalog and community in some regions. This was due to an issue that we identified on our CDN (content delivery network) post-deploy. However, we have already rolled out a quick fix to address this problem. All content should load without any issue now.
Report: "Elevated Playback Error Rates"
Last updateThis incident has been resolved.
A third-party CDN provider is experiencing high rates of playback errors for both videos and live streaming. They have identified a root cause and rolled back a recent change. The provider is monitoring the situation and seeing signs of recovery.
Report: "Catalog and other pages not loading"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented to resolve the issue, and all mobile and web pages should now load correctly. We will continue to monitor the situation to ensure reliable performance.
We are actively working on resolving the 3rd party cloud outage. Mobile apps are now operational and we are making progress with web pages.
One of our third-party cloud partners is currently experiencing an outage. We are actively working on finding solutions to restore catalog pages.
We're aware of an issue with loading the catalog and other pages on web and mobile apps. We're currently investigating the issue further. We will post updates here as soon as we have more information on this investigation.
Report: "Platform caching issues"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Service availability issues"
Last updateWe have resolved the issue and service remains stable. Thank you for your patience.
This issue has been resolved. Our team will continue to monitor the service stability to ensure that everything remains in order. Thank you for your patience and understanding.
We have observed improvement in the services of 3rd party providers. Access to the Uscreen Admin Area is now available once again. We will continue to monitor the situation.
We are currently investigating an issue that is causing "Rate exceeded" errors when accessing the Uscreen Admin Area. We apologize for any inconvenience this may cause and appreciate your patience as we work to resolve this issue. Thank you for your understanding.
Report: "Availability Issue"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
Issue with uscreen.io Domain We’re currently experiencing an issue with the uscreen.io domain that is impacting our mobile apps. We’re actively addressing this issue and are in contact with our service provider for a swift resolution. Current Status: Mobile Apps: Impacted Storefront Subdomains: Partially affected We apologize for any inconvenience this may cause and appreciate your patience as we work to resolve this issue. We’re committed to restoring full functionality as quickly as possible. Stay tuned for further updates on this status page.
We are continuing to work on a fix for this issue.
We are currently investigating an issue with our functionality. We'll post updates as soon as they are available. Thank you for your patience.
Report: "Google Security Alert"
Last updateThis incident has been resolved.
We are continuing to work on a fix for this issue.
The issue has been identified and a fix is being implemented.
Report: "Storefront Errors"
Last updateWe experienced an elevated level of Storefront errors
Report: "Service Availability Issues"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Live Chat messages"
Last updateThis incident has been resolved.
Small improvements have been implemented and we are monitoring the results.
We are experiencing some issues with a loading of live chat messages due to networking issues with third party transport provider
Report: "Giveway Funnels"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are performing maintenance on giveaway funnels for the next 4 hours, and some functionality will be unavailable until then.
Report: "Deployment issues"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Availability Issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
Our team is investigating the issue.
Report: "Issues with upstream DNS provider -> Heroku"
Last updateThis incident has been resolved.
While the Heroku team is working on a global fix, our team implemented a temporary fix.
Engineers identified and are investigating an issue with an upstream DNS provider starting around 19:33 UTC Aug 23rd, leading to increased failure of insert/delete/changes to DNS. You can see DNS_PROBE_FINISHED_NXDOMAIN errors during page loads.
Report: "Platform availability Issue"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Storefront availability Issue"
Last updateThis incident has been resolved.
The issue is resolved. We still will highly recommend you to have CNAME installed as a primary point. Your naked domain can just redirect towards www domain.
Issue affecting only customers with custom naked domains.
The issue is related to Networking and Domain CNAME IP address, our team is continuing to work on a few potential fixes.
Our team is investigating issues related to custom domain loading issues.
Report: "Platform availability Issue"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Storefront availability Issue"
Last updateThis incident has been resolved.
The issue is resolved. We still will highly recommend you to have CNAME installed as a primary point. Your naked domain can just redirect towards www domain.
Issue affecting only customers with custom naked domains.
The issue is related to Networking and Domain CNAME IP address, our team is continuing to work on a few potential fixes.
Our team is investigating issues related to custom domain loading issues.
Report: "Platform Loading Issue"
Last updateThis incident has been resolved.
All system is up. We will continue to monitor the system.
Issues fixed for Admin Portal and API endpoints. We are still working on issues with Storefronts.
Problem with connectivity issues currently in the US and EU regions. Engineers are recovering affected routing components.
We are continuing to work on a fix for this issue.
One of our infrastructure platform providers experiences issues, some service interruption might appear. Our team is monitoring the situation and working with the partners to resolve the issue. We will post updates here as soon as we have further information.
Report: "Storefront availability Issue"
Last updateOur Product Team has resolved the incident, and all sites should be working well as of now. We apologize for any inconveniences this may have caused.
Report: "Slow video encoding"
Last updateThe incident has been resolved. Our video encoding provider is processing the videos as usual. We apologize for any inconveniences this may have caused.
We are continuing to investigate this issue.
Our video provider (MUX) experiences issues that cause delays in video encoding. We apologize for any inconveniences this may have caused.
Report: "Internal issue with API v2"
Last updateWe identified some issues with our API v2 on the 26th of November at 1:57 AM (UTC) and the Product Team resolved the issue at 02:01 AM (UTC).
Report: "Platform Loading Issue"
Last updateOur platform experienced some unexpected loading issues between 6:50 AM and 6:55 AM EDT (around 5 minutes) - Our Product Team has resolved the incident, and all sites should be working well as of now. We apologize for any inconveniences this may have caused.
Report: "Brief inaccessibility of some sites"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We experienced a 4 minute window where some sites were not accessible.
Report: "Sites with Custom Domains are not Loading"
Last updateAll sites are operational. The issue was identified and resolved by our vendor. We thank you for your patience!
All sites are working again. Our Engineering Team is working with our 3rd party cloud service provider to identify the cause of the issue. We will post updates as soon as they are available.
We are currently investigating an issue with one of our 3rd party cloud providers impacting the successful loading of sites with custom domains on our platform. We'll post updates as soon as they are available. Thank you for your patience.
Report: "Sites with Custom Domains are not Loading"
Last updateAll sites are operational. The issue was identified and resolved by our vendor. We thank you for your patience!
All sites have been working for the last 15 minutes. Our Engineering Team is working with our 3rd party cloud service provider to identify the cause of the issue. We will post updates as soon as they are available.
We are currently investigating an issue with one of our 3rd party cloud providers impacting the successful loading of sites with custom domains on our platform. We'll post updates as soon as they are available. Thank you for your patience.
Report: "Platform Loading Issue"
Last updateOur platform experienced some unexpected loading issues between 4:25 AM and 4:32 AM (7 minutes) - Our Product Team has resolved the incident, and all sites should be working well as of now. We apologize for any inconveniences this may have caused.
Report: "Custom Domains are Not Resolving"
Last updateThank you for your patience. We identified the issue as a networking problem that was resolved by switching to secondary network provider. All systems are operational.
We are currently actively investigating an issue with custom domains not resolving to Uscreen sites. As soon as we have further information, we will post it here. Thank you for your patience.
Report: "Platform Loading Issue"
Last updateThis incident has been resolved.
Some sites are experiencing delays or loading issues. Our Development Team is actively investigating this and we will post an update here as soon as further information is available. Thank you for your patience.
Report: "Domain resolution failures in some regions (uscreen.io and uscreen.app)"
Last updateThis incident has been resolved. We have been monitoring the situation, and we can confirm that all services have resumed normal operation.
We have stable DNS resolution as of now. Our primary Nameservers provider has resolved their technical issues, and we have enabled a secondary Nameservers provider as a backup. We are receiving positive reports that the domains are resolving and the Admin Area is up and running. We will continue monitoring for the time being to ensure we have addressed all domain resolution issues and provide additional updates.
Our Nameservers provider has informed us that they completed the mitigation to one region, and the load is back to normal. However, we are still receiving reports about some domains not resolving in other parts of the world. They are rolling out the same change to the other two affected regions. We keep monitoring this situation, and we will post new updates as they become available.
Our domain names are resolving in all regions now, but we keep monitoring this situation. If the issue persists on your end due to DNS caching, please release, renew, and flush your local DNS information. It is practical when addressing networking issues. If you are not comfortable using the command line or terminal, please restart your computer to produce the same effects. On Mobile devices, please enable airplane mode. After a few seconds, disable it again. Rebooting should also clear out your DNS cache. Google Chrome stores DNS cache elsewhere. Please enter this address in the URL bar chrome://net-internals/#dns and click "Clear host cache."
Our primary Nameservers provider is still experiencing technical issues. We added a secondary DNS zone, and our domain names are resolving in most regions now, except where the old DNS zone is cached.
We have received reports about domain resolution failures in certain regions. Upon investigation, we discovered that our Nameservers provider is experiencing technical issues. We are monitoring the situation, and we will post new updates here as they become available.
Report: "A couple minor delays"
Last updateScheduled release emails are working again as expected. Exporting invoices in amounts more than 5000 will not work for a few more days, for now, we recommend pulling smaller batches of invoices. Thank you for your patience.
Exporting invoices in amounts more than 5000 will not work until sometime Monday. We recommend waiting to pull large batches of invoices until Tuesday, February 16th. Scheduled release emails will not send for videos and collections at this time and these scheduled release emails will resume sometime Monday. We recommend using an external service, such as MailChimp to communicate released content until end of the day Monday, February 15th. We will post further information on Monday. Thank you for your patience.
Report: "Partial outage - Issues with inviting users, access to content, catalog updates."
Last updateThis incident has been resolved.
We are seeing some delay in updates to certain components of the platform, including invite users, access to content for new subscribers, and updates to the catalog. We expect these delays to resolve shortly. Our Development Team is actively investigating the cause of the issue and we will provide updates as soon as they become available. Thank you for your patience.