360Learning

Is 360Learning Down Right Now? Check if there is a current outage ongoing.

360Learning is currently Operational

Last checked from 360Learning's official status page

Historical record of incidents for 360Learning

Report: "Issue with video playback"

Last update
resolved

The issue affecting video playback is now <b>fully resolved</b> ✅ We deployed a way to clear corrupted information in the browser cache. We apologize for the inconvenience. Kind regards, The 360Learning team.

monitoring

</b>Video playback is available since yesterday (May 13th) 4:15 PM CEST</b> ✅ Some Web Application users might experience problems playing video because of corrupted information cached in their browser. In this case, we recommend clearing the browser cache to fix the problem. We're currently working on a way to clear corrupted information cached in the browser, and fix this bug for everyone. It should be deployed by Tomorrow (May 15th) 11 AM CEST. Note that this issue doesn't impact Android or iOS applications. We apologize for the inconvenience. Kind regards, The 360Learning team.

monitoring

We have <b>fixed the root cause</b> of the issue that affected our systems. </b>Video playback is now available</b> ✅- Please clear your browser cache in case the videos are not playing on your platform. We keep monitoring the situation. We apologize for the inconvenience. Kind regards, The 360Learning team.

identified

We are continuing to work on a fix for this issue.

identified

Our Video Streaming services are back online and users are able to play videos. We are aware of some users still not able to play videos if they attempted to play them during the outage. We are working on a fix for this specific scenario and will keep you posted as soon as we have an update to share. We apologize for the inconvenience. Kind regards, The 360Learning team.

identified

We have identified the root cause of the issue that is currently affecting Video Streaming services, and which prevented user from playing videos on the platform. The rest of the 360Learning features remains available. We are working to fix this issue and will keep you posted as soon as we have an update to share. We apologize for the inconvenience. Kind regards, The 360Learning team.

investigating

An <b>issue</b> is currently affecting our systems. <b>You cannot play videos from your 360Learning platform.</b> We are investigating and will keep you posted as soon as we have an update to share. We apologize for the inconvenience. Kind regards, The 360Learning team.

Report: "Issue with video playback"

Last update
resolved

The issue affecting our systems is now <b>fully resolved</b>; our monitoring has confirmed that everything is now fully operational. <b>Your 360Learning platform remains up and running</b> ✅ We apologize for the inconvenience. Kind regards, The 360Learning team.

monitoring

A fix has been applied successfully. The video playback is now up and running. We maintain reinforced monitoring to accompany this return to normal.

investigating

We are currently experiencing some issues with the video playback. We are investigating and will keep you posted as soon as we have an update to share.

Report: "Short episodes of elevated latency"

Last update
resolved

Due to an important upgrade of our database management system, your 360Learning Platform have suffered from short episodes of latencies today: from 09:54 to 09:57 AM, and from 10:10 to 10:13 AM (CET). During these times, the service was slower than usual. The maintenance operation is now completed and our service is back to normal. We apologize for the inconvenience. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

Report: "Search Functionality Currently Unavailable"

Last update
resolved

We confirm that the issue is solved and Search is now operational. We apologize for any inconvenience this may have caused. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

monitoring

A fix has been implemented and we are monitoring the results.

identified

We are currently experiencing issues impacting the Search functionality. We have identified the root cause of the issue and are taking actions to fix it. We will send an additional update around 12PM.

Report: "Issues with Data Synchronization"

Last update
resolved

We confirm that the issue is solved and our services are back to normal. We apologize for the inconvenience. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

monitoring

We are continuing to monitor for any further issues.

monitoring

Search functionality is now available. Data is still incomplete but synchronization is in progress. Data Connect and dashboards are fully operational. Thank you for your patience, and we will keep you updated as progress continues.

identified

We have identified the root cause of the issue. We are actively working on a solution. We will send an additional update around 2 PM (CET).

investigating

We are currently facing a data synchronization issue impacting Search, Data Connect, and Dashboards. Search is unavailable on your 360Learning platform, and data may be temporarily incomplete in Data Connect and certain dashboards. Our team is actively investigating the issue and will provide updates as soon as possible.

Report: "Video Streaming service"

Last update
resolved

Hello, We have <b>identified the root cause</b> of the issue that is currently affecting Video Streaming services, and which prevented user from playing videos on the platform. <b>The rest of the 360Learning features remains available.</b> We are working to fix this issue and will keep you posted as soon as we have an update to share. We apologize for the inconvenience. Kind regards, The 360Learning team.

Report: "Issue with Video Streaming services"

Last update
resolved

Hello, The Video Streaming service issue is now <b>fully resolved</b>; our monitoring has confirmed that everything is fully operational. Therefore, <b>Video Streaming is now working properly, and you can now play videos</b> ✅ We apologize for the inconvenience. Kind regards, The 360Learning team.

Report: "Service is slow for some customers"

Last update
resolved

We confirm that the issue is solved and our services are back to normal. We apologize for the inconvenience. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

monitoring

A fix has been applied successfully. The platform is now up and running. We maintain reinforced monitoring to accompany this return to normal.

investigating

Your 360Learning platform might currently suffer some slowdowns. We are investigating the root cause and will keep you posted as soon as we have an update to share.

Report: "Delay in search"

Last update
resolved

We confirm that the issue is solved and our services are back to normal. We apologize for the inconvenience. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

investigating

An issue is currently affecting the search feature. Search are delayed on your 360learning plaftorm. We are investigating and will keep you posted as soon as we have an update to share.

Report: "Login with SSO SAML was blocked"

Last update
resolved

We confirm that the issue is solved and our services are back to normal. We apologize for the inconvenience. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

monitoring

Login with SSO SAML has been temporarily blocked from 12:00 pm to 2:56 pm. A fix has been deployed, and the situation is back to normal.

Report: "Important delay in email delivery"

Last update
resolved

We confirm that the issue is solved and our services are back to normal. We apologize for the inconvenience. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

monitoring

Emails are being sent without problems for now. All non sent emails were resent. We will keep monitoring the situation for the next hours. An additional update will be sent around 18h CET.

identified

We are continuing to work on a fix for this issue. Emails are being sent without problems for now. An additional update will be sent tomorrow around 10h CET.

identified

Our engineering team has identified an issue affecting emails for all users. Some emails are being delivered with an important delay. We are investigating the root cause and working on a solution. An additional update will be sent around 18h CET.

Report: "General Latency"

Last update
resolved

The issue has been resolved.

investigating

Hello, An issue is currently affecting our systems. Your 360Learning platform might be slow for now. We are investigating and will keep you posted as soon as we have an update to share. We apologize for the inconvenience. Kind regards, The 360Learning team.

Report: "Conversion to PDF not available"

Last update
resolved

The issue affecting PDF conversion is now <b>fully resolved</b>. Our monitoring has confirmed that everything is now fully operational. <b>All the failed conversions were successfully fixed</b> ✅ We apologize for the inconvenience.

monitoring

<b>We've successfully fixed more than 75% of previously failed conversion.</b> ✅ We're working on fixing the remaining failed conversion and will send an update around 6 PM CET. We apologize for the inconvenience.

monitoring

We have <b>fixed the root cause</b> of the issue that affected our systems. <b>The PDF conversion is now available!</b> ✅ We're now working on fixing the PDF conversions attempts that failed while the feature was not available. We keep monitoring the situation and we'll inform you when it's done. We apologize for the inconvenience

identified

We are still <b>working to fix the root cause</b> of the known issue we declared earlier. <b>The PDF conversion remains unavailable for now.</b> It’s the case since Friday July 21st (UTC). The issue will take more time than planned to be fixed. We’re working hard to provide a solution as soon as possible. By this time, you can consult this dedicated knowledge base article giving more details on the issue, and proposing workarounds: https://support.360learning.com/hc/en-us/articles/28794862186644-Document-to-PDF-conversion We will keep you posted as soon as we have an update to share. We will provide an additional update on Wednesday, July 31st, at approximately 6 PM CET. We apologize for the inconvenience.

identified

We are still <b>working to fix the root cause</b> of the issue we declared earlier. <b>The PDF conversion remains unavailable for now.</b> We know it impacted PDF conversion done since Friday July 21st (UTC). We will keep you posted as soon as we have an update to share. In any case, we will send an additional update tomorrow around 6 PM CET. We apologize for the inconvenience.

identified

We are continuing to work on a fix for this issue.

identified

We are still <b>working to fix the root cause</b> of the issue we declared earlier. <b>The PDF conversion remains unavailable for now.</b> We know it impacted PDF conversion done since Friday July 21st (UTC). We will keep you posted as soon as we have an update to share. In any case, we will send an additional update tomorrow around 11 AM CET. We apologize for the inconvenience.

identified

We have <b>identified the root cause</b> of the issue that is currently affecting PDF conversion. <b>The PDF conversion remains unavailable for now.</b> We are working to fix this issue and will keep you posted as soon as we have an update to share. In any case, we will send an additional update around 6 PM CET. We apologize for the inconvenience.

investigating

The conversion of new documents (like doc or ppt) to PDF is not available. Therefore, when uploading such documents, they won't be displayed in 360Learning. They can still be downloaded (if allowed - see https://support.360learning.com/hc/en-us/articles/115001380003-Add-a-document-to-a-course#h_01F8T0ZPQZNJ3FYAHNVG262Q3W). We're investigating the root cause and working on a solution. We will send an additional update around 11 AM CET.

Report: "Platform high latency"

Last update
resolved

Microsoft closed the incident. Service back to normal.

monitoring

Improvement in service latency after Microsoft intervention. Monitoring the situation.

identified

The platform might suffer latency issues. Azure is having global network issues. Details here: https://azure.status.microsoft/en-us/status

Report: "Service slow or unavailable"

Last update
resolved

The critical issue affecting our systems is now fully resolved; our monitoring has confirmed that everything is now fully operational. Your 360Learning platform remains up and running

monitoring

We have identified an issue with our main database. Your 360Learning platform is now available ✅- We keep monitoring the situation. We apologize for the inconvenience. Kind regards, The 360Learning team.

investigating

Hello, An issue is currently affecting our systems. Your 360Learning platform might be unavailable for now. We are investigating and will keep you posted as soon as we have an update to share. We apologize for the inconvenience. Kind regards, The 360Learning team.

Report: "Issue with video playback"

Last update
resolved

The video playback is back to normal. We apologize for the inconvenience. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

monitoring

Video playback service has been recreated and videos are available. We are actively monitoring

investigating

The video playback is still unavailable. We are redeploying the video service entirely. Next update at 05:30 AM

investigating

Investigations are still ongoing. The root cause has not been established. Next update at 4:40 AM CEST

investigating

An issue with the video service has been detected. We are currently investigating. Next update by 04:00 AM CEST

Report: "Random errors on login page"

Last update
resolved

The incident has been resolved. Sorry for the inconvenience

monitoring

A fix has been applied successfully. The situation looks to be back to normal. We maintain reinforced monitoring for the next hour.

identified

We're deploying a fix. Next update before 17:00 CET.

identified

We’ve determined the issue is coming from the CDN. We are working on a fix.

identified

Web application fails to load and return CORS error for some users. We identified the problem come from a missing header.

investigating

An issue has been detected on our servers. The web application may be inaccessible for some users. We are currently investing the issue. We will send an additional update around 10:20 CET.

Report: "Service unavailable"

Last update
resolved

We confirm that the issue is solved and our services are back to normal. We apologize for the inconvenience. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

investigating

An issue has been detected on our servers. The service is currently down. We're investigating the root cause and working on a solution. We will send an additional update around 11:30 CET.

Report: "Service unavailable"

Last update
resolved

We confirm that the issue is solved and our services are back to normal. The problem was triggered by an incorrect change in our deployment pipeline. We apologize for the inconvenience. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

monitoring

We have restarted the servers. The platform is now up and running. We maintain reinforced monitoring to accompany this return to normal. In addition, we are conducting further investigations to understand what caused our servers to go down.

investigating

We are continuing to investigate this issue.

investigating

An issue has been detected on our servers. The service is currently down. We're investigating the root cause and working on a solution. We will send an additional update around 11:00 CET.

Report: "Web application fails to load"

Last update
resolved

We confirm that the issue is solved and our services are back to normal. We apologize for the inconvenience. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

monitoring

Web application is back to normal. Monitoring if all clients are correctly served. Issue was coming from an invalid cache on our load balancers.

identified

Rebuild and deploy did not fix the issue.Served files are still invalid.

identified

We are continuing to work on a fix for this issue.

identified

We are rebuilding and redeploying the application to ensure all files are up to date in our CDN. It will take 1 hour.

identified

Web application fails to load and return a blank page. We identified the problem come from a missing file not served by our CDN.

Report: "Service unavailable."

Last update
resolved

We confirm that the issue is solved. Some users who tried to connect between 8:30 and 9:45 CET may still experience error on login. It can be solved by refreshing browser cache as described in https://www.digitaltrends.com/computing/how-to-clear-your-browser-cache/ We apologize for the inconvenience. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

identified

The platform is now available for the majority of users. We are working on a fix to ensure it will be solved for all users. In the meantime, if you still face an issue on login, you can clear your browser cache following this process https://www.digitaltrends.com/computing/how-to-clear-your-browser-cache/ and try to log in again.

identified

We're deploying a fix. Next update around 10:15 CET

investigating

Service unavailable. An issue has been detected on our login component. The service is currently down. We're investigating the root cause and working on a solution. We will send an additional update around 9:30 CET.

Report: "mails service interruption"

Last update
resolved

yesterday we sent back all the mails that were blocked. We confirm that the issue is solved and our services are back to normal. We apologize for the inconvenience. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

identified

Mail metrics are now back to normal. We are monitoring reputations, but all your emails should be sent accordingly. We are now looking into resending emails that were blocked during the period of the 8th of February. User creation routes have been re-enabled. You should not encounter 406 errors anymore.

identified

Between the hours of 6 AM and 2 PM today, Thursday 8 February, our notification service via email was interrupted. The issue was triggered by an attack on our servers that had no consequence on the security of customer accounts and data. However, it deactivated our email service as a precaution. We have taken measures to mitigate such attacks. While we analyze the best strategy, as an additional precaution, we deactivated the creation of user accounts. It was the main vector used by attackers. The mail service has been restored. We will send an additional update when the creation of user accounts is fully restored.

Report: "Issue with emails"

Last update
resolved

Emails have been successfully resent, and the bounced email rate is back to normal.

monitoring

We have fixed the problem of DMARC validation affecting mails outgoing from our domain. Mails are now being sent. We will resend all the blocked mails, except those with time-limited links. This should arrive in the next few days.

identified

We detected an issue affecting emails. We are currently investigating the issue.

Report: "Service latencies."

Last update
resolved

We confirm that the issue is solved and our services are back to normal. We apologize for the inconvenience. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

monitoring

The platform is now up and running. We maintain reinforced monitoring to accompany this return to normal.

investigating

An issue has been detected on our servers. The platform may have latencies. We're investigating the root cause and working on a solution. We will send an additional update around 16h30 CET.

Report: "Program session updates are rejected"

Last update
resolved

We confirm that the issue is solved and our services are back to normal. We apologize for the inconvenience.

monitoring

Problem is solved, we are monitoring the platform.

investigating

Service may reject new program sessions or updates. The issue is identified and we are working on a solution. We will send an additional update around 12:00 CET.

Report: "Courses statistics are unavailable"

Last update
resolved

Incident closed. Statistics are fully functional.

monitoring

Fix successfully applied in production. Statistics are back. We will monitor statistics status.

identified

Fix tested and validated in our test environment. Launching fix in production. Time to recovery <30min.

identified

Update: We are currently testing the fix in our testing environment.

identified

Courses statistics are unavailable since 19th December at 9:45am CET. Problem is identified and fix is incoming. No estimated time to recovery available yet.

Report: "Document upload issue."

Last update
resolved

The incident has been resolved.

investigating

We detected an issue affecting document upload. We are currently investigating the issue.

Report: "Plaftorm high latency"

Last update
resolved

We're closing this incident now as the situation is back to normal after some fixes we applied yesterday. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

identified

We are facing high latencies since 10:09 AM. Following a fix, we expect performance to slowly come back to normal.

monitoring

The situation is back to normal thanks to the actions taken, however we will deploy a more stable fix in the next few days. We'll keep monitoring the situation actively until then.

monitoring

We are still facing some punctual latencies. We are working on solutions to improve stability.

monitoring

The upscale of our database infrastructure is completed. We remain on active monitoring to be sure that this upscale is sufficient to avoid latencies

monitoring

In order to resolve the issue we are upscaling the infrastructure of our database. Latencies seem to be back to normal but we continue the monitoring and upscale operation to ensure it won't happen again.

investigating

The platform might suffer latency issues. We are investigating. Sorry for the inconvenience

Report: "Our service was unavailable between 00:14 and 00:27 CET today"

Last update
resolved

Due to a technical issue that self-recovered, our service was unavailable between 00:14 and 00:27 CET December 7 / 18:14 and 18:27 EST December 6. We've taken action to mitigate the risk and apologize for the inconvenience. If you are still experiencing any issues or have questions or concerns, please contact our support team on the webform on our help center at https://support.360learning.com/hc/en-us/requests/new. Thank you for your patience and continued trust in 360Learning!

Report: "VIdeo streaming and uploading issue"

Last update
resolved

The video streaming issue has been solved since 9:58 AM.

investigating

We are facing an issue with video streaming and uploading. We are currently investigating and will send an update when we have more information.

Report: "Delays on video processing"

Last update
resolved

The incident has been resolved. The situation has been back to normal since 9.00 PM CET.

monitoring

We have restarted the servers in charge of video processing. Videos uploaded today are being processed, and should be available within 2 hours. It is not necessary to upload these videos again. We keep monitoring and will publish updates if necessary. We apologize for the inconvenience.

investigating

Since 7.30 AM CET, we are experiencing delays in processing videos uploaded to the service by our users. We are working on a fix. We will send an additional update in 30 minutes.

Report: "Plaftorm high latency"

Last update
resolved

The issue has been resolved. We apologize for any inconvenience caused by this incident

investigating

Our users are currently experiencing higher than normal load times on the Web application. We're investigating the cause and will provide an update as soon as possible.

Report: "Service not available"

Last update
resolved

Due to an issue with an internal component of our platform, the platform was not available from 11:32 a.m. to 11:56 a.m. (GMT+2). The incident is now resolved.

Report: "Service slow or unavailable"

Last update
postmortem

## Incident report **Service slow or unavailable on Sept 19, 2023, for 1 h 29 minutes** Between the hour of 16:02 to 17:31 CET on September 19st, 2023, our users encountered a slow or unresponsive web application and mobile application, as well as issues on 360Learning Public API. The event was triggered by a routine upgrade operation on the main database, that unfortunately placed the database into an unstable state. Our teams detected the incident immediately due to our monitoring system. We decided to remove the faulty database nodes from operation, and to restart them. Around 17:02 CET the service was back for most users, but slownesses remained until 17:31 CET. Following this incident, we deployed further fixes on the next days, causing short episodes of a slower than usual service. At the date of writing, the incident is now completely resolved. We have taken preventive measures to minimize the impact of this type of incident in the future. We apologize for the inconvenience caused by the incident.

resolved

The issue has been resolved. We apologize for any inconvenience caused by this incident

monitoring

A fix has been deployed to production. We will keep monitoring and take further action if needed.

investigating

Service unavailable. An issue has been detected on our servers. The service is currently down. We're investigating the root cause and working on a solution. We will send an additional update around 5:30 p.m. CET.

investigating

We're experiencing an elevated level of API errors and are currently looking into the issue.

Report: "Elevated upload media errors"

Last update
resolved

The issue has been resolved.

investigating

We're experiencing an elevated level of upload media errors and are currently looking into the issue.

Report: "Plaftorm high latency"

Last update
resolved

The platform had suffered latency issues between 14:00 and 14:30. Corrective action has already been deployed and the platform is back to normal. Sorry for the inconvenience

Report: "Videos are not loading"

Last update
resolved

Certificate updated. Everything back to normal.

investigating

Our ssl certificate has an invalid chain. We are fixing it.

investigating

We are still investigating. Our video service seems to be working correctly. It seems error happens before reaching this service.

investigating

Videos are not loading. As a consequence, users can’t read them, while the video seems to be loading. We are investigating this.

Report: "Plaftorm high latency"

Last update
resolved

We encountered an issue on one of our servers after a hotfix deployment that went wrong, causing random latencies for some users. We fixed the faulty server and we improved our alerting system to avoid such issues from occurring again in the future.

monitoring

A fix has been implemented and we are monitoring the results.

identified

The issue has been identified and a fix is being implemented.

investigating

The platform might suffer latency issues. We are investigating. Sorry for the inconvenience

Report: "Elevated platform errors"

Last update
resolved

Update of April 14th. - We've been observing a stability of our platform and a low error rate since the last fixes deployed. - We will keep working on a clarification of the error messages and on a reinforcement of our infrastructures in the next few weeks. - We consider the incident resolved now.

monitoring

Update of April 7th. - We observed a slowdown on Wednesday for 1 minute around 4.15pm CET, due to the replication mechanism of our database. We applied a fix this morning and we keep monitoring the behavior. - As for error popups, we fixed most causes except: - When users play SCORM courses that are included into paths (not programs), they might see an error popup on the results page. These popups can be safely dismissed. We plan to deploy a fix on Tuesday morning CET. - In some cases, accessing deleted items or items for which the users have lost visibility rights, may lead to these generic error messages instead of a proper explanation for the cause. We are fully engaged in solving these issues and we apologize for the inconveniences. Next update before 1 week.

monitoring

April 4th update. - The platform is stable with a good latency and a low error rate. We will embed fixes in our regular software update planned tomorrow early morning CET, that should decrease the error rate even more. We will of course keep monitoring after this deployment. - Regarding the incident of March 29th (9:02-9:37am CET), an incident report is available: https://drive.google.com/file/d/1wd4m0ODmHfSzfJg0_CTJDMTluoCu6JMZ/view?usp=share_link

monitoring

March 30th update. The number of errors stood at a low level while our latency was good today. We will deploy additional fixes with the next regular release, planned for Wednesday 5th. We keep monitoring. Next update here before 3 days.

monitoring

We have resolved the issue due to a problem on 2 servers hosting the database. The situation is back to normal. We keep monitoring. We apologize for the inconvenience.

investigating

Since 9:00 am CET today (March 29th), we observe a high error rate and elevated latencies. We're investigating the issue.

monitoring

According to our monitoring, the number of errors is still stabilized at a low level, while our latency is good. We need a few more days to deploy new fixes, and make sure to minimize the error messages. Next update before Wednesday 29th 5pm CET.

monitoring

The number of errors has been stabilized at a low level. We will deploy fixes for the long tail of errors in the next few days, and keep monitoring. We will keep updating this page daily. We will however not send further e-mail notifications as the situation is now under control.

identified

A new batch of fixes was deployed today. We observed another 3-fold decrease in the number of errors compared to yesterday, with a good latency of our servers. We will keep implementing our plan in the next few days, and will update this page at least daily.

identified

We confirm the issue. The causes have been identified, and we have built a plan to fix these errors. Some fixes were deployed today, resulting in a 3-fold decrease in the number of errors. We will keep implementing our plan in the next few days, and will update this page at least daily.

investigating

Some customers keep reporting an elevated number of error messages while using our platform. We are currently looking into the issue.

Report: "Plaftorm high latency"

Last update
resolved

OVH block storage is back to normal. Our latencies too. Application is back to normal.

monitoring

We do not detect issues with OVH since 1pm (CET). However block storage is still considered in outage on their side. On our side, latencies are back to normal. Keeping the incident open as we are still monitoring the OVH situation.

investigating

Media latencies are due to issues in OVH GRA block storage. See: https://public-cloud.status-ovhcloud.com/ On our side, application latencies are lower. We are still monitoring and analyzing the situation.

investigating

We observe an increase in the latency. We're analyzing the situation.

Report: "Elevated platform errors"

Last update
resolved

For the past few days, we have noticed an increase in errors and latencies on the platform at certain times of the day, disrupting user navigation. We have since performed several maintenance operations on the servers hosting our database, which ended this Tuesday around 5pm CET. Since then, the situation is back to normal, but we continue to monitor our infrastructure to make sure that the issues are completely solved. We apologize for the inconvenience.

Report: "Plaftorm high latency"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

The platform might suffer latency issues. We are investigating. Sorry for the inconvenience

Report: "Plaftorm high latency"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

The platform might suffer latency issues. We are investigating. Sorry for the inconvenience

Report: "Punctual instabilities"

Last update
resolved

We have been experiencing latency issues and an increase in server errors these days. These issues were due to two reasons: - an issue in one of our media storage partners (OVH), cf https://public-cloud.status-ovhcloud.com/incidents/ck365yfh1f1x - an abnormal use of our services by one of our partners, causing pressure on our servers. The situation is back to normal, but we will continue to monitor our servers in the coming days to ensure that these problems are completely eradicated. We are sorry for the inconvenience.

Report: "Plaftorm high latency"

Last update
resolved

This incident has been resolved.

investigating

The platform might suffer latency issues. We are investigating. Sorry for the inconvenience

Report: "Plaftorm high latency"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

The platform might suffer latency issues. We are investigating. Sorry for the inconvenience

Report: "Plaftorm high latency"

Last update
resolved

This incident has been resolved.

investigating

The platform might suffer latency issues. We are investigating. Sorry for the inconvenience

Report: "Abnormal latency"

Last update
resolved

This incident has been resolved.

investigating

We have identified a feature was causing a lot of errors and performance degradation on the database. The feature has been disabled and the platform is restored. we are sorry for this inconvenience

investigating

We're experiencing an elevated level of errors and are currently looking into the issue.

Report: "Service unavailable"

Last update
resolved

We confirm that the issue is solved and our services are back to normal.

monitoring

A fix has been applied successfully. The platform is now up and running. We maintain reinforced monitoring to accompany this return to normal.

monitoring

A fix has been applied successfully. The platform is now up and running. We maintain reinforced monitoring to accompany this return to normal.

identified

We are working on a fix. We expect the platform to be back to normal around 7 PM CET.

identified

A database outage has been identified.

Report: "Platform outage : medias"

Last update
resolved

The issue has been resolved.

monitoring

The media Object storage service is available again. We will keep the situation under observation for the next few hours

investigating

Due to an issue in our Object storage backend, access to most of the media on the platform was affected/temporarily unavailable. We are looking to solve this issue as fast as possible. We're sorry for the trouble you may have experienced.