Historical record of incidents for Assembly
Report: "Some users are experiencing issues accessing the app"
Last updateThe issue was linked to a recent update to our feature management system which impacted a few sub-set of users. We have rolled back the change and the app is now fully functional. All systems are now functioning as expected. We’ll continue to monitor to ensure stability. Please refresh your browser once if you are still seeing issues. Thank you for your patience while we investigated and resolved this issue.
We are currently investigating an issue that is preventing some users from opening the app. Our team is actively looking into it and we’ll share updates as soon as we have more information. We appreciate your patience.
Report: "Some users are experiencing issues accessing the app"
Last updateThe issue was linked to a recent update to our feature management system which impacted a few sub-set of users. We have rolled back the change and the app is now fully functional.All systems are now functioning as expected. We’ll continue to monitor to ensure stability. Please refresh your browser once if you are still seeing issues.Thank you for your patience while we investigated and resolved this issue.
We are currently investigating an issue that is preventing some users from opening the app. Our team is actively looking into it and we’ll share updates as soon as we have more information. We appreciate your patience.
Report: "Mobile App Connectivity Issue"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Minor service degradation"
Last updateThis incident has been resolved.
A fix has been implemented, and we are monitoring.
The issue is identified and a fix will be implemented shortly.
We are actively investigating a service degradation issue impacting platform loading. Our team is diligently working to resolve this to ensure optimal performance. Thank you for your patience as we address this issue.
Report: "Minor service degradation"
Last updateWe recently experienced a brief interruption in our services that lasted for a couple of minutes. We can confirm that our servers are now operating smoothly and without any issues.
We are currently investigating the issue.
Report: "Intermittent loading issues"
Last updateOur service provider encountered operational challenges that briefly impacted our application performance. We're pleased to report that the issue has been swiftly resolved on their end, and our services are now operating at full capacity. Rest assured, we remain vigilant to uphold stability. Your cooperation during this time is greatly appreciated!
We are continuing to investigate this issue.
We're currently investigating intermittent loading issues in our systems.
Report: "Our API services are experiencing slowness"
Last updateThis incident has been resolved.
A fix has been applied and we are continuing to monitor the performance of our systems.
We are continuing to investigate the issue.
We are currently investigating the issue
Report: "Enhanced security & improvements underway"
Last updateThe maintenance window has been successfully completed. Monitoring over the past couple of weeks indicates satisfactory performance. Thank you for your patience and cooperation during this time.
The rewards system and other updates are operational, and we're currently monitoring the changes made.
We’re currently upgrading our rewards redemption system to bring you an even better experience. This includes enhancements to our platform’s security and functionality, ensuring a smoother and more secure process for redeeming your rewards. The system is still under maintenance, but we’re working diligently to restore access as quickly and safely as possible. We’re committed to not only resolving the accessibility of rewards but also to upgrading the overall system performance and security. We’re aiming to provide a more detailed timeline for when you can expect full functionality to return. An update will be provided by the end of day 02/09/2024. We expect access to redemptions to be out over the weekend and resume on Monday, 02/12/2024. For immediate concerns, please contact our support team at support@joinassembly.com. Thank you for your understanding as we enhance our systems to serve you better. We apologize for any inconvenience and are here to assist you through this period.
Report: "Maintenance: Rewards Redemption System"
Last updateWe're thrilled to announce that the issue affecting rewards redemption has been resolved successfully. Our team has worked tirelessly to address the underlying issue, and we're pleased to confirm that rewards redemption functionality is now fully operational. We sincerely apologize for any inconvenience this may have caused and appreciate your patience and understanding throughout this process. Your satisfaction and security are our utmost priorities, and we're committed to delivering a seamless experience for our users. Thank you for your continued support and cooperation. If you encounter any further issues or have any questions, please don't hesitate to reach out to our support team.
We're pleased to inform you that we've successfully completed the maintenance of redemption on our platform. However, we're currently awaiting confirmation from our third-party service provider to enable reward redemption for all users. We appreciate your patience and understanding. We'll provide further updates as soon as we have more information. Thank you for your continued support
In light of the rewards redemption incident, we observed that one of our internal accounts was compromised. We have taken proactive steps to ensure the continued security of our system and protect the data of all our users. As a precautionary measure, we have initiated forced logouts for all user accounts. This means that you may be required to log in again when accessing our platform. Please be assured that this action is not indicative of a data breach. Instead, it is a proactive security measure taken on our part to mitigate any potential risks associated with unauthorized access. We take the security and privacy of our users' data very seriously, and this measure is part of our ongoing commitment to maintaining a safe and secure environment for all our customers. We apologize for any inconvenience this may cause, and we appreciate your understanding and cooperation as we work to ensure the continued security of our platform. If you have any questions or concerns, please do not hesitate to reach out to our support team
We're continuing to work closely with our rewards redemption service provider to resolve the ongoing maintenance incident. At this time, it's taking longer than anticipated, and we appreciate your patience as we work towards a resolution. Please rest assured that all other features and functionalities remain operational. We're focused on restoring full service as soon as possible. Thank you for your understanding and cooperation.
We are currently experiencing an issue with our rewards redemption system, and as a result, we have temporarily disabled the feature to prevent further use. Our team is actively working to address the issue and restore functionality as soon as possible. During this time, the rewards redemption system will be undergoing maintenance, and it will be unavailable for use. We apologize for any inconvenience this may cause. Rest assured, we are prioritizing the resolution of this issue and will provide updates as soon as the system is back online. Thank you for your patience and understanding.
Report: "Our API services are down"
Last updateThis incident is resolved.
We are currently investigating this issue.
Report: "Our API services are down"
Last updateThis incident has been resolved.
We are reopening the issue and investigating it currently.
Report: "Our services are down"
Last updateThis incident has been resolved.
We are currently investigating the issue
Report: "Files are not showing up in user accounts"
Last updateThis issue was isolated to few internal accounts. Does not affect all users. Please ignore.
We are currently investigating the issue.
Report: "We are observing degraded performance"
Last updateThis incident has been resolved.
Our technical team identified an issue with our internal systems that led to a temporary disruption in service. This issue has been promptly resolved, and our services are now functioning smoothly.
We are currently investigating the issue
Report: "Some users relying on SAML authentication are experiencing difficulties logging in"
Last updateThe incident has been resolved
We are continuing to investigate this issue.
We have identified an issue affecting some of our users who utilize SAML for authentication.
Report: "Minor Navigation Issues"
Last updateThe minor navigation issues within our web application have been resolved. We apologize for any inconvenience this may have caused. Thank you for your patience.
A few subset of users are experiencing minor navigation issues within the web application. Users are sometimes redirected to the wrong link when they attempt to open a link. Impact: The issue is causing a minor inconvenience for users. Users cannot access the correct pages and may have difficulty completing tasks. Workaround: Users can clear their cache, cookies, and log out of their account, then log back in. This workaround has been shown to resolve the issue. Status: The issue is currently under investigation.
Report: "Login using Slack is impacted for users on latest version of iOS"
Last updateWe are pleased to announce that the login issue on iOS has been resolved. The fix has been submitted to Apple and will be available to our customers shortly after it is approved. You can update to the latest version of the iOS app to fix the login issue. To update, please follow these steps: 1. Open the App Store. 2. Tap on your profile picture in the top right corner. 3. Tap on "Manage Apps & Devices." 4. Tap on "Updates." 5. Locate the "Assembly" app and tap on "Update." Once you have updated to the latest version, you should be able to log in to our app using Slack SSO without any problems. We apologize for any inconvenience this may have caused. Thank you for your patience.
We are pleased to announce that Slack is now back up and running. However, we are aware that some users are experiencing login issues on the latest version of iOS. Our team is currently investigating the issue and we will provide updates as soon as we have more information.
Slack is experiencing widespread outages that may impact your ability to log in, connect to Slack, and receive updates from Assembly to Slack. We are actively monitoring the situation and will post updates as we have more information. In the meantime, you can check the Slack status page at https://status.slack.com/ for the latest updates.
Slack.com is experiencing issues with their login/SSO which affects Assembly users who try to log in using Slack.
Report: "We're aware of a problem with loading our web application"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and fixed
We are currently investigating the issue
Report: "Flows feed not loading"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Signing up to our services is momentarily unavailable"
Last update**Issue:** Previously, while making adjustments to the way we managed erroneous behaviour within our APIs, an unexpected behaviour emerged. This led users who were navigating to the OTP screen to be redirected back to the sign-up screen. **Bug Fix and Testing:** Based on our findings, we implemented corrective measures to restore the expected behaviour. Our Quality Assurance team rigorously verified the fix to ensure its effectiveness. **Preventive measures:** To prevent similar issues from occurring in the future, we have strengthened testing procedures. We have enhanced our testing protocols to encompass a wider range of scenarios to ensure thorough validation of the API error handling functionality.
This incident has been resolved.
A fix has been implemented and we are monitoring the results
We are continuing to work on a fix for this issue.
The issue has been identified and a fix is being implemented.
Signing up to Joinassembly.com is unavailable at the moment. We are investigating the issue and a fix will be rolled out soon.
Report: "Users are redirected to an incorrect URL while logging on to their accounts"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are working on a fix and it should be deployed shortly.
Report: "Answer a flow impacted for flow creators"
Last updateAn issue in our queuing system was not allowing flow creators to answer their own flows.
Report: "Application: Template gallery not loading"
Last update**Summary** We had several users \(internal and external\) complain that the template gallery was not loading. **Impact** When users opened Template gallery it was in a loading state. Users were not able to select a template and create a new flow as a result. **Trigger** We got the incident communicated to us from the sales and support team. **Resolution** Users were advised to hard refresh the screen which loaded the template gallery. **Detection** We were unable to replicate the issue. On further analysis with our internal users who were affected, we realised the template gallery UI was not fetching the APIs. **Root causes** On further diagnosis, we found out that even after the new version of a Software bundle was pushed to browser clients to consume - the client was still pointing to the older version \(usually cleared out after the new deployment\). The root cause was further tested in a lower environment. The team is looking into possible fixes for the future since it is not a recurring scenario. **Action items** Monitors were added for this in our logging application to alert the front-end team should an error recur.
We have resolved the incident. We recommend users hard refresh their browsers should you continue to experience issues while loading the template gallery.
We are currently investigating the issue.
Report: "Slack interaction for users is impacted"
Last updateThis incident is fully resolved.
We are continuing to monitor for any further issues.
The issue has been identified and a fix has been implemented. We are currently monitoring the incident.
We are currently investigating this issue.
Report: "Login partially interrupted"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
Login is partially interrupted with some customers not able to log in and getting stuck on a loop. We are currently investigating.
Report: "MSTeams App service partially interrupted"
Last updateThis incident has been resolved.
We’re noticing that there’s a portion of our customer base that’s having issues accessing assembly via MSTeams at this time. We’re actively looking into the issue and request the affected customers to access assembly by visiting https://my.joinassembly.com where you should be able to access your account until this is resolved.
Report: "SWAG Provider service interrupted"
Last updateThis incident has been resolved.
The issue is identified by our provider and its actively been fixed
Report: "Assembly Web not responding or timing out"
Last updateAt Around 9.30am PST, our apis started timing out, after checking with duplo team on this, we got to know the main ingress controller for our k8s cluster was not reachable. On restarting that ingress nginx pod, apis started working as expected. Issue was resolved by 10am PST.
This incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
Report: "Site not loading for some pages across application"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
Report: "Degraded API Performance"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We’ve identified the cause of detected slowness. We’re working on a fix.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Assembly Degradation"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented.
Report: "Rewards failure"
Last updateThis incident has been resolved.
We are continuing to work on a fix for this issue.
The issue has been identified and a fix is being implemented.
Our Gift card provider is having internal issues and Assembly is working with them to solve it.
Report: "Assembly Degradation"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented
Users have reported slowness in page loading time for some users. We are currently investigating the issue.
Report: "Assembly Degradation"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Some users are experiencing slow load times. We are investigating
Report: "Assembly Degradation"
Last updateThis incident has been resolved.
Issue has been identified. Seems to be related to old SSL certifications cached on users personal devices. Clearing browser cache and restarting the personal device seems to solve the problem. We are investigating more to get to the root cause
Some users are experiencing issues on the main feed. We are investigating
Report: "Recognition GIF Degradation"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring
The issue has been identified and we are working on a fix
We are experiencing inconveniences while posting recognitions with GIFs. We are investigating
Report: "Cashing out Rewards Degradation"
Last updateThis incident has been resolved.
Our provider service has been restored, we are monitoring.
We are continuing to work on a fix for this issue.
We identified the issue. A provider is having issues processing: https://statusgator.com/services/tango-card
The issue has been identified. Our Provider is having issues with certain calls: https://statusgator.com/services/tango-card
Report: "Performance Degradation"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are continuing to investigate this issue.
We are experiencing some degradation on our Web and Slack services. We are investigating
Report: "Slack Degradation"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented.
The issue has been identified. Slack is having issues with certain API calls: https://status.slack.com/
Report: "Slack Degradation"
Last updateThis incident has been resolved.
Slack services are returning to normality. We are monitoring
The issue has been identified and a fix is being implemented.
Slack is currently having issues with certain API calls: https://status.slack.com/.
Report: "Slack Degradation"
Last updateThis incident has been resolved.
We are continuing to work on a fix for this issue.
Slack continuous to have issues: https://status.slack.com/
The issue has been identified. Slack is having issues with certain api calls: https://status.slack.com/
Report: "Degraded Performance on our Web and Slack applications"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are continuing to work on a fix for this issue.
The issue has been identified and a fix is being implemented.
We are experiencing some degradation on our Web and Slack services. We are investigating
Report: "Slack Degradation"
Last updateThis incident has been resolved.
On Aug 3, 4:15 PM PDT, Slack deployed fixes for the API issues. We are monitoring
The incident is still active on Slack. On our platform some users might experience delays on giving recognition through Slack, in particular if the recognition has a gif attached.
The issue has been identified. Slack is having issues with certain api calls: https://status.slack.com/2020-07/7d32ad54b0703c47