HappyCo

Is HappyCo Down Right Now? Check if there is a current outage ongoing.

HappyCo is currently Operational

Last checked from HappyCo's official status page

Historical record of incidents for HappyCo

Report: "Potential service disruption - Reporting"

Last update
identified

An upstream outage in our cloud services provider is causing an interruption in reporting and report generation. We are monitoring.

Report: "Intermittent issues loading inspections and tasks on the HappyCo mobile app"

Last update
investigating

We are currently investigating this issue.

Report: "Intermittent Failures"

Last update
resolved

This incident has been resolved.

monitoring

All services are operational. We are investigating potential DNS issues.

investigating

We are currently investigating reports of intermittent errors and failed page loading.

Report: "Due Diligence Service Requests are Delayed"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

Standard requests should be sent to dd@happy.co and include the DD Order name during this delay. Once the connection is restored, all delayed Due Diligence Service Requests will be re-synced with our ticketing system.

investigating

Due Diligence Service Requests are not moving into HappyCo’s ticket queue. This may delay our response to customer Due Diligence requests. Once the connection is restored, all delayed Due Diligence Service Requests will be re-synced with our ticketing system.

Report: "Yardi Integration Service Outage"

Last update
resolved

We have accelerated import and export jobs to catch up to a successful state across all queues, with a high rate of success. With the license in place, confirmed bidirectional data sync, and jobs caught up, we are marking this issue resolved.

monitoring

We are continuing to monitor for any further issues.

monitoring

We have deployed the updated Yardi license and verified our two-way Yardi integration is online and syncing as expected. We're now working through accelerating the data sync process to ensure data is back to immediate push and 15-minute pull.

identified

We have received an updated license from Yardi and preparing a deploy with the new value. After we have released the new license, we will initiate a sync of all data.

investigating

The Yardi license we use to perform data syncs (data import and export) has expired, resulting in no data transfer. No other PMS integrations are impacted. We have escalated to Yardi's customer support and are currently working with their support team to resolve the license issue. Once we have resolved the license expiration, we will initiate a re-sync of all data.

Report: "Issues with Work Assignment Board"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

The issue is now resolved

investigating

We have found the cause for the issue and are working on deploying a solution.

investigating

We are currently investigating this issue.

Report: "Investigating intermittent degraded performance"

Last update
resolved

Systems are restored and healthy. We are continuing to monitor.

monitoring

We are continuing to monitor for any further issues.

monitoring

Applications and services are restored and being monitored. Task-related emails are suspended. We are working to quickly restore service.

monitoring

We are working on restoring interrupted services.

monitoring

Services are recovering and we are continuing to monitor system health.

investigating

We are continuing to investigate this issue.

investigating

We are investigating possible performance degradation in some services.

Report: "Production Issues with Property"

Last update
resolved

This incident has been resolved.

monitoring

We are continuing to monitor for any further issues.

monitoring

Services are restoring and we are monitoring.

investigating

We are currently investigating an issue impacting Property related features (e.g. Property Selector).

Report: "Property provisioning unavailable"

Last update
resolved

This incident has been resolved.

monitoring

We have identified the cause and applied a fix. We are monitoring the results.

investigating

Property provisioning is currently unavailable. We are investigating and will provide an update shortly.

Report: "Task Creation Category Dropdown Misplaced"

Last update
postmortem

**Summary** A software change was deployed that introduced a bug impacting task creation. **Impacted Systems** Task creation via the Web UI was unusable due to a positioning bug that pushed category selection outside of the browser viewport. **Resolution** A patch was deployed effectively reversing the offending change, restoring functionality. **Timeline of Events** 1600 UTC: Issue reported 1841 UTC: Fix developed and tested 1916 UTC: Fix deployed and confirmed in staging 2010 UTC: Hotfix deployed to production resolving issue

resolved

This incident has been resolved.

monitoring

We've released a fix that addresses the mis-positioned category dropdown within Tasks.

identified

We've identified the changes in question, related to an upgrade of two external dependencies, which caused the rendering placement bug. We are in the process of releasing a hot-fix rolling back the version, which we've confirmed addresses the issue, with a resolution ETA of 3:15pm ET / 12:15pm PT.

identified

We're reviewing recent code changes to identify the root cause of the issue.

investigating

We have received reports of the category select dropdown displaying in the lower left-hand side of the screen, resulting in UX issues creating new tasks.

Report: "Call Management After Hours and On Call Schedule unavailable"

Last update
resolved

The service disruption on the HappyCo platform has been resolved.

Report: "Planned maintenance and downtime on Optigo Platform"

Last update
resolved

This incident has been resolved.

monitoring

Maintenance has been completed and we are monitoring the results.

investigating

We have commenced maintenance on the Optigo platform. The HappyCo Maintenance platform and all other systems are unaffected.

Report: "Scheduled Maintenance"

Last update
resolved

This incident has been resolved.

monitoring

Maintenance has been completed, and we are monitoring the results.

identified

We are conducting maintenance. Some services may be affected, including: * Happy Force ticket triaging (After Hours calls not affected) * Asset Management * Property Provisioning

Report: "Scheduled downtime"

Last update
resolved

This incident has been resolved.

monitoring

Maintenance has been completed and we are monitoring performance

investigating

We are progressing with scheduled downtime for server maintenance. HappyCo services are temporarily unavailable.

Report: "Manage experiencing degraded performance and extended load times"

Last update
resolved

This incident has been resolved.

monitoring

We are continuing to monitor for any further issues.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

We are currently investigating this issue.

Report: "Unexpected Database Downtime"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

identified

The issue has been identified and a fix is being implemented.

investigating

We are currently experiencing high disk usage within the database serving Manage.

Report: "Call Complete - Unauthorized Responses"

Last update
resolved

We have confirmed the fix on production successfully resolved the 401 Unauthorized error. All interactions within Call Complete in Manage should be working as expected. Again, this was a staff-only facing issue. All IVR services went unaffected.

identified

We've validated the hotfix is working in a staging environment and are releasing shortly.

identified

We've identified a solution and are working to release a hotfix to address this issue.

identified

Call Complete is currently experiencing a partial outage for property staff attempting to access via Manage. Call Complete standalone customers are unaffected. Property operations, IVR interactions, and tasks creation is unaffected.

Report: "Yardi Integration Service Outage"

Last update
resolved

We have successfully re-run outstanding failed jobs.

monitoring

We have completed working through asset import/export as well as task export failures, and now moving onto task import failed jobs.

monitoring

We are continuing to work through the backlog of previously failed API requests and making steady progress.

monitoring

We've implemented a fix and are currently working through the backlog of failed API calls to bring our data up-to-date across all Yardi instances.

identified

This outage currently only affects Yardi; no other PMS integrations are impacted.

investigating

We are currently investigating this issue.

Report: "Call Complete Web Interface Unavailable"

Last update
resolved

This incident has been resolved. Thank you for your patience.

monitoring

A fix has been implemented, and we are monitoring the results.

identified

We have identified the issue and are investigating.

investigating

Customers are unable to access features of Call Complete via the web. We are actively investigating this issue.

Report: "Degraded system performance"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

We are currently experiencing degraded performance across our API's and services. Customers will experience intermittent failures to requests to HappyCo systems.

Report: "Uncheduled maintenance"

Last update
resolved

This incident has been resolved.

monitoring

We are continuing to monitor for any further issues.

monitoring

A fix has been implemented and we are monitoring the results.

identified

The issue has been identified and a fix is being implemented.

Report: "Insights is experiencing degraded performance"

Last update
resolved

This incident has been resolved.

identified

The issue has been identified and a fix is being implemented.

Report: "Insights is experiencing degraded performance"

Last update
resolved

This incident has been resolved.

investigating

We are currently investigating this issue. Insights is currently out of sync and some dashboards may not be presenting live data.

Report: "Increased error rates"

Last update
resolved

This incident has been resolved.

monitoring

The upgrade has been completed and we are monitoring the results.

identified

Upgrade is in progress - services will be unavailable briefly during this time.

identified

We have identified a cause, and have scheduled a priority upgrade at 2:00am EST. During the upgrade, the system will be offline for approximately 15 minutes.

investigating

We are receiving reports of increased error rates across our services. We are currently investigating.

Report: "Report downloading issues"

Last update
resolved

This incident has been resolved.

identified

We are aware of an issue preventing users from downloading newly created reports. We have determined the cause of the issue and are working on a resolution. Please note that pre-existing reports are unaffected.

Report: "Insights is experiencing degraded performance"

Last update
resolved

This incident has been resolved.

monitoring

We are continuing to monitor for any further issues.

monitoring

A fix has been implemented and we are monitoring the results.

identified

The issue has been identified and a fix is being implemented.

investigating

We are currently investigating this issue.

Report: "HappyCo Platform Unavailable"

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

Our teams are aware of the issue and are working to restore service as quickly as possible

Report: "Scheduled outage - planned maintenance"

Last update
resolved

Maintenance has been completed. All services are restored

investigating

We are continuing to investigate this issue.

investigating

HappyCo services are currently down to allow for planned maintenance to be completed. Services will be restored shortly.

Report: "RealPage integrations are down."

Last update
resolved

This issue has been resolved.

Report: "Yardi integrations are down."

Last update
resolved

This incident has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

identified

The issue has been identified and a fix is being implemented.

investigating

We are currently investigating this issue.

Report: "Unable to share properties when using business inspection templates"

Last update
resolved

Some customers were experiencing issues with templates and are unable to assign business templates to properties. The issue was limited to a small subset of customers with Business Templates enabled. This incident has been resolved. We’ve implemented the solution, and our customers are no longer experiencing this issue. We’re really sorry to have held up customers today!

investigating

Some customers are experiencing issues with global templates and are unable to assign new templates to properties. We're aware of the issue and are working on it urgently. This does not affect any templates that have already been assigned and does not affect creating and completing inspections. We're really sorry to be holding you up today! Please know our teams are working hard to get everything up and running, and we will update you in 1 hour with the latest information.

Report: "Mobile App"

Last update
resolved

This incident has been resolved.

investigating

Companies that have been migrated to Global templates are unable to start scheduled inspections on their devices

Report: "Potential service disruption"

Last update
resolved

The service disruption on the HappyCo platform has been resolved.

investigating

We are continuing to investigate this issue.

investigating

Dashboards in Happy Manage may not be working

investigating

We've seen a potential disruption in the HappyCo platform. We're investigating it!

Report: "Problem opening inspections in mobile apps"

Last update
resolved

This incident has been resolved.

investigating

We are continuing to investigate this issue.

investigating

A few customers may be unable to open scheduled inspections on their mobile device, receiving an error message: "infrastructure. network error 0"

Report: "Potential service disruption"

Last update
resolved

The service disruption on the HappyCo platform has been resolved.

investigating

We've seen a potential disruption in the HappyCo platform. We're investigating it!

Report: "Delayed delivery of some email"

Last update
resolved

This issue is fully resolved.

monitoring

The fix to the root cause has been deployed, and this will be monitored over the next week to ensure that no further issues arise.

identified

The root cause has been identified and a fix will be rolled out soon. In the meantime the backup solution is being monitored to ensure email operations contribute as normal.

identified

Emails are now being processed and sent out. We are investigating the root cause of issue.

investigating

We are investigating the issue.

Report: "Temporary outage"

Last update
resolved

20 minutes down - error connecting to primary database

Report: "Temporary Outage"

Last update
resolved

We had a temporary outage this morning due to a database issue. It has been resolved.

Report: "Intermittent issues with integrations"

Last update
resolved

Issue has now been resolved

monitoring

Engineering have have applied a fix and we are now monitoring all integrations

investigating

We are currently investigating reports of issues with some of our integrations. We will update as more information available.

Report: "Gray screen appearing on login to management portal"

Last update
resolved

Roughly a 5 minute outage due to an incorrect deployment

Report: "HappyCo website outage"

Last update
resolved

Our primary website happy.co experienced a 12-hour outage overnight. We've made some changes and added additional monitoring that should help prevent this occurring again. This outage did not affect any of our mobile or web applications (manage.happyco.com).

Report: "Degraded Performance"

Last update
resolved

Engineering confirm issue now resolved

monitoring

Performance has been restored and engineering are monitoring the situation

investigating

Engineering team are investigating an incident with parts of our service.

Report: "Reduced Performance on Happy Manage"

Last update
resolved

This incident has been resolved.

monitoring

An update to our backend has been released. Engineering are continuing to monitor performance of all systems.

identified

Engineering have identified performance issues with some parts of Happy Manage and are working on a fix. Customers may experience delays on page loads and potentially some timeouts. If affected, continue trying, or return later, if possible. Please monitor this page for updates.

Report: "Intermittent Loading Issues"

Last update
resolved

We've rolled back our latest release which caused some intermittent loading issues.

Report: "Temporary Outage"

Last update
resolved

1 minute outage due to connection issue

Report: "Dashboards unavailable"

Last update
resolved

Issue with dashboard vendor was resolved

investigating

We are currently investigating this issue.

Report: "Temporary Outage"

Last update
resolved

This incident has been resolved.

monitoring

A connection issue caused a temporary outage of around 5 minutes. We're monitoring now.

Report: "Dashboards are temporarily unavailable"

Last update
resolved

A fix has been deployed. We'll be monitoring for 24 hours to ensure all dashboards are working as expected.

identified

A fix is being prepared for deploy.

identified

The issue has been identified and a fix is being implemented.

Report: "Temporary Outage"

Last update
resolved

A slow down of request processing this morning required us to make upgrades to our infrastructure resulting in around 3-4 minutes down time.

Report: "Routing Error"

Last update
resolved

100% message delivery failure to our upstream resulted in around 15 minutes of downtime.

Report: "Photo uploads will not complete"

Last update
resolved

The AWS S3 issues have been resolved and all our services appear to be running smoothly again.

identified

Existing photos and PDFs are available again. Photo uploads and PDF creation is still unavailable.

identified

PDF and photos still unavailable due to upstream outage.

identified

Our upstream photo host is currently having issues. Service should resolve normally once they've resolved their issues. https://status.aws.amazon.com

Report: "Temporary Outage"

Last update
resolved

This incident has been resolved.

monitoring

We experienced a temporary outage lasting approximately 5 minutes during a routine upgrade.