Historical record of incidents for BreezeChMS
Report: "Issues sending texts through Breeze"
Last updateOur Engineering teams have been able to confirm the resolution of this issue and that texting is working as expected now. Thank you for your patience!
We've identified the source of the issue and we're working on a solution.
We are seeing that texting through pages such as tags or outside of the people beta is not working, however texting from inside of the People beta page is working as expected.
Our team is aware of an issue when sending texts through Breeze. We're investigating and will update here.
Report: "Issues viewing Breeze email history"
Last updateDuring overnight work our Engineering teams were able to solve the issues causing the "pending" status to show incorrectly for delivered emails and we are seeing this status reflect as expected for emails sent on Tuesday. Due to the nature of the issue, the status for emails sent Friday through Monday could continue to show the "pending" status incorrectly. Our teams are continuing to do further work to return visibility of historical email history beyond the last 30 days.
Our teams have continued to work on resolving the visibility of historical email sends as well as the correct deliverability reports for current emails. Currently the last 32 days of email history is present, and emails sent starting Friday will show a "pending" status although they were successfully sent.
Our emails are sending and functional at normal levels once more. While we are continuing to monitor the stability of Breeze pages today, our team is aware of the Email History only showing the last 30 days of sends. We are working to bring those back into your views.
While we are continuing to monitor the stability of Breeze pages today, our team is aware that some Breeze emails have been delivering multiple times over the past 24 hours. While we are monitoring the resolution, it is likely that today's sent or scheduled emails could be potentially delayed to send.
We have identified the root cause and have found Breeze pages are loading as expected again. We will continue to monitor the results throughout the day. We are also continuing to closely monitor incidents where emails have sent multiple times.
We are currently investigating an issue that is affecting loading Breeze pages. We will be sharing additional updates here as available.
Report: "Issues sending texts through Breeze"
Last updateOur Engineering teams have been able to confirm the resolution of this issue and that texting is working as expected now. Thank you for your patience!
We've identified the source of the issue and we're working on a solution.
We are seeing that texting through pages such as tags or outside of the people beta is not working, however texting from inside of the People beta page is working as expected.
Our team is aware of an issue when sending texts through Breeze. We're investigating and will update here.
Report: "Issues viewing Breeze email history"
Last updateDuring overnight work our Engineering teams were able to solve the issues causing the "pending" status to show incorrectly for delivered emails and we are seeing this status reflect as expected for emails sent on Tuesday. Due to the nature of the issue, the status for emails sent Friday through Monday could continue to show the "pending" status incorrectly. Our teams are continuing to do further work to return visibility of historical email history beyond the last 30 days.
Our teams have continued to work on resolving the visibility of historical email sends as well as the correct deliverability reports for current emails. Currently the last 32 days of email history is present, and emails sent starting Friday will show a "pending" status although they were successfully sent.
Our emails are sending and functional at normal levels once more. While we are continuing to monitor the stability of Breeze pages today, our team is aware of the Email History only showing the last 30 days of sends. We are working to bring those back into your views.
While we are continuing to monitor the stability of Breeze pages today, our team is aware that some Breeze emails have been delivering multiple times over the past 24 hours. While we are monitoring the resolution, it is likely that today's sent or scheduled emails could be potentially delayed to send.
We have identified the root cause and have found Breeze pages are loading as expected again. We will continue to monitor the results throughout the day. We are also continuing to closely monitor incidents where emails have sent multiple times.
We are currently investigating an issue that is affecting loading Breeze pages. We will be sharing additional updates here as available.
Report: "Slowness in loading pages in Breeze"
Last updateWe have identified that the issue is related to an error with a third party service provider. This has been solved and we'll continue to monitor page response times and performance through the weekend.
We're seeing significant improvement, however our team is continuing to monitor.
We are investigating an issue where pages are being slow to load in Breeze.
Report: "Issues with Automated Volunteer Reminders"
Last updateOur teams have confirmed that this is resolved and reminders scheduled to send are being queued now. If for some reason you see that your reminders have not sent as expected in the next 8 hours, it is safe to manually send. Thank you for allowing us to serve you, and we're sorry for the troubles caused.
Our teams have released a fix and we're seeing that volunteer reminders are sending through as expected now.
We've identified the cause of the issue and are working on the resolution.
While our teams are continuing to investigate this, we are also reviewing the options to resend volunteer reminders that should have sent yesterday or today.
Our various teams are currently investigating reports of volunteer reminders not being sent at the end of this week. We will be sharing additional updates here.
Report: "Extended Maintenance Period"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented.
We are currently investigating an issue that has caused us to prolong our maintenance period.
Report: "Issues with form fields not showing on mobile"
Last updateWe’re happy to report this is fully solved and all form fields are showing as expected on mobile devices.
We have identified the source of this issue and are working to release a fix now.
Our teams are aware of an issue occurring that is preventing all form fields to show when on mobile. Our Engineering teams are currently investigating this.
Report: "Form Entries not loading"
Last updateOur team solved the troubles affecting form entries. Thank you for your patience as we handled this!
A release is going out now that will solve the issue accessing form entries.
Our team has identified the issue and is working on solving this.
We are investigating an issue with form entries not loading in accounts.
Report: "Errors when editing people pages"
Last updateWe are happy to report that this is fully solved by our Engineering team, and while we will be closing this incident our teams will continue to monitor systems and reporting.
We have released a fix and are seeing things return to normal, however we are still monitoring.
Our Engineers have identified this and are working to release a solution.
We are aware of some customers seeing errors when editing People records along with generating some Giving reports. Our Engineering team has been engaged already and is working to resolve this.
Report: "Issues loading People page for some customers"
Last updateOur team has successfully resolved this and all people pages should be loading as expected.
The resolution of this issue will require a brief period of up to 30 minutes where viewing the People page, People's profiles and the sending of SMS will not work as expected. Our Engineering teams are anticipating beginning this at 12:30 Pacific and are not anticipating any additional affects.
We are aware of an issue where some customers are not able to see their list of People. Our Engineering teams have been working on this and are working to implement the solution now.
Report: "People Filter not being respected // Fund Issues"
Last updateOur Engineering team has resolved the issue affecting people filtering as well as funds.
We are releasing a fix for these issues now.
We have identified the issues and are working on a release that will solve them.
We are expanding this incident to also include issues with funds not loading when attempting to add a contribution as well as the inability to edit a fund.
We are aware of an issue where filtering people and then taking actions on the filter is not being respected. Our teams are working on this.
Report: "Emails routing to spam"
Last updateOur teams are continuing to see improvement in email deliverability and while we are marking this as resolved, we will continue to monitor systems to ensure that there are no further issues.
We have implemented a few configuration changes that seem to be reducing the number of Breeze messages detected as spam. The nature of these updates means changes are likely to take effect over several hours, and our team is monitoring to ensure we continue to see improving deliverability.
Our teams have been investigating reports of emails to Gmail users suddenly being sent to spam, as well as Outlook users receiving warnings on all links. While this appears to be an issue external to Breeze, we are continuing to investigate this to ensure emails are sending correctly for all customers.
Report: "Issues viewing pledges and editing transactions"
Last updateOur teams have solved these specific issues as well as one affecting directory exports.
We've identified the source and are working on implementing changes now
We are aware of an error when attempting to view pledge details as well as when editing transactions. Our Engineers are already investigating this.
Report: "Issues adding People within the People Beta (and other actions)"
Last updateOur Engineering team has confirmed that this is fully resolved. Thank you for your patience!
We have released a fix to the issue and we are seeing things return to normal. Our teams are continuing to monitor this before declaring this to be resolved.
We've identified the source of the issue and also that while an error may appear the action is being completed and can be seen if you refresh your page.
We are aware of an issue that is causing an error when attempting to add People, Tags, Giving and other pages. Our team is actively working on this now.
Report: "Issues attempting to load profiles with no photo"
Last updateAfter several hours of additional monitoring we are closing this incident.
While everything is working as expected now, we will keep this incident open for a bit longer as teams monitor.
We've implemented a fix and these profiles are loading as expected now. We're continuing to monitor this to ensure there are no other troubles.
We have identified the source of the issue and are working on a solution. We can confirm that all people records are present and there is no data missing.
Our team is aware of an issue affecting the loading of profiles with no photo and we are working to resolve this now.
Report: "Issues with adding or updating information within Breeze"
Last updateThis incident has been resolved. Adding and/or updating certain information pieces within Breeze should be functioning as expected.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are seeing an issue affecting the adding and/or updating certain information pieces within Breeze. Our teams are working on this right now.
Report: "Issues sending emails"
Last updateWe’re back! Emailing from all areas of Breeze should be working correctly. Thanks for bearing with us.
Our Engineering team has identified the issue and is preparing a release.
We are working to resolve an issue affecting the sending of emails through Breeze. Email sending is working correctly through People Beta, but other areas are currently experiencing issues.
Report: "Issues with sign ups"
Last updateAll issues affecting the Online Giving page and signup are now resolved.
As we are further investigating, we have identified the issue to be a third party partner. We are continuing to investigate
We are investigating an issue affecting signups with Breeze. O
Report: "Issues with embedded calendars"
Last updateWe’re back! Issues with embedded calendars are now resolved. Thanks for bearing with us.
The process to resolve this has been delayed due to a third party provider (GitHub) having issues with several actions. We are continuing to work to get this solved.
Our Engineering team has identified the source of the issue and is working on resolving this now.
We are investigating an issue that is affecting calendars embedded on websites.
Report: "Issues with Mailchimp Extension"
Last updateThe issue affecting the Mailchimp extension has been fully resolved by our Engineering teams.
Our team has identified the issue and are nearly complete with implementing it.
Our Engineering team is working on an issue that is affecting the MailChimp extension from Breeze.
Report: "Issues loading People along with some other Breeze pages"
Last updateWe are seeing that pages are loading correctly. Our Engineering team will continue to work to solve a few small items they've located, however we will be marking this as resolved. Please reach out to our Support team (support@breezechms.com) if you need any assistance!
The issue affecting the loading of the People page has been solved. We will be continuing to monitor this.
Our Engineering team has identified the troubles and they are working on a release to resolve this.
Our Engineering teams are actively working on an issue affecting the loading of People within People Beta as well as other pages like Bills and Payments.
Report: "Emails not sending through Breeze"
Last updateWe’re back! Breeze Email service should be up and running. Our Email sending provider (SendGrid) has resolved the issue on their end, and all messages from Monday, April 8 have now been sent.
This issue is ongoing and we are working with our Email Sending provider (SendGrid) for assistance in resolving this. It is possible that we will not have an update until tomorrow morning.
We have identified the root cause of this issue and we believe that the emails will send out, albeit with a delay. We will update this page as we have more information.
We are investigating issues with email sending through Breeze.
Report: "Delays in SMS delivery"
Last updateOur SMS provider is reporting that messages are sending as expected at this point. Our teams will continue to monitor this to ensure there are no needed actions from our Engineers.
Our SMS provider is reporting that they've solved the issue affecting SMS delivery and are seeing improvement. We will continue to monitor this.
Our teams are aware of an issue affecting SMS delivery (Breeze texting and text giving) due to an issue with our provider, Twilio. We are monitoring their response closely and will update here as needed.
Report: "Troubles access People Beta and other errors"
Last updateWe've fully resolved the troubles here. Thanks for your patience!
Our teams have identified the cause of this and have implemented a fix. We are seeing access to the various pages working as expected now.
We are aware of issues with a few feature of Breeze including accessing People Beta as well as Integration Errors. Our Engineering team has been investigating today, but we are escalating to an incident for more visibility.
Report: "Degraded performance across pages"
Last updateWe have seen improved performance through the day today so we are marking the incident as resolved on this incident. Our Engineering teams are continuing to work on this and we will be continuing until we are confident.
While we have seen increased performance and speed this afternoon and evening, we will keep the status at the degraded level and continue to provide updates as often as possible.
We are aware of decreased performance across Breeze pages. Our team continues to work on solving the root cause of these troubles.
Report: "Pages loading slowly in Breeze Giving & People"
Last updateThis incident has been resolved, but our team will continue to monitor Breeze pages throughout the week
The issue has been identified and a fix is being implemented.
We are continuing to investigate this issue.
We're currently investigating slowdowns related to loading Breeze contribution and people pages
Report: "Slow responses with Breeze"
Last updateWe are seeing improvement across Breeze so we’re closing this incident. Thank you for your patience!
Our Engineering teams have been monitoring site performance, however we have seen a degradation through the day where we are opening a public incident. We will be continuing to work through the slow responses to improve things.
Report: "Degraded speeds within Breeze"
Last updateOur Engineering teams have worked through the day to implement beneficial changes and address issues. We have seen improvement and we will continue to be working to resolve any troubles.
Our Engineering teams are aware that page loads are slower in some areas of Breeze. Those teams have been actively working to solve these troubles. These slowdowns are related to very high system loads. While the work to fully resolve this is ongoing, we did want to create this incident to communicate that we are aware of the troubles and are actively working to mitigate the negative affects on our customers.
Report: "Breeze pages loading slowly"
Last updateWe’re back! Pages are loading at normal speeds. Thanks for bearing with us.
We're starting to see pages load at a more normal speed. We're continuing to monitor.
We have reports of several Breeze pages loading slowly. Our team is currently investigating.
Report: "Breeze Emails are not loading"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating the issue
Report: "Slower Load Times in Breeze"
Last updateThis incident has been resolved but we'll continue to monitor throughout the week
We are continuing to work on a fix for this issue.
Our engineers have identified the cause and working toward a permanent solution to resolving slow page-loading
We're seeing slower load times across pages within Breeze. Our team is currently investigating.
Report: "Slower Load Times in Breeze"
Last updateWhile we are still seeing high loads on the platform, we are seeing page speeds return to normal and we are closing this incident. As always, our teams are keeping a close eye on things and you can reach out to our Support teams if you need anything!
Our team continues to investigate and monitor site performance. We are seeing improvement through the day.
We're seeing slower load times across pages within Breeze. Our team is currently investigating.
Report: "Issues loading pages within Breeze"
Last updateThis is resolved and pages are loading as expected now. Our Engineers are working diligently to improve loading speeds on days with a higher than normal usage.
Our Engineering teams are aware of the trouble and are working to get this fully resolved. We should see speeds return to normal in less than one hour.
We are investigating an issue with certain pages loading within Breeze (namely Funds / Pledges)
Report: "Error when printing check in labels"
Last updateWe are happy to report that this has been successfully resolved and check in labels are printing as expected now. Happy Thanksgiving to all (and especially to our Product and Engineering teams for solving this today)!
Our Engineering team has identified the issue and they are working to deploy a fix now.
Our team is investigating an issue affecting the printing of check in labels. We will have more information to share soon.
Report: "Pledge / Fund pages loading slowly"
Last updateWe are happy to report pages are loading significantly faster and that we are marking this incident as resolved, however we will continue to monitor this closely.
We have deployed a fix and we are seeing page speeds return to normal. We will continue to monitor loads and speeds.
Our Engineering team continues to work on the root cause of this slowdown affecting those pages.
We're investigating an issue where the pledge reporting and fund pages are loading very slowly within Breeze.
Report: "Investigating Degraded Performance for Breeze"
Last updateThe pages that were not loading within Breeze should be up and running. Thank you for your patience!
We’ve identified a current root cause and are working quickly as we can. We’ll share another update shortly.
We are investigating issues loading specific pages within Breeze.
Report: "Troubles signing up for Breeze / Accessing Mailchimp Extension"
Last updateOur teams have resolved the issues here and we're seeing that everything is working as expected now.
Our Engineering teams are continuing to work, however we are able to report signups and access to Mailchimp extension is working. We are investigating an issue affecting exports and this should be resolved soon.
We've identified the issue and are working on releasing a fix right now.
We have identified that this issue is also affecting the signing up of new Breeze accounts so we've updated this incident accordingly.
We are investigating an issue affecting the loading of the Mailchimp extension within Breeze
Report: "Investigating Some Breeze Pages Not Loading As Expected"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We’re noticing slow response times with loading some pages within Breeze for some users. We’re investigating the root problem right now. We’ll continue to share updates on our progress as we resolve this issue.
Report: "Issues sending attachments through new basic email editor"
Last updateThis has been resolved. Our Engineers will continue to monitor and ensure things continue to process as expected.
Our Engineers have deployed a change and we're seeing that attachments are working as expected.
We've identified the source of the issue that is affecting attachments for all emails using the new editors and are working on a change now.
Our team is investigating an issue where email attachments are not sending correctly through the (new) basic email editor. Our current workaround while the team is working to resolve this is to use the legacy email editors.
Report: "Investigating Breeze pages not loading as expected"
Last updateAll Breeze Pages should be up and running as expected. Thank you for your patience!
The Breeze Pages that were experiencing slow load times are now loading as expected. We’re monitoring it closely to verify all issues are fully resolved. We’ll share another update shortly.
The issue has been identified and a fix is being implemented.
We’re noticing slow response times with loading some pages within Breeze for some users. We’re investigating the root problem right now. We’ll continue to share updates on our progress as we resolve this issue.
Report: "Issues loading pages within Breeze"
Last updateWe have deployed a fix for specific pages not loading in Breeze. Thank you for your patience!
The page loading issue has been identified, and a fix is being worked on.
We are investigating issues loading specific pages within Breeze.
Report: "Investigating Degraded Performance for Breeze Event Calendars"
Last updateOur Engineers have released a fix and Breeze Calendars should be up and running. Thanks for bearing with us!
We’ve identified the issue causing the problem and are working to fix this as quickly as we can. We’ll share another update shortly.
We’re noticing calendar events in Breeze are not loading for some users. We’re investigating the root problem right now. We’ll continue to share updates on our progress as we resolve this issue.
Report: "Issues logging in"
Last updateThis issue has been resolved and we can confirm logging in works as expected now.
Our teams have identified the issue and are working to correct the issue right now.
We are investigating issues with logging in to Breeze. Our Engineering team is engaged now.
Report: "Issues loading Breeze pages"
Last updateWe have fully resolved this issue. Thanks for hanging in with us!
Our Engineering teams are working on deploying a fix right now
We're continuing to work on resolving this.
We're continuing to investigate this, but seems to be a more narrow issue.
We are investigating an issue loading certain Breeze pages.
Report: "Delays in email sends"
Last updateOur teams have resolved the issues with email delivery speeds, however they will continue to monitor through the day.
We're investigating an issue that is causing delayed sends in email sends for Breeze.
Report: "Issues with external calendars within Breeze"
Last updateWe've resolved the issue causing the event loading problems.
Our Engineers have identified the cause of this issue and they are working on a resolution now.
Our Engineering teams are investigating an issue affecting the view of external calendars within Breeze. As a current workaround, unchecking these calendars will allow other calendars to load as expected.
Report: "Issues loading events in Breeze"
Last updateWe are happy to confirm that things are fully resolved with the loading of events! Thank you for your patience as we worked through this today.
We have confirmed that event pages are loading as expected, however we will continue to monitor performance.
We've identified the issue and are releasing an update that should resolve this.
Our Engineers are currently working to resolve an issue causing troubles loading events within Breeze.
Report: "Issues loading Breeze events due to permissions"
Last updateOur Engineering team has successfully resolved the issues causing event to not load for some users. Thank you for your patience as we worked throughout today to ensure this was working correctly for you!
Our Engineering teams continue to work on resolving the issue affecting events.
Our Engineering team has identified the issue affecting Event permissions and they are working to resolve this now.
We are investigating an issue causing events to fail to load for certain users with a certain set of permissions.
Report: "Investigating Degraded Performance for Breeze Events"
Last updateThis has been fully resolved by our Engineering teams. Thank you for your patience!
We have resolved the issue and are seeing Events load as expected now.
We are continuing to work on a fix for Breeze Events. The team is fully engaged and working. We'll share another update shortly.
We are continuing to work on a fix for Breeze Events.
We’ve identified the issue causing the problem and are working to fix this as quickly as we can. We’ll share another update shortly.
We’re noticing slow response times and/or inability to load Events for some users. We’re investigating the root problem right now. We’ll continue to share updates on our progress as we resolve this issue.
Report: "Issues loading Breeze Online Giving and Breeze Forms"
Last updateThis issue has been fully resolved and all pages are loading correctly again. Thank you for your patience!
We have identified the cause of the issue and are working to resolve this now.
We are investigating an issue affecting the loading of Breeze Forms and Breeze Online Giving
Report: "Issues loading Breeze pages"
Last updateWe have confirmed full resolution of this issue.
We’ve identified the issue and are seeing pages load normally again.
We are investigating issues with certain Breeze pages loading. Our Engineering teams are already working to investigate and resolve this.