Historical record of incidents for Matillion Services
Report: "Hub is down"
Last updateThe issue has been identified and a fix is being implemented.
We are aware of an issue where customers are unable to select their account when logging in or when trying to switch between accounts. Direct links to an account are still operational, and all scheduled pipelines are unaffected.
Report: "Pubic API: 403 forbidden error returning when attempting to write or list secrets"
Last updateWe are currently investigating this issue.
Report: "Designer: Users unable to access any projects"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Snowflake loading error"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented.
Components: Customers may experience the below error whilst loading into Snowflake. Unable to load data to output: No value present
Report: "Designer: Intermittent issues with the Git Integration when using GitHub"
Last updateThis incident has been resolved.
Users may experience intermittent issues with the Git Integration when using GitHub. This is due to an issue with a third-party provider
Report: "Designer: Intermittent issues with the Git Integration when using BitBucket"
Last updateThis incident has been resolved.
Users may experience intermittent issues with the Git Integration when using BitBucket. This is due to an issue with a third-party provider
Report: "Issue with Snowflake Cortex AI component within Data Productivity Cloud"
Last updateThis incident has been resolved.
Impact: Users of the Snowflake Cortex components may experience disruptions in specific functions during runtime and validation. Current Status: Our team is actively working with Snowflake support to diagnose and resolve the issue as quickly as possible.
Report: "Data Productivity Cloud - Pipeline execution is stalled within EU Region"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Scheduler Service: Schedules that have been created for any pipeline that is within a folder in the last 4 days may not be executing when the scheduled time occurs."
Last updateThis incident has been resolved.
Please note that schedules created between 12-Nov 15:00 and now will need to be edited to reselect the pipeline (you should now see the subfolders). Any new schedules created moving forward will work fine. Existing schedules were never impacted.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Account administration issue affecting a small group of customers"
Last updateThis incident has been resolved.
We are continuing to work on a fix for this issue.
Identified - The issue has been identified, and a fix is being implemented.
Report: "Scheduler: Some scheduled pipelines running an hour earlier in regions which observe daylight savings times (DST)"
Last updateThis incident has been resolved. To fix existing schedules please follow these instructions: https://support.matillion.com/s/article/DPC-Schedules-not-adhering-to-Daylight-Savings-Time-DST
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Designer: Unable to add custom connectors to pipelines"
Last updateThis incident has now been resolved and is now operational.
Issue has currently been identified and fix is currently being implemented
This issue is currently being investigated
Report: "GIT Integration issues"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results
We are continuing to investigate this issue.
Users in US and EU regions may be experiencing issues with GIT actions
Report: "Hub Billing: Customers intermittently unable to report on credit usage"
Last updateThis incident has been resolved.
We are currently testing and rolling out a solution for this issue.
We are currently testing and rolling out a solution for this issue.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
Some customers may experience errors when trying to report on current or historical credit usage from the Hub
Report: "Matillion Website is down Service Unavailable"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Unable to run any pipelines in projects containing Flex connectors"
Last updateThis incident has been resolved.
Report: "Customers may be experiencing issues reaching some BYOG branches"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
This issue has been identified and a fix is being implemented.
Report: "Projects unavailable within US region"
Last updateThe incident has been resolved.
Users in US locations may experience issues accessing projects
Report: "Lineage issue in EU region"
Last updateThe incident has been resolved.
We are currently experiencing an issue with lineage in the eu region
Report: "Issue with Snowflake Cortex Components within Data Productivity Cloud"
Last updateThis incident has been resolved.
Snowflake's engineering team has identified a fix for the issues and is working on pushing it to production.
Impact: Users of the Snowflake Cortex components may experience disruptions in specific functions during runtime and validation. Current Status: Our team is actively working with Snowflake support to diagnose and resolve the issue as quickly as possible. We are committed to minimizing any disruptions and ensuring that normal service is restored promptly.
Report: "HUB: Unable to Setup Trial Snowflake warehouses and a perpetual loading screen is shown"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Designer: Slow performance for projects with more than 50 pipelines"
Last updateThis incident has been resolved.
We are continuing to work on a fix for this issue.
The issue has been identified and a fix is being implemented.
Report: "Designer: Unable to successfully validate the Fixed Iterator component Iteration Values (execution is unaffected)"
Last updateThis incident has been resolved.
Users will experience an issue where they are unable to validate the “Iteration Values” parameter in the Fixed Iterator component at design time. This issue is currently being investigated. Execution of existing pipelines will be unaffected.
Report: "Degraded experience in designer for databricks customers"
Last updateThis incident has been resolved.
A small number of our Databricks customers will be affected, We should have this resolved as soon as possible.
Report: "Designer: Unable to Access oAuth Configurations"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Ongoing outage impacting runtime and design time development"
Last updateThe situation has been resolved in both the US and the EU.
The issue has been identified and a fix is being implemented.
The situation is currently developing, and an investigation into the cause of the outage is ongoing.
Report: "Hub accounts receiving 500 return code when trying to access projects"
Last updateThis incident has been resolved.
We are currently investigating this issue
Report: "Unable to deploy new agents for data productivity cloud"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are continuing to work on a fix for this issue.
We are continuing to work on a fix for this issue.
The issue has been identified and a hotfix is currently being worked on
Report: "Google ADs Query: [403] The caller does not have permission. Developer token is not allowed with project ''."
Last updateWe have identified the issue and published a knowledge-based article for our customer base to resolve this issue using the workaround suggested in the article. Please refer to the link - https://support.matillion.com/s/article/ERROR-Google-Ads-Query-403-The-caller-does-not-have-permission-Developer-token-is-not-allowed-with-project
We have identified the issue and published a knowledge-based article for our customer base to resolve this issue using the workaround suggested in the article. Please refer to the link - https://support.matillion.com/s/article/ERROR-Google-Ads-Query-403-The-caller-does-not-have-permission-Developer-token-is-not-allowed-with-project
We are continuing to work on a fix for this issue.
We are continuing to work on a fix for this issue.
The issue has been identified and a fix is being implemented.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "(EU) : Matillion Hosted Agents - No Agent instances available"
Last updateThis incident has been resolved.
This issue has been mitigated.
We are continuing to work on a fix for this issue.
We are continuing to work on a fix for this issue.
Restarting Agents..
Agents version reverted
We are continuing to work on a fix for this issue.
Agents version mismatch
We are currently investigating this issue.
Report: "HUB Login issue due to Auth0"
Last updateThis incident has been resolved.
Auth0 has confirmed on the status page that they have applied the fix and monitoring the issue
We are continuing to work on a fix for this issue.
The issue has been identified and a fix is being implemented.
Report: "Query Result to Scalar Component: Issue with variable resolution"
Last updateThe Query Result to Scalar Component issue has been resolved, and it is now working as intended.
Query Result to Scalar Component prints no Value. The issue has been identified and a fix is being implemented.
Query Result to Scalar Component prints no Value. We are currently investigating the issue.
Report: "Ongoing outage within EU production causing pipelines and schedules to fail execution."
Last updateThe issue has been resolved, and service has been restored.
Service recovery is currently underway.
Engineering teams are currently investigating.
Report: "Our engineering teams are currently investigating an issue of Agent status "UNKNOWN""
Last updateThe issue has been resolved and it has been confirmed that no more UNKNOWN agent statuses
We are continuing to work on a fix for this issue.
Investigation is going on.. we have a backlog of messages on Agent Manager which is preventing the agents from updating their status to RUNNING.
We are currently investigating this issue.
Report: "Ongoing investigation into hub billing outage impacting Matillion ETL"
Last updateThe issue has been resolved; if any of your instances are in an unlicensed state; a restart is required to ensure the continued usage of Matillion ETL.
The resolution has been determined; clients may need to restart their Matillion ETL instances to become in a licensed state once again.
Our engineering teams are currently investigating an outage within the hub billing platform for Matillion ETL.
Report: "DPC - Cannot create or read secrets in region EU1"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We have applied a fix and are currently monitoring.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Matillion Data Load User interface unavailable"
Last updateUsers within US region operations have been restored.
Users within EU operations have been restored, and work continues for the US region. Updates to follow.
Users within the US and EU will currently be experiencing an outage within the Data Loader Web Application. The issue has been identified, and work is ongoing to mediate the ongoing impact.
Report: "DPC: Issue running and publishing pipelines"
Last updateThis incident has been resolved.
Issue appears to be related to EU region only.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Potential inaccuracies in billing data"
Last updateThe incident has been resolved, and billing systems are back live and processing new events. There are ongoing activities to ensure the billing data integrity throughout the incident. This only impacted US region customers between the 22nd and 29th of November; impacted customers may notice billing information gaps for this duration. This only impacted the following products: Data productivity Cloud: - Orchestration - Transformation - Batch - CDC Matillion Dataload: - MDL Batch No impact on the following products: Matillion ETL Matillion CDC
The incident has been identified, a fix is in place, and active monitoring is occurring. There may be some data inaccuracies with billing events in the US region from November 22nd to December 7th. Billing events from now moving forward should remain accurate.
A fix is in place, and we are continuing to monitor for further issues.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
Report: "No Agent Connections to Data Loader Platform in us-east-1"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Severe third-party outage: Matillion service unavailable"
Last updateMatillion has observed the platform returning to regular behaviour post-deployment of resolution by third parties.
Third-party has deployed a fix for the identified issue, and Matillion is actively monitoring the platform.
Third-party has identified the issue and is working to mitigate the downstream impact.
The issue has been identified and a fix is being implemented.
Matillion service's are currently unavailable due to a severe third-party ongoing outage.
Report: "DPC Customer with OAUTH token refresh issue"
Last updateThe incident has been resolved.
We are continuing to monitor for any further issues.
We are continuing to monitor for any further issues.
We are continuing to monitor for any further issues.
We have identified the problem and a fix is being worked on.
Report: "Designer: US Region - slowness observed when provisioning trial Snowflake accounts and agents"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Hub: Customers cannot view credit consumption page"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Hub: Users may be experiencing intermittent issues logging into Matillion Hub"
Last updateThis incident has been resolved.
Users may experience intermittent issues when trying to login to Matillion Hub, this is due to a issue with a third-party provider.
Report: "Agents Unable to Schedule in the US Region"
Last updateA small number of agents were unable to be scheduled in the US region. This issue was investigated and resolved.
Report: "Iterator Component Error in Designer"
Last updateThis issue has now been resolved
The issue has been identified and we are currently working on a fix
We are currently investigating an issue with the FixedIterator component showing an error when trying to list values in the Designer service.
Report: "Hub: Users in US locations may experience issues logging in via Matillion Hub"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Matillion data loader service degraded"
Last updateSystems are now operating normally.
The problem has been traced to issues with upstream monitoring and execution systems which are now recovering.
We are experience an issue with the Matillion data loader service in EU and US. Our engineers are investigating and more updates will follow shortly.
Report: "Credit consumption dashboard may fail to show"
Last updateThis incident has been resolved.
We are investigating an issue, the workaround is to refresh your browser.
Report: "Customers may fail to login or signup to Matillion Hub from US regions"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A workaround has been implemented and we are monitoring.
This issue has been identified as an issue with a third-party provider. We are monitoring the situation and are investigating a workaround.
Report: "New users cannot signup to Matillion Hub"
Last updateWe have identified and corrected an issue where new customers were unable to sign-up through the Hub