Foxpass

Is Foxpass Down Right Now? Discover if there is an ongoing service outage.

Foxpass is currently Operational

Last checked from Foxpass's official status page

Historical record of incidents for Foxpass

Report: "Syncronization issue with identity providers"

Last update
resolved

This incident has been resolved. Any customer see users missing from groups sync'd from Okta or Google, please contact support.

monitoring

A fix has been implemented and we are monitoring the results.

identified

The issue has been identified and a fix is being implemented

investigating

There is an issue with users being deactivated after a sync with external identity providers. We are currently investigating this issue.

Report: "RADIUS/TTLS can't authenticate"

Last update
resolved

This issue has been fixed.

identified

This is affecting TTLS and PEAP connections to our non EAP-TLS-enabled RADIUS cluster.

investigating

We are currently investigating this issue.

Report: "EAP-TLS failing for some customer sites"

Last update
resolved

A small subset of customer sites cannot authenticate with EAP-TLS

Report: "Long-running LDAP connections return an error code for 'search' commands."

Last update
resolved

This incident has been resolved.

investigating

This has been resolved.

investigating

We are actively working on this incident. In the meantime, forcing a re-connect (restarting sssd or nslcd) should create new connections which will not be affected.

Report: "LDAP binds are sluggish for some requests"

Last update
resolved

This incident has been resolved.

monitoring

A small % of LDAP binds are slow to respond. We are working to improve the performance.

Report: "Google Sync Errors"

Last update
resolved

Google has rolled back the code that caused the error. We are not seeing any more issues.

identified

We are continuing to work on a fix for this issue.

identified

We are getting errors from Google when trying to access their APIs currently. We have escalated to their support.

Report: "Service disruption"

Last update
resolved

This incident has been resolved. Root cause was a failure of our primary database. Automated failover worked as designed and the system recovered about 2 minutes later.

investigating

We are currently investigating this issue.

Report: "Console outage"

Last update
resolved

This incident has been resolved.

identified

This is the result of an AWS Route53 DNS issue. More details here: https://status.aws.amazon.com/

investigating

We are currently investigating this issue

Report: "G Suite Outage"

Last update
resolved

G Suite is reporting that the issue has been fixed and we're seeing recovery as well.

monitoring

We're seeing error rates improve and continue to monitor the situation.

identified

Google G Suite is having issues signing users in and checking their passwords for delegated authentication. We are monitoring the situation. https://status.cloud.google.com/incident/developers-console/19008

Report: "Increased Error Rate"

Last update
postmortem

A misconfigured container went into production over the weekend and caused an increase in LDAP error rates. The number of errors was a small enough percentage across the total traffic that it did not raise any internal alerts. Once the configuration error was found, the container was removed from production and service returned to normal levels. We apologize for those impacted by the service interruption.

resolved

A misconfigured container caused in increase in LDAP error rates

Report: "Delegated authentication failures"

Last update
resolved

This incident has been resolved.

investigating

We are seeing slow or failing authentication to third-party sources. We are investigating.

Report: "Service Outage"

Last update
resolved

The service has recovered and is operating normally.

monitoring

The primary database failed and a secondary automatically took its place within a few minutes. Service is recovering and we are monitoring performance.

investigating

We are currently investigating this issue.

Report: "Some EAP-TTLS RADIUS connections not succeeding"

Last update
resolved

This incident has been resolved but requires action if you connect to our cloud-RADIUS servers for 802.1x. If you did not receive instructions via email, please contact us.

identified

This appears to be an incompatibility with an update to Mac OS's root certificate store and our certificate provider. It is affecting a small number of connections currently but we believe the number will increase daily. We have set up a work-around, you will receive details via our Intercom system.

investigating

We are currently investigating this issue. Connection failure are intermittent.

Report: "Issues With Delegated Authentication"

Last update
postmortem

Customers that wish to read a detailed postmortem may email us at help@foxpass.com.

resolved

A fix has been implemented and the problem has been resolved.

monitoring

A fix has been implemented and we are monitoring the results.

investigating

We are currently investigating issues with our delegated authentication mechanism

Report: "LDAP Outage"

Last update
postmortem

See here: http://blog.foxpass.com/august-2016-post-incident-review/

resolved

This incident has been resolved.

investigating

We are currently investigating this issue.

Report: "Radius Interruption"

Last update
resolved

A new set of outbound IP addresses have been set up, and almost all customers have switched over. We are working to get more information from Okta about the block.

monitoring

Okta is accepting traffic from the new IPs, we are continuing to monitor the situation.

identified

Our traffic to Okta's API is now coming from 52.5.197.216 and 35.153.22.124. You may need to update your Okta on-net whitelist. (please keep the existing ones active).

identified

We are unable to connect to Okta's API.

investigating

We are continuing to investigate this issue.

investigating

We are currently investigating an interruption in our RADIUS service.

Report: "LDAP scheduled maintenance beginning"

Last update
resolved

Maintenance has been completed.

investigating

We are performing maintenance on the LDAP server.

Report: "Okta authentication failing for some customers"

Last update
resolved

Okta's incident has been resolved. See https://status.okta.com/.

identified

Please follow Okta updates at https://status.okta.com/

Report: "Okta Incident"

Last update
resolved

Okta has resolved the issue.

identified

Okta is currently undergoing a service disruption. More information at https://status.okta.com/

Report: "Degraded RADIUS Performance"

Last update
resolved

The issue has been fixed.

investigating

We are currently investigating this issue.

Report: "Scheduled Maintenance"

Last update
resolved

Maintenance completed

monitoring

Maintenance beginning

Report: "Empty groups from sync'd sources"

Last update
resolved

Groups sync'd from external sources (Google, Azure, Okta, etc) may have been temporarily empty starting at approx. 5:20UTC. Most groups recovered within 30 minutes. All group memberships were fully restored by 7:00UTC.

Report: "Intermittent Google OAuth failures"

Last update
resolved

This incident has been resolved.

monitoring

Google's OAuth API is returning failures for some requests.

Report: "Increased LDAP bind times"

Last update
resolved

We moved off of the affected Amazon services and have recovered fully.

monitoring

Amazon's issues are affecting our LDAP bind times. We are monitoring the situation.

Report: "Increased Error Count"

Last update
resolved

5 minute period of increased errors for API/RADIUS during database maintenance.

investigating

We are currently investigating this issue.

Report: "Increased LDAP Bind Times"

Last update
resolved

We experienced an LDAP slowdown for 20 minutes. The system has fully recovered at 3:52 Pacific for the majority of our customers.

monitoring

We are currently monitoring system recovery.

investigating

We are currently investigating this issue.

Report: "Google API Incorrectly Marking Users As Disabled"

Last update
resolved

Google's Auth API has stopped throwing errors and we have re-enabled our internal user sync.

identified

Google's API is returning an invalid state for some users. We've temporarily disabled our sync; please contact us over the Intercom chat system on our website or by email to get these accounts back into a valid state.

Report: "Authentication errors with Bitium delegated auth"

Last update
resolved

This incident has been resolved.

identified

Customers who delegate authentication to Bitium are encountering errors when trying to authenticate. We are working with Bitium to identify and remedy this issue.

Report: "Okta Incident"

Last update
resolved

Okta's issue has been resolved and our error rates have returned to normal.

monitoring

Okta is currently undergoing an event. As a result, Okta delegated authentication and sync may not be fully functional. Follow here for further updates: https://status.okta.com/

Report: "RADIUS Performance Degraded"

Last update
resolved

A RADIUS host failed. Full service has since been restored.

investigating

We are currently investigating this issue.

Report: "Intermittent failures returning SSH keys"

Last update
resolved

One process was "stuck" from 04:30-07:30 UTC resulting in intermittent failures returning SSH keys.

Report: "DNS resolution issue"

Last update
resolved

This incident has been resolved.

monitoring

The DNS issues affecting the eastern region have been fixed, but Okta delegated auth and sync is still having intermittent issues.

identified

There is an issue with DNS resolution. This is affecting many services, but especially delegated authentication.

Report: "Trouble connecting to Google's OAuth servers for some customers"

Last update
resolved

We believe this incident self-resolved quickly. No further errors seen.

investigating

We are currently investigating this issue.

Report: "Increased error rates and timeouts for customers using Okta authentication delegation"

Last update
resolved

All calls are returning successfully as of 17:03 Pacific.

investigating

We are seeing an increased number of errors when communicating with Okta's API. Around 10% of connections are impacted. We are investigating.

Report: "Intermittent failures to bind when using Okta backend"

Last update
resolved

We identified and fixed an issue causing intermittent auth failures to Okta's backend when using our LDAP interface for a portion of this afternoon.

Report: "Degraded RADIUS Performance"

Last update
resolved

Google’s endpoint is returning normally now. All systems fully operational.

monitoring

Google’s auth endpoint was intermittently timing out, degrading our RADIUS servers’ performance. We are monitoring the situation.

investigating

We are currently investigating this issue.

Report: "Degraded RADIUS performance"

Last update
resolved

Around 23:25 UTC, RADIUS performance was degraded. Some queries experienced slow response times. This was resolved around 23:45 UTC.