Historical record of incidents for Papertrail
Report: "Logs from some of the applications on Heroku platform are not received in Papertrail"
Last updateWe are observing an issue with log delivery from Heroku to Papertrail due to an ongoing Heroku incident. This may affect a subset of customers using the Heroku plug-in to send logs to Papertrail. More details on the Heroku incident are available at https://status.heroku.com/incidents/2822.
Report: "Alert Delivery"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Delays in log ingestion"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Delay in log ingestion"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Some Search Alerts searched partial data."
Last updateFrom 21:49 to 22:43 on 2025-01-24 UTC some Search Alerts searched partial data
Report: "Delay in log ingestion"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Delayed log ingestion"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "papertrailapp.com is unavailable"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Log ingestion delayed"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Connections to web site delayed or timing out"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Logs sent to logs.papertrailapp.com are delayed"
Last updateFrom 14:24 UTC to 14:45 UTC new connections to logs.papertrailapp.com were delayed.
We are currently investigating this issue.
Report: "Some log destinations on logs7.papertrailapp.com unavailable"
Last updateOn 2024-07-15 from 14:10 to 14:22 UTC some log destinations on logs7.papertrailapp.com were unavailable.
Report: "Log Collection is delayed"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Search"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "papertrailapp.com is unavailable"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Search Alerts Delayed"
Last updateThis incident has been resolved.
The backlog has been processed. Search Alerts were enabled at 11:38 UTC. Some search alerts may fire initially due to the search window extending back to the start of this incident rather than the normal window (1 minute, 10 minutes, 1hr, etc.) but they will return to normal operation after that initial search with the larger window.
We continue to process the backlog and once that is complete we will enable Search Alerts.
The logs visible in the viewer are up to date. More of the backlog needs to be processed before search alerts can be turned back on.
We are currently investigating this issue.
Report: "Bad network interface on logs7.papertrailapp.com (169.46.82.187)"
Last updateBetween 04:05 and 09:40 UTC on November 17, 2023, the IP address 169.46.82.187, associated with one of the backend servers for logs7.papertrailapp.com, encountered a hardware network interface issue. The other 3 IP address that serves logs7.papertrailapp.com remained operational. Customer impact for users that happen to use the 169.46.82.187 IP address for logs7.papertrailapp.com: 1. Port-Based Log Destinations and UDP users Logs would have been dropped. 2. TCP users Logs would have experienced a 6-hour delay, then sent all at once around 09:35-40 UTC. This delay will lead to incorrect timestamps in the logs, reflecting the time of arrival rather than the time of generation. Importantly, there is no impact on Heroku customers and those utilizing logs7.papertrailapp.com as an HTTP log destination.
Report: "Partial delayed log processing from 06:50 UTC to 07:12 UTC"
Last updateStarting at 06:50 UTC some logs were delayed. Log processing caught back up by 07:12 UTC.
Report: "Search Alerts are Delayed and Increased Errors"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are continuing to investigate this issue.
Starting at 12:30 UTC search alerts are delayed.
Report: "Search Alerts and Log Search delayed"
Last updateThis incident has been resolved.
Starting at 12:16 UTC Search Alerts and Log Search are delayed.
Report: "Updates to or new port based Log Destinations are delayed"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented.
Report: "Delayed log search and search alerts from 23:20 UTC on Friday to 01:20 UTC on Saturday"
Last updateThis incident has been resolved.
Starting at 23:20 UTC on Friday July 7th log search and search alerts are delayed for some customers.
Report: "Log Search and Search Alerts delayed from 22:04 UTC to 22:29 UTC"
Last updateThis incident has been resolved.
Report: "Issue with sending mail for invites and password reset"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Log collection to part of one endpoint interrupted"
Last updateLogs sent to logs7.papertrailapp.com may have been delayed if they were sent between 19:37 UTC and 20:00 UTC.
Report: "Delayed log search and search alerts"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Report: "Search Alerts Issues"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix has been implemented.
We are currently investigating this issue.
Report: "Email Delivery Issue"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We have identified an issue with our email provider. All email communications (account signup, alerts with mail notification) are currently affected.
We are currently investigating this issue.
Report: "Search Alerts are Delayed"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Archived logs delayed from 2023-01-06 at 9:05 AM to 2023-01-07 at 3:10 AM"
Last update**Log archives from 2-10 AM UTC on 2023-01-06 may not be present.** All of the logs from that period of time have been preserved on our servers. If you need log archives from that period of time and they are not already present please contact support [technicalsupport@solarwinds.com](mailto:technicalsupport@solarwinds.com) and reference this statuspage: [https://www.papertrailstatus.com/incidents/hmcbh005mfmh](https://www.papertrailstatus.com/incidents/hmcbh005mfmh)
This incident has been resolved.
We are continuing to monitor as we process the backlog of logs sent to be archived.
Log archives are delayed.
Report: "Search Alerts Delayed"
Last updateFrom 04:50 to 05:50 some search alerts were delayed.
Since 04:50 UTC Search Alerts have been delayed.
Report: "Delayed log search and search alerts"
Last updateThis incident has been resolved.
Logs are delayed by 6 minutes or less. We are processing the backlog.
Report: "Accidental status set on Statuspage for "Search Alerts""
Last updateAn accidental status for "Search Alerts" was at 8AM UTC and was resolved 7 hours later.
Report: "Live Tail, Log Search and Search Alerts are delayed."
Last updateThis incident has been resolved.
The backlog has been processed.
Log processing is delayed. The Live Tail, Log Search and Search Alerts features will have delays.
Report: "Transient failures when sending emails since 04:30 UTC 16Sep2022"
Last updateAs of 09:00 UTC delivery of notifications from search alerts returned to normal.
Not all notifications sent by search alerts are being delivered. All notifications types are impacted, not just email.
Starting roughly 2 hours ago not all emails sent by search alerts are being delivered. Our email provider has not yet provided an ETA to restore normal service. https://status.mailgun.com/incidents/m85fxdtc7tvs
Report: "Delayed log collection"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
Report: "Log processing is delayed."
Last updateThis incident has been resolved.
Log Search and Search Alerts are delayed.
Report: "Search Alerts may be unable to send notifications"
Last updateThe behavior of our mail provider has returned to normal. Search Alert notifications of all types are operating normally now.
The outage at our provider continues. Search Alert notifications that use email have not been delivered since 12:00 UTC. Notifications that do not use email are mostly unaffected.
An outage with our email provider is causing search alert notifications to have increased latency and periodic failures.
A fix has been implemented and we are monitoring the results.
Report: "Search alerts impacted from 08:40 to 09:25 UTC"
Last updateSearch alerts processing was impacted from 08:40 to 09:25.
Report: "The logs2.papertrailapp.com endpoint has higher than normal latency"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Log Search and Search Alerts are delayed"
Last updateThis incident has been resolved.
A fix has been implemented and we are watching as the backlog is being processed.
The issue has been identified and a fix is being implemented.
Log Searching and Search Alerts are delayed.
Report: "Website and search alert problems"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Alerts delayed"
Last updateThis incident has been resolved.
We are continuing to work through the backlog of delayed alerts
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Alert and other emails are not being sent"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented.
Report: "Website, log search and search alert outage"
Last updateThis incident has been resolved.
Log Search and Search Alerts are delayed as the backlog of events is processed.
We are currently investigating this issue.
Report: "Email not being sent for alerts"
Last updateThis incident has been resolved.
Alerts that send emails are being processed normally now.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Search Alerts processing after 20:22 UTC is paused."
Last updateThe Search Alert backlog has been processed.
As of 20:22 UTC Search Alerts are not being processed. Search Alert processing will be paused until the AWS Incident resolves.
The issue has been identified and a fix is being implemented.
Report: "Partial log processing delay"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Log processing are delayed by about 30 minutes. We're investigating.
Report: "Customers using the "token" log destinations may be unable to send logs"
Last updateThis incident has been resolved.
The "token" log destinations are now operating normally.
The issue has been identified and a fix is being implemented.
Report: "Delay in log search and search alerts"
Last updateThis incident has been resolved.
Log Search and Search Alerts are delayed.
Report: "Partial log processing and search alert delay"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Log processing and search alerts are delayed. We're investigating.