Historical record of incidents for Short.io
Report: "Click tracking partial outage"
Last updateWe are currently investigating this issue.
Report: "Statistics module partial outage"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Statistics module partial outage"
Last updateThis incident has been resolved.
We are continuing to monitor for any further issues.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Statistics slowdown"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Due to emergency maintenance requests to statistics produce timeouts
Report: "Dashboard, API, URL redirector"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
Report: "API partial outage"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Team management section partial outage"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
Report: "Redirector increased latency (EU Region)"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "URL Redirector partial outage"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Statistics downtime"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Redirector malfunctioning for the US region"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Statistics module partial outage"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "API key for team users temporary malfunction"
Last updateUsers with team-restricted API keys experienced difficulties accessing domains through the API due to issues caused by an update. The root cause has been identified and the changes were rolled back.
Report: "URL Redirector partial outage"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Statistics module outage"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Statistics module outage"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Temporary API outage"
Last updateThis incident has been resolved.
Report: "Partial statistics module outage"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Bulk Edit Spreadsheets outage"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Partial URL redirector outage"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Bulk Spreadsheets & CSV Import outage"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "providing ttl parameter in public link creation API leads to error 400"
Last updateThis incident has been resolved.
The issue has been identified and a fix is being implemented.
Report: "Bulk create API endpoint returns error 401"
Last updateThis incident has been resolved.
After the new release it was found that we return error 401 on all bulk link create requests. The issue expented to be fixed within 15 minutes
Report: "slightly increased rate of 500 errors"
Last updateConflict of two backend modules, partially affected redirects. The issue lasted <30 minutes.
Report: "EU Region Redirector outage"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Redirector partial outage (EU Region)"
Last updateThis incident has been resolved.
We are continuing to investigate this issue.
We are currently investigating this issue
Report: "Redirector partial outage (EU Region)"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Redirector partial outage"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "US region DNS outage"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Statistics module partial outage"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Short.io domain resolution failure"
Last updateThe incident occurred due to the late renewal of the [Short.io](http://Short.io) domain, resulting in a temporary outage of all services provided via the [short.io](http://Short.io) domain \(API, statistics, short links\). The problem was noticed within seconds after expiration and domain was renewed immediately, but some users have incorrect DNS cache records for a longer period
This incident has been resolved.
Report: "DDoS Attack, affected redirects"
Last updateFollowing a series of Distributed Denial of Service \(DDoS\) attacks on our network infrastructure, our development team conducted an extensive review and identified the lack of adequate DDoS protection as a significant vulnerability. These attacks severely impacted our service availability, affecting both client trust and operational performance. ### Issue Description The attacks utilized a high volume of requests to overwhelm our system, making it inaccessible to legitimate users. Traditional mitigation strategies proved insufficient against the scale and sophistication of these attacks. ### Resolution Development In response to this challenge, the development team proposed the integration of a Proof-of-Work \(PoW\) algorithm to bolster our defenses against DDoS attacks. PoW requires a not-insignificant amount of computational work from the requester, thus providing a natural barrier against the bulk automated requests typical of DDoS attacks. ### Implementation Strategy The chosen PoW algorithm will require all incoming requests to provide a proof of computational effort before processing. This method is expected to deter malicious actors due to the increased costs and effort associated with launching a DDoS attack.
This incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "High rate of 500 errors during redirects"
Last updateDDoS attacker bypassed our protection by using hostnames like [hostname.com:28913](http://hostname.com:28913). We implemented a hotfix as soon as possible and real fix later
This incident has been resolved.
We are continuing to work on a fix for this issue.
We are continuing to work on a fix for this issue.
We are currently dealing with new DDoS attack, solution is being deployed
Report: "High rate of 500 errors"
Last updateThis incident has been resolved.
DDoS attack
Report: "DDoS Attack, affected redirects"
Last updateThe incident has been resolved. A fix has been applied to prevent similar types of DDoS attacks.
A fix has been implemented and we are monitoring the results
We are currently investigating the redirection issue, the fix is in deployment process.
Report: "DDoS attack on Short.io"
Last updateThis incident has been resolved.
We are getting a new version of DDoS attack. The fix is applied
Report: "DDoS Attack, affected redirects"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are continuing to investigate this issue.
We are currently investigating this issue.
Report: "Statistics module malfunction"
Last updateThis incident has been resolved.
The issue has been identified
We are currently investigating this issue.
Report: "DDoS attack, affected redirects"
Last updateThis incident has been resolved.
We've got a large unexpected DDoS attack, and currently investigating this issue
Report: "Increased rate of 5xx errors during DDoS attack"
Last updateThis incident has been resolved.
There was a short spike of 500 errors during DDoS attack for few minutes while our system scaled out to handle this DDoS attack. We are investigate the reason of this accident, but the service is already operational
Report: "Increased rate of 500 errors in redirects"
Last updateBetween 14:30 and 14:35 there were increased 500 errors rate caused by unexpected consequences of our primary database optimization
Report: "Redirector outage"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Redirector partial outage"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Dashboard displays empty screen"
Last updateA fix has been implemented and we are monitoring the results.
Report: "Redirector downtime"
Last updateWe've handled DDoS attack. Like previous one it was done with precise timing, so we did not have time to scale automatically. Like previous time our cache did not handle load and we passed data to upstream. This time we updated cache error management and working on faster reaction on DDoS attacks
Report: "Increased rate of 502 errors during redirect"
Last update**Cause:** The incident was caused by the new kind of DDoS attack. Attacker used perfect timing to start every attack wave: 1. Large wave of requests \(10k RPS\) got “cache miss” on our caching frontend and caused 502 errors in our redirecting module 2. 502 errors weren’t cached, so every new request bypassed cache as well, increasing load to our redirecting module 3. After cache was populated, attacker started a new wave with a different URL **Our mitigation:** 1. As an immediate fix we limited impact by disabling domain under attack \(it helped other clients' domains to be available\) 2. We implemented a solution, which prevents large numbers of requests to bypass cache at the same time 3. We implemented “siege mode” for domains under attack, which adds few more restrictions to these domains and increasing number of DDoS requests we can handle without affecting our legitimate customers
This incident has been resolved.
We are currently investigating this issue.
Report: "Increased statistics delay in US region"
Last updateThis incident has been resolved.
Our customers are not able to see clicks/data from last 12 hours. Should be fixed by 18:00 UTC
Report: "Redirector Degraded Perfomance"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
We are currently investigating this issue.
Report: "Increased rate of 502 errors"
Last updateThis incident has been resolved.
We are currently investigating this issue.
Report: "Redirector Partial Outage"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are currently investigating this issue.
Report: "Our service is under DDoS attack, we are working on a solution"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
Report: "Redirector outage"
Last updateThis incident has been resolved.
A fix has been implemented and we are monitoring the results.
The issue has been identified and a fix is being implemented.
We are continuing to investigate this issue.
We are currently investigating this issue.