Homepage News Three reasons: Microsoft reveals what caused near-global blackout last week

Three reasons: Microsoft reveals what caused near-global blackout last week

Three reasons: Microsoft reveals what caused near-global blackout last week
Stock all/shutterstock.com

The blackout has been estimated to have cost 7 billion USD in lost productivity.

On Monday, Microsoft explained what triggered the 24-hour blackout that knocked Outlook, Exchange, and Office 365 offline last week.

According to the tech giant’s initial report, no hackers were involved, The Guardian reports.

Instead, three separate glitches collided at once. Any single problem would have been easy to fix on its own, Microsoft executives noted in the report.

Trouble started on Thursday during busy US traffic hours. By Friday, the disruption had spread worldwide, locking millions out of their email accounts before engineers finally restored access on Saturday.

Real-world consequences piled up fast, with millions of people unable to work. According to American think tank Anderson Economic Group, the global outage cost an estimated 7 billion USD in lost productivity.

How things unraveled

On Monday, Microsoft executive vice-president Charles Lamanna traced the chain reaction in a post on X. A hidden code flaw from July caused servers to “become overwhelmed and unresponsive.”

Normally, Microsoft runs two networking gateways, which act like digital doors moving data between separate systems. One failed for Microsoft Teams. Surging traffic then slammed into the lone backup.

Meanwhile, an unrelated issue from the day before had already cut server capacity by more than 14 percent.

“Taken together, the increased load and the reduced server capacity, caused the network gateway to encounter the latent bug from July,” Lamanna wrote.

Click to display external content from x,
- You can always enable and disable third-party content.
You agree to display external third-party content. Personal data may be sent to the provider of the content and other third-party services.

Slow road back

Fixing the mess proved harder than usual. Because the defect had sat untouched for months, engineers could not simply undo a recent update, Lamanna explained on X.

Freshly restarted servers also froze again under waves of waiting traffic. Automated recovery tools failed. According to Lamanna, those systems were never designed for a blackout that wide.

Microsoft has apologized and promised a final report with more details.

Outside experts see a clear warning here. “This is a prime example of the importance of not only cyber resilience, but business resilience,” said Matt Hull, a vice-president at NCC Group.

Ads by MGDK