View all newsletters
Receive our newsletter - data, insights and analysis delivered to you
  1. Leadership
  2. Digital Transformation
March 13, 2019updated 14 Mar 2019 4:39pm

What Caused Facebook’s Outage?

ThousandEyes suggests app-layer issue to blame

By CBR Staff Writer

UPDATED 16:39 GMT March 14, 2019. Facebook has blamed a “server configuration change” for the outage, without providing further details. 

A Facebook outage that lasted nearly 13 hours left users of the social media company’s family of services locked out globally overnight, with Facebook itself, Instagram and WhatsApp users all affected to different degrees.

The Facebook outage has also affected its advertisement services and the company said it was considering the possibility of refunds for its advertisers. The company confirmed it was not the result of a DDoS attack but no further detail.

Networking monitoring company ThousandEyes said: “Our tests shows this is very likely an app-layer issue, as we see 500 Internal Server Errors being reported from various locations around the globe.”

Content from our partners
Scan and deliver
GenAI cybersecurity: "A super-human analyst, with a brain the size of a planet."
Cloud, AI, and cyber security – highlights from DTX Manchester

It added that it was not seeing any border gateway protocol changes, suggesting the issue was one internally at Facebook.

An update on Facebook’s developer page said: “We are currently experiencing issues that may cause some API requests to take longer or fail unexpectedly. We are investigating the issue and working on a resolution.”

The status page showed a quadrupling of API error rates to still less-than-catastrophic 4.7 percent as of approximately 21:00 GMT and a doubling of average API response times to approximately 240 milliseconds.

facebook outageThe technical hiccup follows last night’s Gmail and Google Drive outage; few companies, even those with a sprawling array of data centres, seem to be immune to such issues: Microsoft Office 365 also recently suffered a near-two-day outage for some users.

Facebook operates 15 data centres globally, including in Ireland, Singapore and Sweden. The company had 1.58 billion daily active users in December 2018 and estimates that around 2.7 billion people now use its family of services.

One expert who did not want to be named told Computer Business Review they suspected it was an issue with an automation system that manages Facebook’s infrastructure. Facebook has built and open sourced a wide range of software including four key data infrastructure management tools, RocksDB, GraphQL, Presto and Haxl. The claim is, at this point, entirely speculative.

Websites in our network
Select and enter your corporate email address Tech Monitor's research, insight and analysis examines the frontiers of digital transformation to help tech leaders navigate the future. Our Changelog newsletter delivers our best work to your inbox every week.
  • CIO
  • CTO
  • CISO
  • CSO
  • CFO
  • CDO
  • CEO
  • Architect Founder
  • MD
  • Director
  • Manager
  • Other
Visit our privacy policy for more information about our services, how Progressive Media Investments may use, process and share your personal data, including information on your rights in respect of your personal data and how you can unsubscribe from future marketing communications. Our services are intended for corporate subscribers and you warrant that the email address submitted is your corporate email address.