Not long after that, Reddit user u/ramenporn reported on the r/sysadmin subreddit that BGP peering with Facebook is down, probably due to a configuration change that was pushed shortly before the outages began.Īccording to u/ramenporn-who claims to be a Facebook employee and part of the recovery efforts-this is most likely a case of Facebook network engineers pushing a config change that inadvertently locked them out, meaning that the fix must come from data center technicians with local, physical access to the routers in question. If the BGP routes for a given network are missing or incorrect, nobody outside that network can find it. 1.1.1.1 started seeing high failure in last 20mins.- Dane Knecht October 4, 2021 It appears their BGP routes have been withdrawn from the internet.

With no BGP routes into Facebook's network, Facebook's own DNS servers would be unreachable-as would the missing application servers for Facebook-owned Instagram, WhatsApp, and Oculus VR. (BGP-short for Border Gateway Protocol-is the system by which one network figures out the best route to a different network.) Instagram and WhatsApp were reachable but showed HTTP 503 failures (no server is available for the request) instead, an indication that while DNS worked and the services' load balancers were reachable, the application servers that should be feeding the load balancers were not.Ī bit later, Cloudflare VP Dane Knecht reported that all BGP routes for Facebook had been pulled. Facebook-owned Instagram was also down, and its DNS services-which are hosted on Amazon rather than being internal to Facebook's own network-were functional. The problem goes deeper than Facebook's obvious DNS failures, though. Without working DNS, your computer doesn't know how to get to the servers that host the website you're looking for. 3GHJ3mW0P0- Jim Salter (definitely not Elon Musk) October 4, 2021ĭNS-short for Domain Name System-is the service that translates human-readable hostnames (like ) to raw, numeric IP addresses (like 18.221.249.245).

TL DR: Google anycast DNS returns SERVFAIL for Facebook queries querying directly times out.

Facebook instagram whatsapp down what