My dad had internet issues this morning. I was in the process of blaming our ISP back at home in India, and then I noticed a Twitter trend of Belkin routers causing an internet outage across the globe. NO! That seems a bit messed up. What I found most interesting was the fact that it supposedly wasn’t a firmware update which caused the issue. So how did devices which are supposed to connect you to the internet fail on their own without a firmware update?
A certain subset of Belkin routers seem to ping heartbeat.belkin.com to see if they have internet access.
If they don’t get a response they stop doing a bunch of DNS related things which includes forwarding requests from all devices to DNS servers.
Belkin’s workaround was to set static DNS to Google’s DNS Servers (18.104.22.168 and 22.214.171.124), while they danced about trying to fix the issue.
In very simple terms, a Belkin router assumed it could connect to the internet only if could connect to a certain Belkin server. And if it could not it just assumed the internet was dead and sat there looking pretty.
heartbeat.belkin.com need not have been just one server, but for Belkin to have programmed their routers such that their service had to be up for the routers to work seems crazy to me. Yes everything is back up now, but definitely a fun story.