Author Topic: Facebook & Instagram go down simultaneously this A.M.  (Read 1282 times)

Brad Johnson

  • friend
  • Senior Member
  • ***
  • Posts: 18,061
  • Witty, charming, handsome, and completely insane.
Facebook & Instagram go down simultaneously this A.M.
« on: October 04, 2021, 02:38:27 PM »
Tried to hop on FacePlace during lunch and got an error. Just now seeing a news blurb that Facebook, Instagram, and several associated services went Tango Uniform about the same time this morning.

https://www.nytimes.com/2021/10/04/technology/facebook-down.html

I would think doxxing, but with all the redundancy and decentralization built into the FB infrastructure, I'm at a loss as to how it could be done.

Brad
It's all about the pancakes, people.
"And he thought cops wouldn't chase... a STOLEN DONUT TRUCK???? That would be like Willie Nelson ignoring a pickup full of weed."
-HankB

charby

  • Necromancer
  • Administrator
  • Senior Member
  • *****
  • Posts: 29,295
  • APS's Resident Sikh/Muslim
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #1 on: October 04, 2021, 02:40:51 PM »
Iowa- 88% more livable that the rest of the US

Uranus is a gas giant.

Team 444: Member# 536

Brad Johnson

  • friend
  • Senior Member
  • ***
  • Posts: 18,061
  • Witty, charming, handsome, and completely insane.
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #2 on: October 04, 2021, 02:42:46 PM »
Huh?

DOH!  :facepalm:

Meant DDoS. That's what I get for trying to post while on a phone call.

Brad
It's all about the pancakes, people.
"And he thought cops wouldn't chase... a STOLEN DONUT TRUCK???? That would be like Willie Nelson ignoring a pickup full of weed."
-HankB

lee n. field

  • friend
  • Senior Member
  • ***
  • Posts: 13,564
  • tinpot megalomaniac, Paulbot, hardware goon
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #3 on: October 04, 2021, 02:45:56 PM »
What I'm seeing is, some Book of Faces engineer pushed a router upgrade that went south.
In thy presence is fulness of joy.
At thy right hand pleasures for evermore.

French G.

  • friend
  • Senior Member
  • ***
  • Posts: 10,187
  • ohhh sparkles!
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #4 on: October 04, 2021, 02:52:05 PM »
Too many people trashing Biden, posts about theirs whistleblower and the Pandora files release. Mark pulled the plug for a bit while the raids take over pace.  [tinfoil]
AKA Navy Joe   

I'm so contrarian that I didn't respond to the thread.

TechMan

  • Administrator
  • Senior Member
  • *****
  • Posts: 10,562
  • Yes, your moderation has been outsourced.
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #5 on: October 04, 2021, 02:59:39 PM »
DNS...it is always DNS...
Quote
Hawkmoon - Never underestimate another person's capacity for stupidity. Any time you think someone can't possibly be that dumb ... they'll prove you wrong.

Bacon and Eggs - A day's work for a chicken; A lifetime commitment for a pig.
Stupidity will always be its own reward.
Bad decisions make good stories.

Quote
Viking - The problem with the modern world is that there aren't really any predators eating stupid people.

fifth_column

  • friend
  • Senior Member
  • ***
  • Posts: 1,705
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #6 on: October 04, 2021, 03:06:44 PM »
There are some good memes on twitter. My favorite so far:

https://twitter.com/i/status/1445081890273308675
Power concedes nothing without a demand. It never did and it never will... The limits of tyrants are prescribed by the endurance of those whom they oppress. ― Frederick Douglass

No American citizen should be willing to accept a government that uses its power against its own people.  -  Catherine Engelbrecht

WLJ

  • friends
  • Senior Member
  • ***
  • Posts: 28,086
  • On Patrol In The Epsilon Eridani System
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #7 on: October 04, 2021, 03:09:49 PM »
In other news the world's collective IQ went up a few points today
"Sometimes I think the surest sign that intelligent life exists elsewhere in the universe is that none of it has tried to contact us".
- Calvin and Hobbes

Nick1911

  • Administrator
  • Senior Member
  • *****
  • Posts: 8,487
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #8 on: October 04, 2021, 03:15:42 PM »
What do you call Facebook and Instagram going down simultaneously? 

A good start.

Ron

  • friends
  • Senior Member
  • ***
  • Posts: 10,881
  • Like a tree planted by the rivers of water
    • What I believe ...
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #9 on: October 04, 2021, 03:18:01 PM »
whatsapp is down also from what I read.
For the invisible things of him since the creation of the world are clearly seen, being perceived through the things that are made, even his everlasting power and divinity, that they may be without excuse. Because knowing God, they didn’t glorify him as God, and didn’t give thanks, but became vain in their reasoning, and their senseless heart was darkened. Professing themselves to be wise, they became fools.

TechMan

  • Administrator
  • Senior Member
  • *****
  • Posts: 10,562
  • Yes, your moderation has been outsourced.
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #10 on: October 04, 2021, 03:19:12 PM »
Quote
Hawkmoon - Never underestimate another person's capacity for stupidity. Any time you think someone can't possibly be that dumb ... they'll prove you wrong.

Bacon and Eggs - A day's work for a chicken; A lifetime commitment for a pig.
Stupidity will always be its own reward.
Bad decisions make good stories.

Quote
Viking - The problem with the modern world is that there aren't really any predators eating stupid people.

Ben

  • Administrator
  • Senior Member
  • *****
  • Posts: 45,924
  • I'm an Extremist!
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #11 on: October 04, 2021, 03:25:35 PM »
What do you call Facebook and Instagram going down simultaneously? 

A good start.

 =D
"I'm a foolish old man that has been drawn into a wild goose chase by a harpy in trousers and a nincompoop."

just Warren

  • friend
  • Senior Member
  • ***
  • Posts: 5,234
  • My DJ name is Heavy Cream.
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #12 on: October 04, 2021, 03:57:55 PM »
I don't care about FaceBook but as an influencer how am I gonna do the influence without the 'Gram? 
Member in Good Standing of the Spontaneous Order of the Invisible Hand.

MechAg94

  • friend
  • Senior Member
  • ***
  • Posts: 33,694
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #13 on: October 04, 2021, 03:58:50 PM »
What I'm seeing is, some Book of Faces engineer pushed a router upgrade that went south.
Unpossible.  That stuff never happens. 


I am also wondering what that person gets paid.  (or if they have an H1B visa)
“It is much more important to kill bad bills than to pass good ones.”  ― Calvin Coolidge

HankB

  • friend
  • Senior Member
  • ***
  • Posts: 16,605
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #14 on: October 04, 2021, 04:12:18 PM »
I don't do Facebook or Instagram, but some other websites - AFAIK, unrelated to these two - were all but unreachable this morning.
Trump won in 2016. Democrats haven't been so offended since Republicans came along and freed their slaves.
Sometimes I wonder if the world is being run by smart people who are putting us on, or by imbeciles who really mean it. - Mark Twain
Government is a broker in pillage, and every election is a sort of advance auction in stolen goods. - H.L. Mencken
Patriotism is supporting your country all the time, and your government when it deserves it. - Mark Twain

AJ Dual

  • friends
  • Senior Member
  • ***
  • Posts: 16,162
  • Shoe Ballistics Inc.
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #15 on: October 04, 2021, 04:24:22 PM »
What I'm seeing is, some Book of Faces engineer pushed a router upgrade that went south.

Post or source?

That should be fixable in short order. Unless they screwed up so badly that it broke TFTP or lost access to the console port.

Although I guess enterprises of that size have tools for mass/aggregate management of routers and ain't going to do them onesy-twosey. So something fundamentally wrong could screw up a boatload of them at once. And then you've got to work your way up the chain from the first device that's actually accessible at a root level in a tree configuration.

Without more to go on than the length of the outage, I'm thinking something screwed up with their internal DNS. Rebuilding tables and propagating the changes can take time.

Not a big FB fan, but it's useful to keep in touch with family, and pushing updates out for Mrs. Dual's funeral arrangements. So I hope this is fixed soon. 
I promise not to duck.

lee n. field

  • friend
  • Senior Member
  • ***
  • Posts: 13,564
  • tinpot megalomaniac, Paulbot, hardware goon
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #16 on: October 04, 2021, 04:29:52 PM »
was an arstechnica article I saw it in. 

https://arstechnica.com/information-technology/2021/10/facebook-instagram-whatsapp-and-oculus-are-down-heres-what-we-know/

Sure has been down a long time.

Quote
Not long after that, Reddit user u/ramenporn reported on the r/sysadmin subreddit that BGP peering with Facebook is down, probably due to a configuration change that was pushed shortly before the outages began.

According to u/ramenporn—who claims to be a Facebook employee and part of the recovery efforts—this is most likely a case of Facebook network engineers pushing a config change that inadvertently locked them out, meaning that the fix must come from data center technicians with local, physical access to the routers in question. The withdrawn routes do not appear to be the result of nor related to any malicious attack on Facebook's infrastructure.
« Last Edit: October 04, 2021, 10:21:31 PM by lee n. field »
In thy presence is fulness of joy.
At thy right hand pleasures for evermore.

Brad Johnson

  • friend
  • Senior Member
  • ***
  • Posts: 18,061
  • Witty, charming, handsome, and completely insane.
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #17 on: October 04, 2021, 04:35:04 PM »
Facebook network engineers pushing a config change that inadvertently locked them out, meaning that the fix must come from data center technicians with local, physical access to the routers in question

That less an "ooops" and more an "oh, *expletive deleted*it".

Brad
It's all about the pancakes, people.
"And he thought cops wouldn't chase... a STOLEN DONUT TRUCK???? That would be like Willie Nelson ignoring a pickup full of weed."
-HankB

Ron

  • friends
  • Senior Member
  • ***
  • Posts: 10,881
  • Like a tree planted by the rivers of water
    • What I believe ...
For the invisible things of him since the creation of the world are clearly seen, being perceived through the things that are made, even his everlasting power and divinity, that they may be without excuse. Because knowing God, they didn’t glorify him as God, and didn’t give thanks, but became vain in their reasoning, and their senseless heart was darkened. Professing themselves to be wise, they became fools.

just Warren

  • friend
  • Senior Member
  • ***
  • Posts: 5,234
  • My DJ name is Heavy Cream.
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #19 on: October 04, 2021, 06:31:47 PM »
And it's back.
Member in Good Standing of the Spontaneous Order of the Invisible Hand.

RocketMan

  • Mad Rocket Scientist
  • friend
  • Senior Member
  • ***
  • Posts: 13,610
  • Semper Fidelis
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #20 on: October 04, 2021, 06:46:12 PM »
Supposedly the security system that allows access to the Facebook buildings is offline for the same reason.  The folks that must lay hands on the hardware to fix the problem can't get in the building.
Hah, hah!
If there really was intelligent life on other planets, we'd be sending them foreign aid.

Conservatives see George Orwell's "1984" as a cautionary tale.  Progressives view it as a "how to" manual.

My wife often says to me, "You are evil and must be destroyed." She may be right.

Liberals believe one should never let reason, logic and facts get in the way of a good emotional argument.

RocketMan

  • Mad Rocket Scientist
  • friend
  • Senior Member
  • ***
  • Posts: 13,610
  • Semper Fidelis
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #21 on: October 04, 2021, 06:46:38 PM »
And it's back.

Remember, we had it good for a while.
If there really was intelligent life on other planets, we'd be sending them foreign aid.

Conservatives see George Orwell's "1984" as a cautionary tale.  Progressives view it as a "how to" manual.

My wife often says to me, "You are evil and must be destroyed." She may be right.

Liberals believe one should never let reason, logic and facts get in the way of a good emotional argument.

WLJ

  • friends
  • Senior Member
  • ***
  • Posts: 28,086
  • On Patrol In The Epsilon Eridani System
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #22 on: October 04, 2021, 07:41:47 PM »
And it's back.

In other news the world's collective IQ just went down a few points.
"Sometimes I think the surest sign that intelligent life exists elsewhere in the universe is that none of it has tried to contact us".
- Calvin and Hobbes

HeroHog

  • Technical Site Pig
  • Administrator
  • Senior Member
  • *****
  • Posts: 8,039
  • It can ALWAYS get worse!
    • FaceButt Profile
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #23 on: October 05, 2021, 02:25:29 AM »
Anyone else chuckle as the (hundreds of?)thousands of dollars/minute ticked by at FacistButt & InstaScam this morning? No, just me?
 :rofl:
« Last Edit: October 05, 2021, 05:21:52 AM by HeroHog »
I might not last very long or be very effective but I'll be a real pain in the ass for a minute!
MOLON LABE!

K Frame

  • friend
  • Senior Member
  • ***
  • Posts: 44,176
  • I Am Inimical
Re: Facebook & Instagram go down simultaneously this A.M.
« Reply #24 on: October 05, 2021, 07:19:28 AM »
Because of the whistleblower the Zuck though it would be a good idea to clear the browser history.
Carbon Monoxide, sucking the life out of idiots, 'tards, and fools since man tamed fire.