British Airways Down from Computer Failure
-
@Jimmy9008 Yeah heard that this morning too, not seen any reports yet on BBC etc.
-
@Jimmy9008 said in British Airways Down from Computer Failure:
I've read this problem has been blamed on failure of 1 UPS... Anybody have any detail on that?
I'd be surprised if a company like BA runs servers somewhere protected by only 1 UPS, including the backup servers/systems.I read that a power surge and a faulty UPS rendered both the live systems, and the backups systems unavailable... that's insane if true.
I've seen similar stuff here. Our backup generators had a bad circuit breaker. When the weekly test rolled around, it would take down our main server room any time the AC came on while the generators were running...
-
@hobbit666 said in British Airways Down from Computer Failure:
@Jimmy9008 Yeah heard that this morning too, not seen any reports yet on BBC etc.
Yeah, I get that things can happen. But the report I read said the power issue took out the live and backup systems. Our backup systems/DR is the other side of the country... no way can 1 x UPS or a bad generator in the live site kill both systems...
Were BA running live and DR within the same building, off of the same UPS and generator?...
That's what I mean; I just don't see how a UPS or power issue in their datacenter could have caused the problem. Something else must have been the cause. Or a REALLY bad design/infrastructure engineer designed them.
-
@Jimmy9008 said in British Airways Down from Computer Failure:
I've read this problem has been blamed on failure of 1 UPS... Anybody have any detail on that?
I'd be surprised if a company like BA runs servers somewhere protected by only 1 UPS, including the backup servers/systems.I read that a power surge and a faulty UPS rendered both the live systems, and the backups systems unavailable... that's insane if true.
That's a pretty major failure, and... no generators?
-
@scottalanmiller said in British Airways Down from Computer Failure:
@Jimmy9008 said in British Airways Down from Computer Failure:
I've read this problem has been blamed on failure of 1 UPS... Anybody have any detail on that?
I'd be surprised if a company like BA runs servers somewhere protected by only 1 UPS, including the backup servers/systems.I read that a power surge and a faulty UPS rendered both the live systems, and the backups systems unavailable... that's insane if true.
That's a pretty major failure, and... no generators?
No one said no generators.
-
@scottalanmiller said in British Airways Down from Computer Failure:
@Jimmy9008 said in British Airways Down from Computer Failure:
I've read this problem has been blamed on failure of 1 UPS... Anybody have any detail on that?
I'd be surprised if a company like BA runs servers somewhere protected by only 1 UPS, including the backup servers/systems.I read that a power surge and a faulty UPS rendered both the live systems, and the backups systems unavailable... that's insane if true.
That's a pretty major failure, and... no generators?
Haven't read anything about it yet. If the UPS failed it might have been upstream power, like a transfer switch or something similar, that also failed.
-
Until/If they announce something, it is all speculation.
That said, I have seen more than one site where the entire power ecosystem was not designed as a whole, and it causes these kinds of problems.
Since it sounds like it was all in one place, they most likely have one of the huge APC cabinets powering multiple racks, and it went out. On site generators cannot do shit for that.
Poor planning on separating power to different buses and such.
-
-
British Airways says IT chaos was caused by human error
http://www.bbc.co.uk/news/business-40159202 -
@scottalanmiller said in British Airways Down from Computer Failure:
British Airways says IT chaos was caused by human error
http://www.bbc.co.uk/news/business-40159202Thank you captain obvious.
-
@scottalanmiller Seems like a huge failure to plan for such a large company.
-
@Kyle said in British Airways Down from Computer Failure:
@scottalanmiller Seems like a huge failure to plan for such a large company.
Whoa, look who showed up! A wild Kyle appears.
-
@scottalanmiller A wild Kyle has been pretty bad off here lately and just now trying to swing things back around. I am so sick of doctors in what I can only describe as professional malpractice at the highest.
-
@Kyle said in British Airways Down from Computer Failure:
@scottalanmiller A wild Kyle has been pretty bad off here lately and just now trying to swing things back around. I am so sick of doctors in what I can only describe as professional malpractice at the highest.
I hear ya. Sorry that it has been so bad. We are all pulling for you.I'm back in Texas now, not so far away.
