Anotter update causing chaos

Lutin
Posts: 651
Joined: Mon Mar 16, 2020 4:52 pm
Location: Just across the border in the Republic
Has thanked: 259 times
Been thanked: 333 times

Anotter update causing chaos

Post by Lutin »

Oops! Crowdstrike and Microsoft: What we know about global IT outage
A mass IT outage has caused travel chaos around the world, with banking and healthcare services also badly hit.

Many flights have been grounded, with queues and delays at airports.

Cyber-security firm Crowdstrike has admitted that the problem was caused by an update to its Falcon antivirus software, designed to protect Microsoft Windows devices from malicious attacks.

Microsoft has said it is taking "mitigation action" to deal with "the lingering impact" of the outage.
Blundering about trying not to make too much of a hash of things.
User avatar
DefTrap
Posts: 4515
Joined: Tue Apr 14, 2020 8:23 am
Has thanked: 2276 times
Been thanked: 2200 times

Re: Anotter update causing chaos

Post by DefTrap »

Funnily enough only yesterday I was just rewriting our organisation's Business Continuity Plan and thinking that our reliance on Microsoft for 365 and Azure was overly risky. Not that any of it really deals with these short-term outages, other than waiting it out.
Microsoft wrote: Microsoft is advising people to try a classic method to get things working - turning it off and on again - in some cases up to 15 times.
Lolz ;) Certainly a classic.
User avatar
Horse
Posts: 11698
Joined: Sun Mar 15, 2020 11:30 am
Location: Always sunny southern England
Has thanked: 6296 times
Been thanked: 5141 times

Re: Anotter update causing chaos

Post by Horse »

Microsoft wrote: Microsoft is advising people to try a classic method to get things working - turning it off and on again next month - in some cases up to 15 times.
Clarified
Even bland can be a type of character :wave:
roadster
Posts: 163
Joined: Sun Mar 05, 2023 9:05 am
Has thanked: 16 times
Been thanked: 148 times

Re: Anotter update causing chaos

Post by roadster »

One news bulletin did say that safe mode was needed to reverse the update. Makes sense for a security program, you can't just turn it off! Although the platform was Microsoft it was third party software which went wrong. All changes to business critical systems should be tested and approved on mirror systems before role out but it seems that this is not done any more.
Mussels
Posts: 4451
Joined: Mon Mar 16, 2020 9:02 pm
Has thanked: 841 times
Been thanked: 1245 times

Re: Anotter update causing chaos

Post by Mussels »

roadster wrote: Sat Jul 20, 2024 9:03 am One news bulletin did say that safe mode was needed to reverse the update. Makes sense for a security program, you can't just turn it off! Although the platform was Microsoft it was third party software which went wrong. All changes to business critical systems should be tested and approved on mirror systems before role out but it seems that this is not done any more.
There isn't really time for extensive testing on critical security patches, a choice between possible crashes and someone being able to hack your systems.
So when MS started cutting corneres and rolling out standard updates with security ones it was very anoying.
Mr. Dazzle
Posts: 14113
Joined: Mon Mar 16, 2020 7:57 pm
Location: Milton Keynes
Has thanked: 2583 times
Been thanked: 6321 times

Re: Anotter update causing chaos

Post by Mr. Dazzle »

Was chatting to my brother about this yesterday - he's a senior IT security bod for a big ol' company.

He had the server estate all fixed in a matter of a few hours. The ballache is the fact it's a "hands on keyboards" fix, but luckily for him the actual keyboardy people are a few layers down :D