Twitter risks fraying as engineers exit over Elon Musk upheaval
_vb_10.gif)
New York(AP): Elon Musk's managerial bomb-throwing at Twitter has so thinned the ranks of software engineers who keep the world's de-facto public square up and running that industry insiders and programmers who were fired or resigned this week agree: Twitter may soon fray so badly it could actually crash.
Musk ended a very public argument with nearly two dozen coders critical to the microblogging platform's stability by ordering them fired this week. Hundreds of engineers and other workers then quit after he demanded they pledge to "extremely hardcore" work by Thursday evening or resign with severance pay.
The newest departures mean the platform is losing workers just at it gears up for the 2022 FIFA World Cup, which opens Sunday. It is one of Twitter's busiest events, when tweet surges heavily stress its systems.
"It does look like he is going to blow up Twitter," said Robert Graham, a veteran cybersecurity entrepreneur. "I cannot see how the lights will not go out at any moment" -- although many recent Twitter departures predicted a more gradual death.
Hundreds of employees signalled they were leaving ahead of Thursday's deadline, posting farewell messages, a salute emoji or other familiar symbols on the company's internal Slack messaging board, according to employees who still have access. Dozens also took publicly to Twitter to announce they were signing off.
Earlier in the week, some got so angry at Musk's perceived recklessness that they took to Twitter to insult the Tesla and Space X CEO. "Kiss my ass, Elon," one engineer said, adding lipstick marks. She had been fired.
Twitter leadership sent an unsigned email after Thursday's deadline, saying its offices would be closed and employee badge access disabled until Monday. No reason was given, according to two employees who got the email -- one who took the severance, one still on payroll. They spoke on condition of anonymity, fearing retribution.
A trusted phalanx of Tesla coders at his side as he ransacked a formerly convivial workspace, Musk did not appear bothered.
"The best people are staying, so I'm not super worried," he tweeted on Thursday night. But it soon became clear some crucial programming teams had been thoroughly gutted.
Indicating how strapped he is for programmers, Musk sent all-hands emails Friday summoning "anyone who actually writes software" to his command perch on Twitter's 10th floor at 2 pm -- asking that they fly into San Francisco if not local, said the employee who quit on Thursday but was still receiving company emails.
After taking over Twitter less than three weeks ago, Musk booted half of the company's full-time staff of 7,500 and an untold number of contractors responsible for content moderation and other crucial efforts. Then came this week's ultimatum.
Three engineers who left this week described for The Associated Press why they expect considerable unpleasantness for Twitter's more than 230 million (23 crore) users now that well over two-thirds of Twitter's pre-Musk core services engineers are apparently gone. While they do not anticipate near-term collapse, Twitter could get very rough at the edges -- especially if Musk makes major changes without much off-platform testing.
Signs of fraying were evident before Thursday's mass exit. People reported seeing more spam and scams on their feeds and in their direct messages. Engineers reported dropped tweets. People got strange error messages.
Still, nothing critical has broken. Yet.
"There is a betting pool for when that happens," said one of the engineers, all of whom spoke on condition of anonymity for fear of retaliation from Musk that could impact their careers and finances.
Another said that if Twitter has been shutting servers and "high volume suddenly comes in, it might start crashing".
"World Cup is the biggest event for Twitter. That is the first thing you learn when you onboard at Twitter," he said.
With the earlier layoffs of curation employees, Twitter's trending pages were already suffering. The engineering fireworks began on Tuesday when Musk announced on Twitter that he had begun shutting down "microservices" he considered unnecessary "bloatware".
"Less than 20% are actually needed for Twitter to work!" he tweeted.
That drew objections from engineers who told Musk he had no idea what he was talking about.
"Microservices are how most modern large web services organise their code to allow software engineers to work quickly and efficiently," said Gergely Orosz, author of the Pragmatic Engineer blog and a former Uber programmer. There are scores of such services and each manages a different feature. Instead of testing the removal of microservices in a simulated real-world environment, Musk's team has apparently been updating Twitter live on everyone's computers.
And indeed, one microservice briefly broke -- the one people use to verify their identity to Twitter via SMS message when they log in. It is called two-factor authentication.
"You have hit the limit for SMS codes. Try again in 24 hours," Twitter advised when a reporter tried to download their microblogging history archive. Luckily, the email verification alternative worked.
One of the newly-separated Twitter engineers, who had worked in core services, told the AP that engineering team clusters were down from about 15 people pre-Musk -- not including team leaders, who were all laid off -- to three or four before Thursday's resignations.
Then more institutional knowledge that cannot be replaced overnight walked out the door.
"Everything could break," the programmer said.
It takes six months to train someone to work an on-call rotation for some services, the engineers said. Such rotations require programmers to be available at all hours. But if the person on call is unfamiliar with the code base, failures could cascade as they frantically plow through reference manuals.
"If I stayed I would have been on-call constantly with little support for an indeterminate amount of time on several additional complex systems I had no experience in," tweeted Peter Clowes, an engineer who took the severance.
"Running even relatively boring systems takes people who know where to go when something breaks," said Blaine Cook, Twitter's founding engineer, who left in 2008. It is dangerous to drastically reduce a programming workforce to a skeleton crew without first bulletproofing the code, he said.
"It is like saying, these firefighters are not doing anything. So, we will just fire them all."
The engineers also worry Musk will shut down tools involved in content moderation and removing illicit material that people upload to Twitter -- or that there simply would not be enough people on staff to run them properly.
Another concern is hackers. When they have breached the system in the past, diminishing damage depends on detecting them quickly and kicking them out.
It is not clear how Musk's housecleaning at Twitter has affected its cybersecurity team, which suffered a major PR black eye in August when the highly respected security chief fired by the company earlier this year, Peiter Zatko, filed a whistleblower complaint claiming the platform was a cybersecurity shambles.
"So much of the security infrastructure of a large organisation like Twitter is in people's heads," said Graham, the cybersecurity veteran. "And when they are gone, you know, it all goes with them." (AP)
Let the Truth be known. If you read VB and like VB, please be a VB Supporter and Help us deliver the Truth to one and all.
Israel launches first airstrike on Lebanon since ceasefire, accusing Hezbollah of breaching truce
Beirut, Nov 28: The Israeli military on Thursday said its warplanes fired on southern Lebanon after detecting Hezbollah activity at a rocket storage facility, the first Israeli airstrike a day after a ceasefire between Israel and Hezbollah took hold.
There was no immediate word on casualties from Israel's aerial attack, which came hours after the Israeli military said it fired on people trying to return to certain areas in southern Lebanon. Israel said they were violating the ceasefire agreement, without providing details. Lebanon's state-run National News Agency said two people were wounded.
The back-to-back incidents stirred unease about the agreement, brokered by the United States and France, which includes an initial two-month ceasefire in which Hezbollah members are to withdraw north of the Litani River and Israeli forces are to return to their side of the border. The buffer zone would be patrolled by Lebanese troops and UN peacekeepers.
On Thursday, the second day of a ceasefire after more than a year of bloody conflict between Israel and Hezbollah, Lebanon's state news agency reported that Israeli fire targeted civilians in Markaba, close to the border, without providing further details. Israel said it fired artillery in three other locations near the border. There were no immediate reports of casualties.
An Associated Press reporter in northern Israel near the border heard Israeli drones buzzing overhead and the sound of artillery strikes from the Lebanese side.
The Israeli military said in a statement that “several suspects were identified arriving with vehicles to a number of areas in southern Lebanon, breaching the conditions of the ceasefire.” It said troops “opened fire toward them” and would “actively enforce violations of the ceasefire agreement.”
Israeli officials have said forces will be withdrawn gradually as it ensures that the agreement is being enforced. Israel has warned people not to return to areas where troops are deployed, and says it reserves the right to strike Hezbollah if it violates the terms of the truce.
A Lebanese military official said Lebanese troops would gradually deploy in the south as Israeli troops withdraw. The official spoke on condition of anonymity because they were not authorized to brief media.
The ceasefire agreement announced late Tuesday ended 14 months of conflict between Israel and Hezbollah that began a day after Hamas' Oct. 7, 2023 attack out of Gaza, when the Lebanese Hezbollah group began firing rockets, drones and missiles in solidarity.
Israel retaliated with airstrikes, and the conflict steadily intensified for nearly a year before boiling over into all-out war in mid-September. The war in Gaza is still raging with no end in sight.
More than 3,760 people were killed by Israeli fire in Lebanon during the conflict, many of them civilians, according to Lebanese health officials. The fighting killed more than 70 people in Israel — over half of them civilians — as well as dozens of Israeli soldiers fighting in southern Lebanon.
Some 1.2 million people were displaced in Lebanon, and thousands began streaming back to their homes on Wednesday despite warnings from the Lebanese military and the Israeli army to stay out of certain areas. Some 50,000 people were displaced on the Israeli side, but few have returned and the communities near the northern border are still largely deserted.
In Menara, an Israeli community on the border with views into Lebanon, around three quarters of homes are damaged, some with collapsed roofs and burnt-out interiors. A few residents could be seen gathering their belongings on Thursday before leaving again.
