Staff at AI labs and the UK's AI Security Institute report a mental toll from fears their work could harm society, the FT reported
AI staff are complaining of mental toll over fears of threats to society, per FT
Context
If the people testing and building frontier AI are burning out, the safety checks that governments and companies rely on could weaken just as models get more capable.
The Financial Times published the report on September 22, and unusual_whales resurfaced it on October 12. Britain's AI Security Institute tests frontier models before release under voluntary agreements with developers. Several senior safety researchers at leading labs have quit in recent years citing concerns about safety.
Deep dive
On October 12, unusual_whales posted that AI staff are complaining of mental toll over fears of threats to society, per FT. The Financial Times story it refers to ran on September 22.
The FT reported that multiple staff at the UK's AI Security Institute have been signed off work with stress and are undergoing counselling, according to people with knowledge of the matter. Four people told the paper that tight schedules for testing unreleased models, along with alarm over the rapid rollout and growing capabilities of AI, have contributed to low morale and burnout at the institute.
The FT said staff at Anthropic, OpenAI and Google DeepMind have also publicly complained of similar issues, and that more than a dozen senior researchers across the three labs have quit over the past two years citing concerns about how their leaders prioritize safety. It reported that a DeepMind employee described making AI safer as feeling like an impossible task.
According to the Daily Mail's summary of the FT report, a former institute employee said staff were particularly alarmed by a recent jump in capabilities related to cyberwarfare and biochemistry, and a DeepMind employee said there had been various quittings and a lot of mental health leave.
What to expect next
Watch whether the AI Security Institute or the UK government responds with changes to staffing or testing timelines, especially now that the institute is regaining early access to US models.
Also watch whether labs disclose more about staff wellbeing and attrition on safety teams, and whether more researchers resign publicly, which has repeatedly shaped the debate over how fast frontier AI should be released.