Moderna cofounder Noubar Afeyan calls for urgent regulation of AI agents, warning of a possible biomedical disaster without safety checks

Context

Polymarket is relaying a Bloomberg report, so this is secondhand. Afeyan is the founder of Flagship Pioneering, which created Moderna. The details below come from Bloomberg's headline and Quartz's report on his remarks.

Deep dive

On October 13, Polymarket posted: JUST IN: Moderna founder calls for urgent regulation of AI agents, warning a biomedical disaster could occur without stronger safeguards.

Bloomberg reported the remarks under the headline Moderna Founder Calls for Urgent Regulation of AI Agents. According to Quartz, Afeyan urged regulators to require safety verification for AI agents sold commercially before they reach the market, rather than waiting for a disaster to force action.

Quartz reported that Afeyan compared the risk to thalidomide, the drug whose harm to babies in the 1950s and 1960s led to modern drug approval rules. He argued that agents, rather than the underlying large language models, should be the focus of regulation, because agents act on their own and have what he called intentionality.

He warned that AI agents could produce dangerous compounds or unreliable biomedical results, according to Quartz. His view is notable because Flagship Pioneering's companies use AI heavily in drug discovery, so he is calling for rules on tools his own industry depends on.

What to expect next

Watch whether lawmakers or agencies such as the FDA take up Afeyan's idea of premarket safety checks for AI agents used in biomedical work.

Also watch reactions from AI companies and other biotech leaders, and whether his argument to regulate agents rather than models gains ground in current AI policy debates. His comments could also feed into debates in Congress and Europe over whether existing AI rules cover autonomous agents at all.