← Wednesday, October 21 deck

17Security

Google says Wiz researchers found more than twice as many vulnerabilities with Gemini 4 Argon as with baseline models in real world testing

Researchers at @wiz_io put Gemini 4 Argon to the test against complex cyber threats. In real-world testing, it found more than two times more vulnerabilities than baseline models — catching a critical risk that previous frontier models missed. See how they did it ↓

Video of a bearded man in a tan sweater working at a laptop showing a security dashboard, then speaking seated in a dark room with shelves, in an interview about using Gemini 4 Argon

Context

Why it matters

Security work is one of the most valuable uses of frontier models, and a named customer's results help show whether Argon's cyber defense claims hold up.

Wiz is a cloud security company, and this is a Google post promoting results Wiz reported. Google said in its Argon safety post on October 13 that Wiz had early access and found a critical bug in hospital software that earlier models missed.

Deep dive

On October 21, Google posted that researchers at Wiz put Gemini 4 Argon to the test against complex cyber threats. It said that in real world testing the model found more than two times more vulnerabilities than baseline models and caught a critical risk that previous frontier models missed.

In the attached Google DeepMind video, a Wiz researcher says the team ran shadow A B tests of the model on real systems and found it caught more than twice as many vulnerabilities while using fewer tokens, then did well on longer tasks. He describes a Scan for Good effort with Google DeepMind to scan public sites of governments, hospitals and critical infrastructure. In one healthcare application, the model found a bypassable public file download feature, retrieved a configuration file with a master key, and showed a path to administrator access, which was then fixed.

Google's October 13 safety post described the same hospital case, saying it helped protect hundreds of thousands of patient records. It also said Argon solved all 12 of Google's end to end simulated cyberattack scenarios and ships with layered safeguards against misuse. The post does not name the baseline models, and the results come from Google and its partner, not an independent test.

What to expect next

Watch for Wiz or Google to publish details of the comparison, including which baseline models were used. Also watch for more results from the Scan for Good effort and from Google's Fairwind program for cyber defenders. Comparable claims from OpenAI and Anthropic about their security models will set up a direct contest, and independent security researchers may try to reproduce the gains on public code.