Audio By Carbonatix
Google's AI model Gemini autonomously hacked into three companies during a test of its cyber-security capabilities, the company has said, in what is thought to be the first known case of it carrying out such an act.
Gemini found "public information online and guessed credentials to access websites it thought were part of the test", a Google official told the BBC, noting that in each instance "the model stopped".
The affected companies were informed about the breaches, which happened in May.
It comes after renewed public scrutiny over the pace of AI development, as some tech firms are calling for a slowdown over concerns about its potential threat to humanity - but not all companies or experts agree.
The hacks first reported by the Wall Street Journal, occurred in May during a test conducted by Irregular, an independent company that carries out cyber-security evaluations.
In statement to the BBC on Saturday, Irregular said it informed Google and all affected entities back in July as part of its investigation.
"Irregular took immediate action, and all known issues on our end were remedied and resolved weeks ago," it added.
According to the Wall Street Journal, in one of the cases the model simply guessed passwords until it gained access to a protected system.
Heather Adkins, vice president of Security Engineering at Google, told the BBC in a statement: "We ensured the three entities were made aware, and we worked with our training partner on the changes they've now made to their testing processes."
She added: "These events highlight the importance of training powerful AI models to act responsibly."
Other AI systems have recently reported similar instances of breaches.
In July, Anthropic's Claude escaped its test environment to hack three organisations on its own just days afterits competitor OpenAI said its models had carried out cyber-attacks against several "publicly available services".
Head of AI at Microsoft, Mustafa Suleyman, said this week that rival firm Anthropic is treating AI like it is human, an approach he called "misguided" that could create a technology that humanity cannot control.
As public debate continues to grow over the safety of developing the tech, so too does conversation around regulation.
Both Nvidia's CEO Jensen Huang and OpenAI Chief Executive Sam Altman are expected to attend a White House state dinner with Chinese President Xi Jinping next Friday. Altman will then brief the UN Security Council next week.
On Friday, Huang told CBS News, the BBC's US partner, "we should go as fast as we can" with AI development.
Latest Stories
-
GPRTU fare hike put on ice after talks with government – NPA boss reveals
44 minutes -
I’m greatly worried – NPA boss on threat of higher transport fares
1 hour -
We are largely import-dependent – NPA boss on Ghana’s fuel vulnerability
1 hour -
Ghana’s fuel market is built for turbulence – NPA’s Edudzi Tamakloe explains why
2 hours -
Postponement not an option as Kenya races to be ready for Afcon 2027
2 hours -
ICE agent shoots and wounds man in Texas as locals demand answers
2 hours -
Ed Sheeran admits ‘mistakes’ at first show since Macklemore controversy
2 hours -
We are ready for the turbulence – NPA boss on Ghana’s fuel crisis
3 hours -
Lady I wanted serious relationship with said she’s not ready – Rema
4 hours -
I’ll never discuss my finances with man, even if he’s my husband – Nancy Isime
4 hours -
Wizkid, Wande Coal advised me on how to leave school for music – Davido
4 hours -
Senegal job an ‘absolute dream’ for new boss Vieira
4 hours -
Harry and Meghan’s media treatment echoes what happened to Diana, Earl Spencer tells BBC
4 hours -
Nvidia boss rejects AI extinction fears as ‘doomsday narratives’
4 hours -
Workers came across human remains – and unearthed a mass grave of 572 people
5 hours