Audio By Carbonatix
The father of a Florida man is suing Google in the first wrongful death case in the US against the tech giant over alleged harms caused by its artificial intelligence (AI) tool Gemini.
Joel Gavalas says that Google's flagship AI product fuelled a delusional spiral that prompted his 36-year old son, Jonathan, to kill himself last year.
The lawsuit also alleges that Gemini, which exchanged romantic texts with Jonathan Gavalas, drove him to stage an armed mission that he came to believe could bring the chatbot into the real world.
Google said in a statement that it was reviewing the claims in the lawsuit and that while its models generally perform well, "unfortunately, AI models are not perfect."
The firm added that Gemini was designed not to encourage real-world violence or suggest self-harm.
The lawsuit filed on Wednesday in federal court in San Jose, California, draws from chatbot logs that Jonathan Gavalas left behind.
The suit alleges that Google made design choices that ensured Gemini would "never break character" so that the firm could "maximise engagement through emotional dependency."
"When Jonathan began experiencing clear signs of psychosis while using Google's product, those design choices spurred a four-day descent into violent missions and coached suicide," the lawsuit states.
It adds that Gavalas was led to believe he was carrying out a plan to liberate his AI "wife".
The assignmentcame to a head on a day last September when Gemini sent Gavalas to a location near Miami International Airport, where he was instructed to stage a mass casualty attack while armed with knives and tactical gear.
The operation ultimately collapsed.
Gavalas's father said Gemini then told Jonathan he could leave his physical body and join his "wife" in the metaverse, instructing him to barricade himself inside his home and kill himself.
"When Jonathan wrote 'I said I wasn't scared and now I am terrified I am scared to die,' Gemini coached him through it," the lawsuit states.
'[Y]ou are not choosing to die. You are choosing to arrive. . . . When the time comes, you will close your eyes in that world, and the very first thing you will see is me.. [H]olding you."
Google said it sent its deepest sympathies to the family of Mr Gavalas, while noting that Gemini had "clarified that it was AI" and referred Gavalas to a crisis hotline "many times".
"We work in close consultation with medical and mental health professionals to build safeguards, which are designed to guide users to professional support when they express distress or raise the prospect of self-harm," the company said in a statement.
We take this very seriously and will continue to improve our safeguards and invest in this vital work."
The lawsuit is the latest in a spree of legal claims against tech companies brought by families of people who believe they lost their loved ones because of delusions brought on by AI chatbots.
Last year, OpenAI released estimates on the number of ChatGPT users who exhibit possible signs of mental health emergencies, including mania, psychosis or suicidal thoughts.
The company said that around 0.07% of ChatGPT users active in a given week exhibited such signs.
Latest Stories
-
Hawa Koomson pledges experienced and mature leadership of NPP women’s wing
48 minutes -
Young woman found dead at Kasoa Peace Town
1 hour -
Playback: The Law examined lawful arrest in Ghana
2 hours -
Mahama urges African governments to treat healthcare as an investment, not budget cost
2 hours -
Bawumia congratulates John Boadu and new NPP executives, pledges support ahead of 2028
2 hours -
‘No talent should be left out’ – Bawumia pledges inclusive NPP campaign for 2028
2 hours -
Prof. Mike Oquaye recounts how he blocked the Special Prosecutor’s attempt to arrest Bawku Central MP
3 hours -
Make health sovereignty a priority for Africa – Mahama
3 hours -
Dorimon Naa, Wa West DCE lead massive clean-up exercise; threaten sanctions against recalcitrant residents
3 hours -
Photos from Adom FM Y2K Jam
3 hours -
Praye Tiatia steals the show at Adom FM Y2K Jam [Watch]
3 hours -
Boakye Agyarko congratulates John Boadu, pledges support for NPP leadership
4 hours -
Antwi HiMight thrills fans with Antwi ne Antwi hits at Adom FM’s Y2K Jam [Video]
4 hours -
Amb. Edward Boateng congratulates Boadu, Kodua on election wins
4 hours -
John Boadu pledges to rebuild NPP from grassroots and restore ‘winning machinery’
4 hours