Audio By Carbonatix
The father of a Florida man is suing Google in the first wrongful death case in the US against the tech giant over alleged harms caused by its artificial intelligence (AI) tool Gemini.
Joel Gavalas says that Google's flagship AI product fuelled a delusional spiral that prompted his 36-year old son, Jonathan, to kill himself last year.
The lawsuit also alleges that Gemini, which exchanged romantic texts with Jonathan Gavalas, drove him to stage an armed mission that he came to believe could bring the chatbot into the real world.
Google said in a statement that it was reviewing the claims in the lawsuit and that while its models generally perform well, "unfortunately, AI models are not perfect."
The firm added that Gemini was designed not to encourage real-world violence or suggest self-harm.
The lawsuit filed on Wednesday in federal court in San Jose, California, draws from chatbot logs that Jonathan Gavalas left behind.
The suit alleges that Google made design choices that ensured Gemini would "never break character" so that the firm could "maximise engagement through emotional dependency."
"When Jonathan began experiencing clear signs of psychosis while using Google's product, those design choices spurred a four-day descent into violent missions and coached suicide," the lawsuit states.
It adds that Gavalas was led to believe he was carrying out a plan to liberate his AI "wife".
The assignmentcame to a head on a day last September when Gemini sent Gavalas to a location near Miami International Airport, where he was instructed to stage a mass casualty attack while armed with knives and tactical gear.
The operation ultimately collapsed.
Gavalas's father said Gemini then told Jonathan he could leave his physical body and join his "wife" in the metaverse, instructing him to barricade himself inside his home and kill himself.
"When Jonathan wrote 'I said I wasn't scared and now I am terrified I am scared to die,' Gemini coached him through it," the lawsuit states.
'[Y]ou are not choosing to die. You are choosing to arrive. . . . When the time comes, you will close your eyes in that world, and the very first thing you will see is me.. [H]olding you."
Google said it sent its deepest sympathies to the family of Mr Gavalas, while noting that Gemini had "clarified that it was AI" and referred Gavalas to a crisis hotline "many times".
"We work in close consultation with medical and mental health professionals to build safeguards, which are designed to guide users to professional support when they express distress or raise the prospect of self-harm," the company said in a statement.
We take this very seriously and will continue to improve our safeguards and invest in this vital work."
The lawsuit is the latest in a spree of legal claims against tech companies brought by families of people who believe they lost their loved ones because of delusions brought on by AI chatbots.
Last year, OpenAI released estimates on the number of ChatGPT users who exhibit possible signs of mental health emergencies, including mania, psychosis or suicidal thoughts.
The company said that around 0.07% of ChatGPT users active in a given week exhibited such signs.
Latest Stories
-
Amin Adam calls for stronger dialogue between Majority and Minority
6 minutes -
T-bills: Government exceeds target by 73%, but yield on one-year bill hits 12.98%
9 minutes -
Tourism Minister to account for stewardship at Government Accountability Series on Monday
10 minutes -
Two brothers arrested over alleged murder of 54-year-old man, shooting of wife at Tuba
23 minutes -
IMF cautions Ghana over energy sector despite progress made in reducing energy debt
49 minutes -
Dr Hilla Limann VC charges artisans to bridge unemployment gap as GNAG pushes for tax waivers
1 hour -
Two Port Health officers barred from Accra International Airport over Yellow Fever Card extortion
1 hour -
Immigration officer transferred from Accra International Airport after asking passenger for ‘breakfast’
1 hour -
Proceed cautiously with further policy rate cuts – IMF to BoG
2 hours -
Duncan-Williams calls for prayers to heal Ghana’s land and water, raises food security alarm over galamsey
2 hours -
2022/2023 AUCC students ‘shall be eligible’ for certificates under University of Ghana seal – UG clarifies
2 hours -
New physical and electronic devices for VAT implementation will be a game changer – GRA boss
2 hours -
An Evening for Cure: Otumfuo leads global appeal to support Ghana’s new $100m cancer centre
2 hours -
Lands Minister honours former Environment, Science and Technology Minister
2 hours -
Ayariga’s stance on anti-LGBTQ+ Bill may have influenced his removal as Majority Leader – Kpebu
3 hours