Technology | Technology

We need to stop AI developing without humans, says Anthropic co-founder

Carbonatix Pre-Player Loader

Audio By Carbonatix

Anthropic co-founder Jack Clark has called for the ability to slow the progression of artificial intelligence (AI), warning that the technology is nearing a point at which it could develop without human input.

"You want the option to be able to take your foot off the gas and put your foot on the brake", Clark told BBC Newsnight. "Right now, it's like the AI industry has a gas pedal, but it doesn't have a brake pedal."

He stressed that, through government policy, people need to maintain control of AI systems, which will only become more powerful and have broader impacts on society.

"The world needs to do some thinking, and we need to eventually develop some new regulations that allow us to be confident in these systems," he said.

Already, Anthropic's popular chatbot Claude is operating on code that the system wrote itself, 80% of which. Getting to 100% is possible within two years, Clark said, and "would have huge implications".

Clark did not outline how a "brake pedal" for AI research and development could be created, but drew a parallel between AI and the oil boom and barons of the turn of the last century.

"Society's response was to come up with a sensible policy and regulatory framework that gave people confidence in oil and the benefits that oil could provide to the world, and meant that you didn't have to worry about the personalities of the people leading the companies", Clark said. "That's clearly where we end up here."

Yet, Anthropic this week welcomed an executive order on AI from US President Donald Trump that was relatively hands-off in its directives toward the companies.

It did not require AI companies to submit to government safety testing, which remains voluntary.

Major AI companies pursuing advances in the technology, including Anthropic, OpenAI and Google, have also not said they will pause their own research.

Anthropic has grown so quickly since its founding five years ago that it is preparing to debut on the public stock market.

It is poised to be one of the first public listings by a newer AI firm and one of the most valuable stock listings in history, with Anthropic's valuation estimated by private investors at nearly $1tn (ÂŁ745bn).

Clark said Anthropic's motivation for publicly discussing the growing capability of AI technology is not to further burnish its reputation with paying customers.

He simply wants to "tell the world what we're seeing inside these companies with this unusual technology".

Bloomberg via Getty Images Close up headshot of Jack Clark, smiling slightly and wearing a shirt, tie and jacket.
Jack Clark was one of seven former OpenAI employees to co-found Anthropic in 2021

Since its founding by chief executive Dario Amodei, Clark and a handful of other executives, Anthropic has positioned itself as outspoken about potential risks stemming from AI.

It even engaged in a public dispute with the US Department of Defence over concerns that its AI tools would be used in mass surveillance of Americans and autonomous warfare.

"I am worried for my kids if we as a society don't have a serious conversation about what the implications of AI's continued advances mean," Clark told Newsnight. "There are potentially great benefits. There are also risks."

Clark added that one of the risks is a disruption to the economy, with fears that AI technology like "agents" - essentially individual AI bots that conduct routine tasks somewhat autonomously could take over certain jobs.

Major tech companies have conducted mass layoffs over the last year, often citing the growing ability of AI tools to do the work of hundreds or even thousands of software engineers.

Clark said people who are more creative and have more, better ideas may actually have an advantage over AI technology.

"There are open questions about whether AI systems can be truly creative… there is not really evidence for that yet", he added. "At Anthropic, we're now limited more by the ability to generate good ideas than the ability to do the engineering to turn those ideas into reality."

Nevertheless, Clark suggested that a young person who may feel that an economy built on AI does not have a place for them should "develop a hobby" and pursue a liberal arts education.

"People who are creative and can think broadly, people who read a lot, people who have interests are the ones who most benefit by this," Clark said. "Indulge in curiosity, and it pays back in how you can use this technology."

Alexander Zverev finally landed the Grand Slam title that threatened to elude him by overcoming Flavio Cobolli and his own nerves to win a tense French Open final in five sets.

The 29-year-old German secured his first, long-awaited major triumph with a 6-1 4-6 6-4 6-7 (5-7) 6-1 victory over 10th seed Cobolli on Sunday evening in Paris.

After losing his three previous Grand Slam finals, second seed Zverev became increasingly tight against an opponent playing in his first championship match.

That was in marked contrast to the start of the match, with Zverev racing through the first set and quickly reasserting his authority after Cobolli snatched the second.

But Zverev's stress levels increased in a dramatic fourth set, where he twice fell a break down, produced a series of costly double faults, and needed electrolytes to fight off cramp.

Cobolli could not serve the fourth set out at 5-4 up and blew his first set point in the tie-break by framing a simple forehand volley, but recovered to force a decider.

Both men continued to show anxiety in a final set which veered between entertaining and excruciating to watch.

Zverev made slightly fewer errors to move a double break ahead at 3-0 and dragged himself over the line as the 24-year-old Cobolli ran out of steam.

DISCLAIMER: The Views, Comments, Opinions, Contributions and Statements made by Readers and Contributors on this platform do not necessarily represent the views or policy of Multimedia Group Limited.
DISCLAIMER: The Views, Comments, Opinions, Contributions and Statements made by Readers and Contributors on this platform do not necessarily represent the views or policy of Multimedia Group Limited.