An arms race for artificial intelligence (AI) supremacy, triggered by recent panic over Chinese chatbot DeepSeek, risks amplifying the existential dangers of superintelligence, according to one of the “godfathers” of AI.
Canadian machine learning pioneer Yoshua Bengio, author of the first International AI Safety Report to be presented at an international AI summit in Paris next week, warns unchecked investment in computational power for AI without oversight is dangerous.
“The effort is going into who’s going to win the race, rather than how do we make sure we are not going to build something that blows up in our face,” Mr Bengio says.
He warns that military and economic races “result in cutting corners on ethics, cutting corners on responsibility and on safety. It’s unavoidable”.
Mr Bengio worked on neural networks and machine learning, the software architecture that underpins modern AI models.
He is in London, along with other AI pioneers to receive the Queen Elizabeth Prize for Engineering, the most prestigious global award for engineering, in recognition of AI and its potential.
He’s enthusiastic about its benefits for society, but the pivot away from AI regulation by Donald Trump‘s White House and frantic competition among big tech companies for more powerful AI models is a worrying shift.
‘Superhuman systems becoming more powerful’
“We are building systems that are more and more powerful; becoming superhuman in some dimensions,” he says.
“As these systems become more powerful, they also become extraordinarily more valuable, economically speaking.
“So the magnitude of, ‘wow, this is going to make me a lot of money’ is motivating a lot of people. And of course, when you want to sell products, you don’t want to talk about the risks.”
But not all the “godfathers” of AI are so concerned.
Take Yann LeCun, Meta’s chief AI scientist, also in London to share in the QEPrize.
Yann LeCun, Meta’s Chief AI scientist
“We have been deluded into thinking that large language models are intelligent, but really, they’re not,” he says.
“We don’t have machines that are nearly as smart as a house cat, in terms of understanding the physical world.”
Within three to five years, Mr LeCun predicts, AI will have some aspects of human-level intelligence. Robots, for example, that can perform tasks they’ve not been programmed or trained to do.
Read more:
What is DeepSeek? The low-cost Chinese AI firm that has turned the tech world upside down
Bill Gates says he would be diagnosed with autism if he was young today
But, he argues, rather than make the world less safe, open-source AI models such as DeepSeek – a chatbot developed by a Chinese company that rivals the best of America’s big tech with a tenth of the computing power – demonstrates no one will dominate for long.
“If the US decides to clam up when it comes to AI for geopolitical reasons, or, commercial reasons, then you’ll have innovation someplace else in the world. DeepSeek showed that,” he says.
The Queen Elizabeth Prize for Engineering prize is awarded each year to engineers whose discoveries have, or promise to have, the greatest impact on the world.
Previous recipients include the pioneers of photovoltaic cells in solar panels, wind turbine technology and neodymium magnets found in hard drives, and electric motors.
Science minister Lord Vallance, who chairs the QEPrize foundation, says he is alert to the potential risks of AI.
Organisations such as the UK’s new AI Safety Institute are designed to foresee and prevent the potential harms AI “human-like” intelligence might bring.
Science minister Lord Vallance
But he is less concerned about one nation or company having a monopoly on AI.
“I think what we’ve seen in the last few weeks is it’s much more likely that we’re going to have many companies in this space, and the idea of single-point dominance is rather unlikely,” he says.