Tech experts, Silicon Valley billionaires and everyday Americans have voiced their concerns that artificial intelligence could spiral out of control and lead to the downfall of humanity. Now, researchers at the Center for AI Safety have detailed exactly what “catastrophic” risks AI poses to the world.
“The world as we know it is not normal,” researchers with the Center for AI Safety (CAIS) wrote in a recent paper titled “An Overview of Catastrophic AI Risks.” “We take for granted that we can talk instantaneously with people thousands of miles away, fly to the other side of the world in less than a day, and access vast mountains of accumulated knowledge on devices we carry around in our pockets.”
That reality would’ve been “inconceivable” to people centuries ago and remained far-fetched even a few decades back, the paper stated. A pattern in history has emerged of “accelerating development,” the researchers noted.
“Hundreds of thousands of years elapsed between the time Homo sapiens appeared on Earth and the agricultural revolution,” the researchers continued. “Then, thousands of years passed before the industrial revolution. Now, just centuries later, the artificial intelligence (AI) revolution is beginning. The march of history is not constant—it is rapidly accelerating.”
“As with all powerful technologies, AI must be handled with great responsibility to manage the risks and harness its potential for the betterment of society,” Hendrycks and his colleagues Mantas Mazeika and Thomas Woodside wrote. “However, there is limited accessible information on how catastrophic or existential AI risks might transpire or be addressed.”
Hendrycks told Fox News Digital that the aim of the paper is “to provide a survey of catastrophic risks from AI, and it is meant to be accessible to a wide audience, including policymakers and others interested in learning more about the risks.”
“I hope this can be useful for government leaders looking to learn about AI’s impacts,” Hendrycks added.
Fast-forward nearly 30 years, AI could potentially be used to create a bioweapon that could have devastating effects on humanity if a bad actor gets their hands on the technology. The CAIS researchers floated a hypothetical where a research team open sources an “AI system with biological research capabilities” that is intended to save lives, but could actually be repurposed by bad actors to create a bioweapon.
“In situations like this, the outcome may be determined by the least risk-averse research group. If only one research group thinks the benefits outweigh the risks, it could act unilaterally, deciding the outcome even if most others don’t agree. And if they are wrong and someone does decide to develop a bioweapon, it would be too late to reverse course,” the study states.
“The immense potential of AIs has created competitive pressures among global players contending for power and influence. This ‘AI race’ is driven by nations and corporations who feel they must rapidly build and deploy AIs to secure their positions and survive. By failing to properly prioritize global risks, this dynamic makes it more likely that AI development will produce dangerous outcomes,” the research paper outlines.
In the military, the AI race could translate to “more destructive wars, the possibility of accidental usage or loss of control, and the prospect of malicious actors co-opting these technologies for their own purpose” as AI gains traction as a useful military weapon.
Artificial intelligence could also open the floodgates to more accurate and fast cyberattacks that could decimate infrastructure or even spark a war between nations.
“To reduce risks from an AI race, we suggest implementing safety regulations, international coordination, and public control of general-purpose AIs,” the paper suggests to help prevent such outcomes.
Artificial Intelligence is hacking datas in the near future. (iStock)
The researchers behind the paper say labs and research teams building AI systems “could suffer catastrophic accidents, particularly if they do not have a strong safety culture.”
“As we progress in developing advanced AI systems, it is crucial to remember that these systems are not immune to catastrophic accidents. An essential factor in preventing accidents and maintaining low levels of risk lies in the organizations responsible for these technologies,” the researchers wrote.
The researchers argue that even in the absence of bad actors or competitive pressure, AI could have catastrophic effects on humanity due to human error alone. In the case of the Challenger or Chernobyl, there was already well established knowledge on rocketry and nuclear reactors when chaos struck, but AI in comparison is far less understood.
“AI lacks a comprehensive theoretical understanding, and its inner workings remain a mystery even to those who create it. This presents an added challenge of controlling and ensuring the safety of a technology that we do not yet fully comprehend,” the researchers argued.
“Rapid and unpredictable evolution of AI capabilities presents a significant challenge for preventing accidents. After all, it is difficult to control something if we don’t even know what it can do or how far it may exceed our expectations,” the researchers explained.
The researchers suggest that organizations establish better cultures and structures to reduce such risks, such as through “internal and external audits, multiple layers of defense against risks, and military-grade information security.”
Artificial Intelligence words are seen in this illustration taken March 31, 2023. (REUTERS/Dado Ruvic/Illustration)
One of the most common concerns with artificial intelligence since the proliferation of the tech in recent years is that humans could lose control and computers overpower human intelligence.
Researchers cited an example from the Soviet Union when authorities began measuring nail factories’ performances based on how many nails a factory was able to produce. To exceed or meet expectations, factories began mass producing tiny nails that were essentially useless due to their size.
“The authorities tried to remedy the situation by shifting focus to the weight of nails produced. Yet, soon after, the factories began to produce giant nails that were just as useless, but gave them a good score on paper. In both cases, the factories learned to game the proxy goal they were given, while completely failing to fulfill their intended purpose,” the researchers explained.
Researchers suggest that companies not deploy AI systems with open-ended goals like “make as much money as possible,” and supporting AI safety research that can hash out in-the-weeds research to prevent catastrophes.
“Although there has been years of research by many people on some of these topics, it has been spread across many different sources and it can be difficult for people newly interested in the field to sort through it. Our paper hopes to provide a comprehensive and easily digestible overview of catastrophic AI risks, how they relate to each other, and steps we can take to mitigate them. In addition to being accessible to non-technical readers, we hope the paper will also be useful to technical experts who want a high-level overview of issues before looking into the technical details,” Hendrycks told Fox News Digital.