AI can pose Risk of Extinction: Top experts issue warning

Artificial intelligence (AI) has become an indispensable part of our lives, revolutionizing various industries and enhancing our capabilities. However, leading computer scientists and technologists have recently raised concerns about the potential risks associated with AI, going so far as to issue a warning of its "risk of extinction." This dire prediction has prompted a call for global action to address the dangers posed by AI, putting it on par with other societal-scale risks such as pandemics and nuclear war.
A group of AI experts and high-profile figures, including renowned technology leaders like Sam Altman, Geoffrey Hinton, and Audrey Tang, joined forces to issue this warning. Their statement, released by the Center for AI Safety, a San Francisco-based research and advocacy group, emphasizes the urgent need to prioritize mitigating the risk of AI-driven extinction. Notably, the signatories also include notable figures such as neuroscientist Sam Harris and musician Grimes, showcasing the broad support for this cause.

This recent call for action echoes a previous open letter signed by Elon Musk and other influential figures in March. The letter advocated for a six-month pause on the development of AI systems that surpass the capabilities of OpenAI's GPT-4. The underlying principle behind these appeals is that powerful AI systems should only be developed once there is confidence in their positive effects and manageable risks.



The rapid advancement of AI technology has sparked concerns about its potential negative consequences for society. These range from widespread job losses and copyright infringement to the dissemination of misinformation and political instability. Some experts even fear that humanity may eventually lose control over AI, with potentially disastrous implications.

Although current AI systems have not yet achieved artificial general intelligence (AGI), which would enable them to make independent decisions, there have been significant developments in this field. In March, researchers at Microsoft noted that GPT-4 displayed "sparks of AGI" and showcased the ability to tackle novel and complex tasks across various domains, including mathematics, coding, vision, medicine, law, and psychology, without specific instructions.

The mounting concerns surrounding AI have prompted influential figures like Geoffrey Hinton to take action. Hinton, a renowned computer scientist, recently resigned from his position at Google to dedicate more time to advocating for AI risk awareness. Similarly, Sam Altman, the CEO of OpenAI, stressed the importance of regulatory frameworks for AI during his testimony before the United States Congress. He recommended a licensing-based approach to ensure responsible development and deployment of AI technology. Governments worldwide are grappling with the challenge of striking the right balance between oversight and encouraging innovation, with the European Union aiming to pass comprehensive AI legislation by the end of the year, including risk-based categorization.

China has also recognized the need for AI regulation and has taken significant steps in this direction. The country has implemented legislation specifically addressing deep fakes and requires companies to register their algorithms with regulators. Moreover, Beijing has proposed stringent rules to restrict politically-sensitive content and introduced a mandatory approval process for the release of generative AI-based technologies.