Elon Musk, Yuval Noah Harari Among Those Calling On AI Labs To Pause Training AI More Advanced Than OpenAI's GPT-4

Tesla CEO Elon Musk, Apple co-founder Steve Wozniak and former US Presidential candidate Andrew Yang are among the over 1,000 signatories to an open letter that has called for all artificial intelligence (AI) labs to immediately pause the training of AI systems more powerful than OpenAI's GPT-4 for at least six months.

The signatories also include Professor Yuval Noah Harari from Hebrew University of Jerusalem, Conjecture CEO Connor Leahy, University of Montreal's Yoshua Bengio among others.

Asserting that AI systems with human-competitive intelligence can pose profound risks to society and humanity, the letter, signed by a group of intellectuals, businessmen and politicians, has also sought that the pause on AI systems' training "should be public and verifiable, and include all key actors".

"If such a pause cannot be enacted quickly, governments should step in and institute a moratorium," it said.

"As stated in the widely-endorsed Asilomar AI Principles, Advanced AI could represent a profound change in the history of life on Earth, and should be planned for and managed with commensurate care and resources. Unfortunately, this level of planning and management is not happening, even though recent months have seen AI labs locked in an out-of-control race to develop and deploy ever more powerful digital minds that no one – not even their creators – can understand, predict, or reliably control," the letter said.

The letter added that contemporary AI systems are now becoming human-competitive at general tasks.

"We must ask ourselves: Should we let machines flood our information channels with propaganda and untruth? Should we automate away all the jobs, including the fulfilling ones? Should we develop nonhuman minds that might eventually outnumber, outsmart, obsolete and replace us? Should we risk loss of control of our civilization? Such decisions must not be delegated to unelected tech leaders," the letter reads.

It added that powerful AI systems should be developed only once we are confident that their effects will be positive and their risks will be manageable. 

"This confidence must be well justified and increase with the magnitude of a system's potential effects," it said.

OpenAI in its recent statement regarding artificial general intelligence had said that "At some point, it may be important to get independent review before starting to train future systems, and for the most advanced efforts to agree to limit the rate of growth of compute used for creating new models".

"We agree. That point is now", the letter said.

"Therefore, we call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4," it added.

The letter suggested that AI labs and independent experts should use this pause to jointly develop and implement a set of shared safety protocols for advanced AI design and development that are rigorously audited and overseen by independent outside experts.

"These protocols should ensure that systems adhering to them are safe beyond a reasonable doubt," it said, adding that this does not mean a pause on AI development in general but merely a stepping back from the dangerous race to ever-larger unpredictable black-box models with emergent capabilities.

It added that AI research and development should be refocused on making today's powerful, state-of-the-art systems "more accurate, safe, interpretable, transparent, robust, aligned, trustworthy, and loyal".

In parallel, AI developers must work with policymakers to dramatically accelerate development of robust AI governance systems, it said.

The AI governance governance systems, according to the letter, should at a minimum include, "new and capable regulatory authorities dedicated to AI; oversight and tracking of highly capable AI systems and large pools of computational capability; provenance and watermarking systems to help distinguish real from synthetic and to track model leaks; a robust auditing and certification ecosystem; liability for AI-caused harm; robust public funding for technical AI safety research; and well-resourced institutions for coping with the dramatic economic and political disruptions (especially to democracy) that AI will cause".

Asserting that the society has hit pause on other technologies with potentially catastrophic effects on it, the letter said that same can be done in the AI's case too.

"Let's enjoy a long AI summer, not rush unprepared into a fall," the letter concluded.