Managing extreme AI risks amid rapid progress
arxiv(2023)
摘要
Artificial Intelligence (AI) is progressing rapidly, and companies are
shifting their focus to developing generalist AI systems that can autonomously
act and pursue goals. Increases in capabilities and autonomy may soon massively
amplify AI's impact, with risks that include large-scale social harms,
malicious uses, and an irreversible loss of human control over autonomous AI
systems. Although researchers have warned of extreme risks from AI, there is a
lack of consensus about how exactly such risks arise, and how to manage them.
Society's response, despite promising first steps, is incommensurate with the
possibility of rapid, transformative progress that is expected by many experts.
AI safety research is lagging. Present governance initiatives lack the
mechanisms and institutions to prevent misuse and recklessness, and barely
address autonomous systems. In this short consensus paper, we describe extreme
risks from upcoming, advanced AI systems. Drawing on lessons learned from other
safety-critical technologies, we then outline a comprehensive plan combining
technical research and development with proactive, adaptive governance
mechanisms for a more commensurate preparation.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要