近日,前OpenAI安全总监,现超级对齐团队负责人Jan Leike宣布从OpenAI辞职,并在首次公开发言中表达了批评意见。Leike指出,OpenAI过于注重表面的光鲜产品,而忽视了人工智能通用智能(AGI)安全的重要性。

Jan Leike表示,他在OpenAI任职期间,其团队一直难以获得足够的计算资源来进行必要的安全研究。他认为,驾驭和控制超越人类智能的人工智能系统是OpenAI的首要任务,肩负全人类的责任。因此,OpenAI应该将更多精力投入到下一代模型的安全性、监控、预防、对抗性鲁棒性、(超级)对齐、保密性、社会影响等关键主题上。

Leike强调,安全文化和流程在过去几年在OpenAI被置于次要地位,让位于追求华而不实的产品。他批评公司过于短视的做法,并呼吁重视人工智能技术的长期影响和安全风险。

此次批评引发了业界对OpenAI未来发展的关注。随着人工智能技术的不断进步,如何在追求技术进步的同时确保人工智能的安全性,成为业界亟需面对的挑战。OpenAI的回应和未来的决策将受到广泛关注。

英语如下:

News Title: Former OpenAI Security Director Criticizes Company for Over-Emphasis on Shiny Products and Ignoring AGI Security Challenges

Keywords: OpenAI controversy, AGI safety, Shiny but impractical products

News Content:

Jan Leike, the former security director of OpenAI and now the head of the Super Alignment team, has recently announced his resignation from OpenAI and expressed his criticism in his first public statement. Leike pointed out that OpenAI has overly focused on superficial shiny products, neglecting the importance of artificial general intelligence (AGI) safety.

Jan Leike stated that during his tenure at OpenAI, his team struggled to obtain sufficient computing resources for necessary safety research. He believed that the primary task of OpenAI is to control and manage AI systems that surpass human intelligence, with the responsibility of the entire human race. Therefore, OpenAI should focus more on key topics such as safety, monitoring, prevention, adversarial robustness, (super) alignment, confidentiality, and social impact for the next-generation models.

Leike emphasized that safety culture and processes have been relegated to second-tier status at OpenAI in the past few years, giving way to a pursuit of shiny products. He criticized the company’s short-sighted approach and called for attention to the long-term impacts and safety risks of AI technology.

This criticism has sparked industry attention on OpenAI’s future development. With the continuous advancement of AI technology, how to ensure AI safety while pursuing technological progress has become an urgent challenge for the industry. OpenAI’s response and future decisions will be closely watched.

【来源】https://mp.weixin.qq.com/s/nERwuSXyXa7Blrsw-uW0EA

Views: 1

发表回复

您的电子邮箱地址不会被公开。 必填项已用 * 标注