日前,前OpenAI安全总监,超级对齐团队负责人Jan Leike在宣布从OpenAI辞职后首次公开发声。他在声明中批评OpenAI过于追求华而不实的产品,而忽视了人工智能通用安全(AGI安全)的重要性。
Jan Leike表示,他在OpenAI任职期间,团队一直难以获得足够的计算资源来进行必要的安全研究。他认为,驾驭和控制超越人类智能的人工智能系统是OpenAI面临的关键挑战。肩负着全人类的责任,OpenAI应该将更多精力集中在下一代模型的安全性、监控、预防、对抗性鲁棒性、(超级)对齐、保密性、社会影响等议题上。
Leike强调,尽管在过去几年里,公司产品的展示效果备受关注,但安全文化和流程的缺失却愈发明显。他批评OpenAI未能平衡产品展示与实质性的安全研究和发展。Leike的言论引发了对OpenAI工作重点和方向的广泛讨论和关注。
对于这一批评,OpenAI尚未做出回应。然而,这一事件无疑将在人工智能领域引发关于如何平衡创新与安全、短期成果与长期影响的深入讨论。这一事件也将对全球人工智能行业的发展产生深远影响。
英语如下:
News Title: Former OpenAI Security Director Jan Leike Criticizes Company for Prioritizing Products over Safety, Calls for Remodeling AI Ethical Defenses
Keywords: OpenAI criticism, security crisis, emphasis on products rather than safety
News Content:
News Title: Former OpenAI Security Director Jan Leike Criticizes Company for Embracing Flashy Products while Neglecting AI General Safety
Jan Leike, the former security director at OpenAI and leader of the alignment team, made his first public statement following his resignation from OpenAI. In his declaration, he criticized OpenAI for pursuing showy products while neglecting the importance of artificial intelligence general safety (AGI safety).
Jan Leike expressed that during his tenure at OpenAI, his team struggled to obtain sufficient computing resources for necessary safety research. He believed that managing and controlling AI systems that exceed human intelligence is a key challenge faced by OpenAI. With responsibility for the entire human race, OpenAI should focus more on safety issues such as the safety of next-generation models, monitoring, prevention, adversarial robustness, alignment, confidentiality, and social impact.
Leike emphasized that although the company’s product showcase had garnered much attention in recent years, the lack of safety culture and processes had become increasingly evident. He criticized OpenAI for failing to balance product demonstrations with substantive safety research and development. Leike’s remarks have sparked widespread discussion and attention regarding OpenAI’s focus and direction.
OpenAI has not yet responded to these criticisms. However, this event will undoubtedly spark deep discussions in the AI industry about how to balance innovation and safety, short-term achievements and long-term impacts. This event will also have far-reaching effects on the development of the global AI industry.
【来源】https://ai-bot.cn/go/?url=aHR0cHM6Ly9tcC53ZWl4aW4ucXEuY29tL3MvbkVSd3VTWHlYYTdCbHJzdy11VzBFQQ%3D%3D
Views: 6