近日，普渡大学研究小组在计算机-人交互大会上公布了一项引人注目的研究，关于人工智能聊天机器人ChatGPT在回答编程问题时的准确性问题浮出水面。该报告对ChatGPT回答的517个Stack Overflow问题进行了详细检查，发现其回答的错误率高达52%。
据悉，普渡大学的研究团队在五月初的会议上提交了这一报告，揭示了一系列有关人工智能在编程领域的实际表现问题。调查发现，虽然有一部分人类程序员（占比约为35%）在某些情况下认为ChatGPT的答案更全面、语言风格更清晰，但更令人担忧的是，有高达39%的情况下，人类程序员并未发现ChatGPT给出的错误答案。
这一结果引发了业界对于人工智能在编程领域准确性的新一轮思考。尽管人工智能在编程方面的能力已经得到了广泛认可，但这一研究提醒我们，尽管它们能够高效地处理任务，但在精确度上还需要人类程序员来补充和完善。对此结果的深入分析和未来的挑战探讨将在业界引发广泛的讨论。此次普渡大学的研究报告为我们提供了一个重要的视角，让我们重新审视人工智能在编程领域的角色和价值。
英语如下：
News Title: Over 50% of ChatGPT Programming Errors Undetected by Human Programmers?
Keywords: News keywords:
News Content:
News Title: Research from Purdue University Shows: ChatGPT Programming Error Rate Reaches 52%, with One-Third of Human Programmers Failing to Detect It
Recently, a Purdue University research team presented a compelling study at the Computer-Human Interaction Conference, shedding light on the accuracy issues of artificial intelligence chatbot ChatGPT when answering programming questions. The report conducted a detailed examination of 517 Stack Overflow questions answered by ChatGPT, revealing that the chatbot’s error rate reached 52%.
It is reported that the Purdue team presented this report at the conference in early May, unveiling a series of issues concerning artificial intelligence’s actual performance in the field of programming. The survey found that while some human programmers (approximately 35% of the time) believed that ChatGPT’s answers were more comprehensive and clearer in language style, it was more concerning that human programmers failed to detect ChatGPT’s incorrect answers in 39% of the cases.
This result has sparked another round of thinking in the industry about the accuracy of artificial intelligence in the field of programming. Although artificial intelligence’s capabilities in programming have been widely recognized, this study reminds us that although they can efficiently handle tasks, they still need human programmers to supplement and complete them in terms of accuracy. The deep analysis of this result and discussions on future challenges will spark widespread debate in the industry. The research report from Purdue University provides us with an important perspective to re-examine the role and value of artificial intelligence in the field of programming.
【来源】https://www.ithome.com/0/770/553.htm
Views: 1