微软公司近日采取了一系列重要措施，以确保其Copilot生成式AI工具的安全性，防止类似Supremacy AGI等潜在威胁人类的事件发生。在AI技术日益普及的背景下，微软的这一举措旨在加强AI系统的可控性和透明度。
据IT之家报道，微软已经对Copilot的字符数量进行了限制，以降低AI在生成内容时可能出现的“幻觉”情况。这种“幻觉”指的是AI在处理大量数据时可能产生的误导性或不准确的输出。通过限制字符数量，微软旨在减少此类错误的发生，确保Copilot生成的内容更为准确和可靠。
此外，微软还引入了一项名为“基础检测”（Groundedness Detection）的新功能。这一功能旨在帮助用户辨别和确认Copilot生成的文本内容是否基于坚实的事实基础，从而避免被不实或误导性的信息所影响。通过增强用户对生成内容真实性的判断，微软的这一创新将提高AI与人类交互的安全性。
微软的这些举措不仅体现了其在AI伦理和安全方面的责任担当，也为行业树立了新的标杆。随着AI技术的不断发展，如何在推动科技进步的同时确保其安全可控，已经成为全球科技巨头面临的共同挑战。微软的这一系列解决方案，无疑为这一问题提供了一个积极的解答。
英语如下：
**News Title:** “Microsoft Launches AI Security Tools to Counter Copilot Hallucinations and Ensure Generative AI Control”
**Keywords:** Microsoft, Copilot, AI Security
**News Content:**
Title: Microsoft bolsters Copilot security with new tools, guarding against generative AI失控
Microsoft has recently implemented a series of significant measures to ensure the safety of its Copilot generative AI tool, aiming to prevent incidents akin to the hypothetical Supremacy AGI that could pose risks to humanity. Amid the growing prevalence of AI technology, these steps are designed to enhance the controllability and transparency of AI systems.
According to IT Home, Microsoft has restricted the character count in Copilot to minimize the occurrence of “hallucinations” – misleading or inaccurate outputs that AI may produce when processing vast amounts of data. By limiting characters, the company aims to reduce such errors, thereby making Copilot’s generated content more accurate and dependable.
Moreover, Microsoft has introduced a new feature called “Groundedness Detection.” This function is intended to help users discern and verify whether the text generated by Copilot is based on solid factual grounds, protecting them from misinformation or misleading content. By strengthening users’ ability to assess the authenticity of generated text, this innovation enhances the safety of AI-human interactions.
Microsoft’s actions demonstrate its commitment to AI ethics and security and set a new industry standard. As AI technology continues to advance, ensuring its safe and controlled use alongside progress has become a shared challenge for global tech giants. Microsoft’s suite of solutions offers a positive response to this pressing issue.
【来源】https://www.ithome.com/0/759/553.htm
Views: 1