【全球科技讯】今日凌晨，全球知名企业家马斯克旗下的大模型公司 xAI 传出重大消息，该公司正式开源了其最新研发的超大规模语言模型——Grok-1。Grok-1 拥有惊人的3140亿参数，一举成为当前参数量最大的开源大语言模型，这一举动无疑将推动人工智能领域的技术进步和开放共享。
据机器之心报道，Grok-1 的设计基于混合专家（MoE）架构，该模型在大量文本数据的训练基础上构建，但未针对特定任务进行微调，展现出广泛的普适性。值得一提的是，Grok-1 中有25%的激活权重分配给每个给定的 token，这在大规模语言模型中是一项创新设计。
xAI 利用先进的技术栈完成了Grok-1的训练，他们采用了JAX库和Rust语言的自定义训练堆栈，所有工作均在2023年10月完成。此外，xAI秉持开源精神，遵循Apache 2.0许可证，将Grok-1的权重和网络架构全面开放给研究者和开发者，为全球AI社区提供了宝贵的资源和学习平台。
这一开源行动不仅展示了xAI在人工智能领域的技术实力，也为全球的科研人员和开发者提供了探索、学习和创新的广阔空间，预示着未来人工智能技术将有更多可能性和突破。
英语如下：
**News Title:** “Musk’s xAI Stuns with Open-Source Launch: Grok-1, a 3140-Billion-Parameter Giant, Pioneers the New Era of Large Language Models”
**Keywords:** Elon Musk, Grok-1, Open-source Large Model
**News Content:** **Global Tech Wire** – In a major announcement early today, renowned entrepreneur Elon Musk’s big model company xAI has disclosed that it has open-sourced its latest groundbreaking large language model, Grok-1. With an astonishing 3140 billion parameters, Grok-1 now stands as the largest open-source language model in terms of parameter count, poised to propel advancements and foster openness in the field of artificial intelligence.
According to Machine之心, Grok-1 is built upon a Mixed-Expert (MoE) architecture, trained on vast amounts of textual data without fine-tuning for specific tasks, demonstrating broad applicability. Notably, 25% of its activation weights are allocated to each given token, an innovative design feature in large language models.
xAI utilized an advanced tech stack to train Grok-1, employing the JAX library and a custom training stack in Rust, all accomplished by October 2023. Adhering to the spirit of open-source, xAI has released Grok-1’s weights and network architecture under the Apache 2.0 license, furnishing a valuable resource and learning platform for the global AI community.
This open-source initiative not only exhibits xAI’s technological prowess in AI but also furnishes a vast playground for researchers and developers worldwide to explore, learn, and innovate, foreshadowing a future with even more possibilities and breakthroughs in AI technology.
【来源】https://mp.weixin.qq.com/s/hvt5zwoazDx26KOaKuTs_w
Views: 1