北京——360公司近日在开源社区GitHub上发布了一项重大举措，将他们的360智脑7B大模型公之于众，这是一款拥有70亿参数的先进人工智能模型。该模型的推出，标志着国内AI技术在文本处理能力上迈出了新的一步。
据IT之家报道，360智脑7B模型在训练过程中使用了庞大的3.4万亿Tokens的语料库，涵盖了中文、英文以及代码等多种语言，显示了其跨语言处理的强大能力。尤其引人注目的是，360公司开放了4K、32K和360K三种不同长度的文本输入，其中360K的文本长度相当于约50万字，这一长度在国产开源模型中尚属首次。
360公司表示，这一创举旨在推动AI技术的普及和创新，为开发者和研究者提供更强大的工具，以应对日益增长的长文本处理需求。50万字的输入限制打破了以往的行业标准，将极大地拓宽AI在文本理解和生成领域的应用范围，包括但不限于自然语言处理、机器翻译、智能写作等多个领域。
这一开源行动不仅体现了360公司在AI技术研发上的领先地位，也展现了其对开放源代码文化的承诺和对行业生态的积极贡献。此举有望激发更多的开发者和研究团队参与到AI技术的探索与实践中，共同推动中国乃至全球的人工智能技术向前发展。
英语如下：
**News Title:** “360 Brain 7B Model Open Source: A Record 500,000-Character Input, Pioneering New Heights for Domestic AI”
**Keywords:** 360 Brain, 7 billion parameters, open-source text
**News Content:**
**Title:** 360 Company Open Sources 7 Billion Parameter 360 Brain 7B Model, Paving the Way for Domestic AI Innovation
**Beijing** — 360 Company recently made a significant move by releasing their 360 Brain 7B large language model on GitHub, an advanced AI model with 7 billion parameters. This launch signifies a new milestone for domestic AI technology in text processing capabilities.
According to IT Home, the 360 Brain 7B model was trained using a massive 3.4 trillion Tokens corpus, encompassing Chinese, English, and code in multiple languages, demonstrating its prowess in cross-lingual processing. Notably, 360 Company has opened up text input lengths of 4K, 32K, and 360K, with the 360K length corresponding to approximately 500,000 characters, a first for domestic open-source models.
360 Company states that this initiative aims to promote the普及 and innovation of AI technology, providing developers and researchers with more powerful tools to address the growing demand for long-text processing. The 500,000-character input limit breaks previous industry standards and will significantly broaden the application scope of AI in text understanding and generation, including but not limited to natural language processing, machine translation, and intelligent writing.
This open-source move not only underscores 360 Company’s leadership in AI R&D but also demonstrates its commitment to open-source culture and its positive contribution to the industry ecosystem. It is expected to inspire more developers and research teams to engage in AI exploration and practice, collectively propelling AI technology forward in China and globally.
【来源】https://www.ithome.com/0/761/531.htm
Views: 1