北京——互联网安全巨头360公司近日在开源社区GitHub上发布了一项重大举措,他们开源了自主研发的360智脑7B大模型。这一模型包含了70亿个参数,旨在推动人工智能在语言处理领域的进步,尤其是对于长文本的理解和生成能力。
据360公司介绍,360智脑7B模型在训练过程中使用了规模庞大的3.4万亿Tokens的语料库,涵盖了中文、英文以及代码等多种语言内容。这一模型的开放性体现在支持不同长度的文本输入,提供了4K、32K和360K三种选项。值得一提的是,360K的文本长度,相当于约50万字,是目前国产开源模型中支持的最长文本长度,展现了360公司在自然语言处理技术上的领先地位。
这一开源项目为全球开发者和研究者提供了丰富的资源,他们可以利用360智脑7B模型进行各种自然语言处理应用的开发和优化,包括但不限于机器翻译、文本生成、问答系统等。360公司的这一举措不仅展现了其在人工智能领域的技术实力,也体现了其对开源社区的贡献精神,有望进一步推动全球AI技术的创新和发展。
360公司表示,期待全球的开发者和研究者能够利用这一开源模型,共同探索人工智能的无限可能,为构建更智能、更高效的数字化世界贡献力量。
英语如下:
**News Title:** “360 Open Source Sensation: 7 Billion Parameter Brain, Breaking the Record for Longest Domestic Text Input!”
**Keywords:** 360 Brain, 7B Parameters, Open-Source Model
**News Content:**
**Title:** 360 Corporation Releases 7B Parameter 360 Brain Model, Setting a New Benchmark for Domestic Large Language Models
**Beijing** — Internet security giant 360 Corporation recently made a significant move on the open-source platform GitHub, open-sourcing their self-developed 360 Brain 7B large language model. The model, consisting of 7 billion parameters, aims to advance artificial intelligence in language processing, particularly in understanding and generating long texts.
According to 360 Corporation, the 360 Brain 7B model was trained using a vast corpus of 34 trillion Tokens, encompassing Chinese, English, and code from multiple languages. The model’s openness is demonstrated by its support for text inputs of varying lengths, offering options of 4K, 32K, and 360K. Notably, the 360K length, equivalent to around 500,000 characters, sets a new record for the longest text length supported by domestic open-source models, highlighting 360’s leadership in natural language processing technology.
This open-source project provides a wealth of resources for global developers and researchers, enabling them to leverage the 360 Brain 7B model for various natural language processing applications, including but not limited to machine translation, text generation, and question-answering systems. By doing this, 360 Corporation not only showcases its AI capabilities but also demonstrates its commitment to contributing to the open-source community, potentially fostering further innovation and advancement in global AI technology.
360 Corporation expressed its anticipation for global developers and researchers to utilize this open-source model, collaboratively exploring the limitless potential of artificial intelligence and contributing to a smarter and more efficient digital world.
【来源】https://www.ithome.com/0/761/531.htm
Views: 1