360公司近日在GitHub上开源了旗下大型人工智能模型——360智脑7B，该模型拥有70亿参数，能够支持50万字长文本输入。这一举动标志着我国在大型人工智能模型领域取得了重要进展。
据了解，360智脑大模型采用了3.4万亿Tokens的语料库进行训练，主要包括中文、英文和代码等内容。为了满足不同场景的需求，360智脑提供了4K、32K和360K三种不同文本长度的模型。其中，360K模型的文本长度约为50万字，是目前国产开源模型中文本长度最长的。
360智脑7B模型的开源，将为我国人工智能领域的研究者和开发者提供强大的工具。开发者可以利用这一模型进行各种人工智能应用的开发，如文本生成、对话系统、智能客服等。同时，这一模型的开源也有助于推动我国人工智能技术的发展，提升我国在全球人工智能领域的竞争力。
值得一提的是，360智脑大模型在训练过程中，采用了大规模的语料库，包括中文、英文和代码等多种语言。这使得360智脑在处理多语言文本方面具有优势，能够更好地理解和生成多种语言的文本。
360公司此次开源360智脑7B模型，展示了我国在大型人工智能模型领域的技术实力。未来，随着我国人工智能技术的不断进步，我们有理由相信，人工智能将在更多领域发挥更大的作用，为人类社会带来更多的便利。
英语如下：
### News Title: 360 launches open-source 7B parameter model for ZhiNao: supports 500,000-word long text input
### Keywords: 360 ZhiNao, open-source model, text length
#### News Content:
360 Corporation recently open-sourced its large-scale artificial intelligence model, 360 ZhiNao 7B, on GitHub. This model, with its 7 billion parameters, is capable of processing input texts up to 500,000 words in length. This move signifies significant progress in China’s large-scale AI model sector.
It is understood that the 360 ZhiNao grand model was trained on a corpus of 3.4 trillion Tokens, which includes Chinese, English, and code among other languages. To cater to diverse scenarios, 360 ZhiNao offers three models with different text lengths: 4K, 32K, and 360K. Among these, the 360K model handles texts of approximately 500,000 words, making it the longest-text open-source model developed in China.
The open-source release of the 360 ZhiNao 7B model will provide researchers and developers in China’s AI field with a powerful tool. Developers can utilize this model for the development of various AI applications, such as text generation, dialogue systems, and intelligent customer service. Moreover, the open-sourcing of this model contributes to the advancement of AI technology in China and enhances the country’s global competitiveness in the AI sector.
It is worth noting that during the training process of the 360 ZhiNao grand model, it employed a massive corpus that includes multiple languages, such as Chinese, English, and code. This has given 360 ZhiNao an advantage in handling multilingual texts, allowing it to better understand and generate text in various languages.
By open-sourcing the 360 ZhiNao 7B model, 360 Corporation has showcased China’s technical strength in the field of large-scale AI models. In the future, with the continuous progress of AI technology in our country, there is reason to believe that AI will play a greater role in more fields and bring more convenience to human society.
【来源】https://www.ithome.com/0/761/531.htm
Views: 1