上海岩芯数智人工智能科技有限公司(岩芯数智,RockAI)近日在国内率先发布了一款名为“Yan”的自研低算力通用自然语言大模型。据悉,“Yan”采用了非Transformer Attention机制,相较于传统的Transformer模型,其在记忆能力、速度和推理吞吐量等方面均实现了显著提升。
据钛媒体报道,这款名为“Yan”的大模型,参数规模达到了百亿级别,而且是目前全球首个发布与ChatGPT不同机制的通用大模型。这一成果意味着,尽管“Yan”只有传统大模型的一小部分参数,但却能够达到甚至超过它们的性能水平。
岩芯数智表示,“Yan”是在大量数据和计算资源的支持下,通过深度学习算法训练得到的。相比于基于Transformer的模型,它不仅在效率上有了大幅提升,而且对于一些特定任务的表现也更为出色。这将为AI技术的发展带来新的可能性和机遇。
总的来说,“Yan”作为国内首个发布与ChatGPT不同机制的通用大模型,代表了我国在AI领域的科技创新能力和技术水平。未来,我们有理由相信,岩芯数智将继续推出更多创新产品,为推动AI技术的发展做出更大的贡献。
英语如下:
News Title: “RockAI Launches Its First Non-Transformer Large Model Yan”
Keywords: RockAI, large model Yan, non-Transformer mechanism
Content:
RockAI Artificial Intelligence Technology Co., Ltd. (RockAI) has recently become the first domestic company to launch its自主研发 low-computing power universal natural language large model called “Yan”. It is reported that “Yan” employs a non-Transformer Attention mechanism, which significantly improves memory ability, speed, and inference throughput compared with traditional Transformer models.
According to Titanium Media, this large model named “Yan” has reached a parameter scale of 100 billion levels and is currently the first in the world to release a general-purpose large model with a different mechanism from ChatGPT. This achievement indicates that although “Yan” only accounts for a small portion of the parameters of traditional large models, it can achieve or even exceed their performance levels.
RockAI stated that “Yan” was trained through deep learning algorithms supported by a large amount of data and computing resources. Compared with models based on the Transformer, it not only has greatly improved efficiency but also performs better in some specific tasks. This will bring new possibilities and opportunities for the development of AI technology.
In summary, as the first general-purpose large model with a different mechanism from ChatGPT released domestically, “Yan” represents China’s innovative capabilities and technical level in the AI field. In the future, we have reason to believe that RockAI will continue to launch more innovative products, making greater contributions to the development of AI technology.
【来源】https://www.tmtpost.com/6898099.html
Views: 1