Tiangong Large Model 3.0 to be Released Soon: Simultaneously Open-Sourcing a 400-Billion-Parameter MoE Super Model
-
According to an official post by Kunlun Wanwei, the Tiangong Large Model 3.0 will be officially released on April 17, along with the simultaneous open-sourcing of a 400-billion-parameter MoE super model.
This model employs a 400-billion-parameter MoE hybrid expert architecture, making it one of the largest and most powerful MoE models globally in terms of parameter scale and performance. Compared to the previous generation Skywork 2.0 MoE model, Skywork 3.0 demonstrates remarkable performance enhancements across multiple domains. It shows significant improvements in model semantic understanding, logical reasoning, generalizability, uncertainty knowledge, and learning capabilities. Specifically, the model's technical knowledge has improved by over 20%, while its abilities in mathematics, reasoning, coding, and creative writing have increased by more than 30%.
Skywork 3.0 introduces several new features, such as search enhancement, research mode, code execution and chart drawing, and multiple web search calls. Additionally, it has been specifically trained for Agent capabilities, enabling Skywork 3.0 to independently plan, call, and combine external tools and information. This allows it to accurately and efficiently handle various complex tasks, such as industry analysis and product comparisons, providing users with a groundbreaking artificial intelligence experience. Tiangong 3.0 is a multimodal "super model" that integrates multiple AI capabilities, including AI search, AI writing, AI long-text reading, AI dialogue, AI voice synthesis, AI image generation, AI comic creation, AI image recognition, AI music generation, AI code writing, and AI table generation. It can be considered a "super application" in the era of large models.
Particularly noteworthy is that the AI music generation model SkyMusic in Tiangong 3.0 will open for invitation-based testing on April 2, which undoubtedly further demonstrates the strong innovation and application capabilities of Tiangong 3.0. Overall, the release and open-sourcing of TianGong Large Model 3.0 will undoubtedly advance technological progress and application innovation in the field of artificial intelligence, presenting fresh opportunities and challenges for both industry and academia.