Gege AI Launches Billion-Parameter Chinese Music Model, Pre-Trained from Scratch and Integrated with ByteDance Platforms

Hangzhou Yinlv Shandong AI Technology Co., Ltd. recently released the Gege AI Music Model, a billion-parameter end-to-end music generation model pre-trained from scratch specifically for Chinese music. It addresses shortcomings of general AI music models in Chinese pronunciation, emotional expression, and genre adaptation. The model features a dual-stream independent generation architecture (vocal and accompaniment paths aligned via cross-stream attention), a phoneme-time frame soft alignment prior mechanism (improving pronunciation clarity), and a hierarchical multi-dimensional condition control system (AdaLN-Zero for emotional stability). It can generate a 3-minute stereo song on a single H-series GPU in about 10 seconds, with a real-time factor of approximately 0.05.

Technical Architecture and Localization Design

The core technical approach of the Gege AI Music Model includes:

• Dual-stream independent generation architecture: Vocals and accompaniment are generated via separate paths, with real-time alignment of rhythm and harmony through cross-stream attention, avoiding the disconnection typical of traditional post-hoc layering.
• Phoneme-time frame soft alignment prior mechanism: Pronunciation timing information of Chinese characters is injected as attention bias into the generation process, fundamentally solving syllable misalignment and unclear articulation.
• Hierarchical multi-dimensional condition control system: Global styles such as emotion, genre, and key are modulated via AdaLN-Zero at each layer, with independent guidance strength for different condition dimensions, allowing creators to adjust lyric adherence and melodic freedom separately.
• Three-stage full-chain Chinese training: Stage 1 trains a VAE for audio compression and reconstruction; Stage 2 pre-trains a billion-parameter diffusion backbone on a licensed Chinese music library; Stage 3 aligns with Chinese listener aesthetic preferences via music-domain DPO.

Efficiency and Commercialization Path

The model adopts a non-autoregressive parallel generation architecture, denoising the latent representation of the entire song in parallel. A single H-series GPU generates a 3-minute song in about 10 seconds, with a real-time factor of approximately 0.05. Combined with flow matching few-step sampling and model quantization acceleration, inference cost is extremely low, supporting block-wise continuation.

On the commercialization front, Gege AI has signed a non-exclusive music copyright revenue-sharing agreement with ByteDance. Generated original songs, recordings, and music videos can be fully compliantly uploaded to ByteDance platforms including Douyin, Jianying, Qishui Music, Xigua Video, and Toutiao. Douyin and Jianying creators can use copyright music for free, while revenue from Qishui Music subscriptions and ads is settled per contract. Newly generated non-exclusive tracks are automatically added to the licensed library.

Chinese Folk Music AI Model and Data Moat

Gege AI has simultaneously launched a dedicated Chinese folk music AI model project, planned in three steps: building a proprietary sound library for traditional instruments and local opera vocals; fine-tuning the folk music generation pipeline based on the existing architecture; and launching an independent folk music creation zone. The team has begun nationwide field recording, capturing original instrument sounds, folk tunes, and local opera vocals, which will be archived as exclusive training data after copyright clearance. The project currently has no clear commercial return timeline but aims to build a data moat.

Industry Background and Competitive Landscape

According to the IFPI Global Music Report 2026, global recorded music revenue reached $31.7 billion in 2025, with China becoming the fourth-largest music market for the first time. Deezer data shows that in April 2026, nearly 75,000 AI-generated songs were added daily, accounting for 44% of new uploads, but actual playback share was only 1%-3%, reflecting AI music overcapacity but limited user acceptance. Overseas models like Suno (valued at $5.4 billion) lead in general capabilities but have structural weaknesses in Chinese pronunciation and emotional expression. Among domestic players, ByteDance, Tencent, and NetEase treat AI music as an ecosystem supplement, while Kunlun Tech's Mureka has an annualized revenue of approximately $12 million and achieved positive gross profit. Gege AI differentiates through deep localization, developing its own model from scratch and establishing a closed-loop copyright distribution chain.