YuE
Y
Yue
Overview :
YuE is an open-source music generation model developed by the Hong Kong University of Science and Technology and a multimodal art projection team. It can generate full songs up to 5 minutes long, including vocals and accompaniment, based on given lyrics. The model addresses the complex issues of lyric-to-song generation through various technological innovations, such as semantic-enhanced audio taggers, dual-tagging technology, and lyrical chain thinking. The main advantages of YuE include its ability to produce high-quality musical works and support for multiple languages and music styles, offering strong scalability and controllability. The model is currently free and open-source, aimed at promoting the advancement of music generation technology.
Target Users :
YuE is designed for music creators, music producers, audio engineers, and researchers interested in music generation technology. It helps creators quickly produce the first drafts of musical works, inspires creative ideas, and can be used in music education and entertainment, providing users with a brand new musical experience.
Total Visits: 51.7K
Top Region: US(22.10%)
Website Views : 93.3K
Use Cases
Generate a pop-style Chinese song 'My Love' with lyrics created by GPT and melody and accompaniment produced by YuE.
Generate a metal-style English song 'Step Back,' showcasing YuE's performance capability in the heavy metal genre.
Generate a jazz-style English song 'Quiet Evening,' highlighting YuE's finesse in the jazz genre.
Features
Supports lyric-to-song generation in multiple languages, including English, Chinese, Japanese, and Korean.
Able to generate various music styles, such as pop, rock, jazz, and rap.
Utilizes semantic-enhanced audio taggers to reduce training costs and accelerate convergence.
Achieves synchronized modeling of vocals and accompaniment through dual-tagging technology.
Employs lyrical chain thinking techniques to incrementally generate entire songs.
Provides a variety of model checkpoints and upsamplers for user convenience and expansion.
Supports multilingual code switching for cross-language music creation.
Capable of learning and generating complex vocal techniques, such as death growls and harmonization.
How to Use
1. Visit the YuE GitHub page to download the necessary model checkpoints.
2. Prepare the lyrics text, selecting the desired language and music style.
3. Use the tools provided by YuE to split the lyrics into multiple segments.
4. Input the lyric segments into the YuE model to generate corresponding music segments.
5. Stitch the generated music segments together to create a complete song.
6. Use an upsampler for further optimization of the generated music (optional).
7. Adjust the generated music parameters, such as tempo and pitch, to meet personal preferences.
8. Export the final generated music file for sharing or further creative work.
AIbase
Empowering the Future, Your AI Solution Knowledge Base
© 2025AIbase