

Yue
Overview :
YuE is an open-source music generation model developed by the Hong Kong University of Science and Technology and a multimodal art projection team. It can generate full songs up to 5 minutes long, including vocals and accompaniment, based on given lyrics. The model addresses the complex issues of lyric-to-song generation through various technological innovations, such as semantic-enhanced audio taggers, dual-tagging technology, and lyrical chain thinking. The main advantages of YuE include its ability to produce high-quality musical works and support for multiple languages and music styles, offering strong scalability and controllability. The model is currently free and open-source, aimed at promoting the advancement of music generation technology.
Target Users :
YuE is designed for music creators, music producers, audio engineers, and researchers interested in music generation technology. It helps creators quickly produce the first drafts of musical works, inspires creative ideas, and can be used in music education and entertainment, providing users with a brand new musical experience.
Use Cases
Generate a pop-style Chinese song 'My Love' with lyrics created by GPT and melody and accompaniment produced by YuE.
Generate a metal-style English song 'Step Back,' showcasing YuE's performance capability in the heavy metal genre.
Generate a jazz-style English song 'Quiet Evening,' highlighting YuE's finesse in the jazz genre.
Features
Supports lyric-to-song generation in multiple languages, including English, Chinese, Japanese, and Korean.
Able to generate various music styles, such as pop, rock, jazz, and rap.
Utilizes semantic-enhanced audio taggers to reduce training costs and accelerate convergence.
Achieves synchronized modeling of vocals and accompaniment through dual-tagging technology.
Employs lyrical chain thinking techniques to incrementally generate entire songs.
Provides a variety of model checkpoints and upsamplers for user convenience and expansion.
Supports multilingual code switching for cross-language music creation.
Capable of learning and generating complex vocal techniques, such as death growls and harmonization.
How to Use
1. Visit the YuE GitHub page to download the necessary model checkpoints.
2. Prepare the lyrics text, selecting the desired language and music style.
3. Use the tools provided by YuE to split the lyrics into multiple segments.
4. Input the lyric segments into the YuE model to generate corresponding music segments.
5. Stitch the generated music segments together to create a complete song.
6. Use an upsampler for further optimization of the generated music (optional).
7. Adjust the generated music parameters, such as tempo and pitch, to meet personal preferences.
8. Export the final generated music file for sharing or further creative work.
Featured AI Tools

Gemini
Gemini is the latest generation of AI system developed by Google DeepMind. It excels in multimodal reasoning, enabling seamless interaction between text, images, videos, audio, and code. Gemini surpasses previous models in language understanding, reasoning, mathematics, programming, and other fields, becoming one of the most powerful AI systems to date. It comes in three different scales to meet various needs from edge computing to cloud computing. Gemini can be widely applied in creative design, writing assistance, question answering, code generation, and more.
AI Model
11.4M
Chinese Picks

Liblibai
LiblibAI is a leading Chinese AI creative platform offering powerful AI creative tools to help creators bring their imagination to life. The platform provides a vast library of free AI creative models, allowing users to search and utilize these models for image, text, and audio creations. Users can also train their own AI models on the platform. Focused on the diverse needs of creators, LiblibAI is committed to creating inclusive conditions and serving the creative industry, ensuring that everyone can enjoy the joy of creation.
AI Model
6.9M