I have not tried this as of yet.
Hong Kong University of Science and Technology researchers just introduced YuE, an open-source AI music generation that transforms lyrics into complete songs, challenging closed commercial platforms like Suno and Udio. The details:
- YuE leverages two specialized models — one for vocals and music and another for production elements — enabling the creation of songs up to 5 minutes in length.
- The system supports multiple languages and can handle complex vocal techniques like scatting and mixed-voice performances.
- Users can fine-tune their creations with controls for genre, instruments, mood, and vocal characteristics while still maintaining a coherent musical structure.
With commercial AI music platforms like Suno and Udio facing growing legal challenges from record labels, an open-source system could seriously shake up the space. Whether from YuE or another entrant, broader access to AI music tools is coming fast – and the music industry is already reckoning with the changes.