Meta’s Open Source AI Language Model MusicGen Can Convert Text and Melody Into Complete Music Pieces

On June 12, Meta made an announcement that it has open-sourced its AI language model MusicGen on GitHub. This model is based on Google’s Transformer model that was launched in 2017 and is primarily used for music generation.

MusicGen can convert text and existing melodies into complete compositions. The R&D team stated that they utilized 20,000 hours of authorized music to train the model.

They also used Meta’s EnCodec encoder to decompose audio data into smaller units for parallel processing, which resulted in MusicGen’s computing efficiency and generation speed being faster than other AI models of the same type.

meta musicgen ai model

MusicGen also has a feature that supports the combined input of text and melody.

For instance, users can propose to generate “a light song” and simultaneously ask to “combine it with Beethoven’s ‘Ode to Joy’.” The R&D team conducted tests to evaluate MusicGen’s performance.

The results show that MusicGen performs better on indicators such as the degree of matching between music and text prompts and the credibility of composition when compared with Google’s MusicLM and other music models such as Riffusion, Mousai, and Noise2Music. MusicGen is generally slightly higher than Google MusicLM’s level.

Meta has licensed the model for commercial use and has published a demo web application on Huggingface.

You can find the model’s code in the link here.

The demo version of the MusicGen Model can be found here: Click here.

So guys, if you liked this post and wish to receive more tech stuff delivered daily, don’t forget to subscribe to the Inspire2Rise newsletter to obtain more timely tech news, updates and more!

Keep visiting for more such excellent posts, internet tips, and gadget reviews, and remember we cover, “Everything under the Sun!”

inspire2rise10revised

Follow Inspire2rise on Twitter. | Follow Inspire2rise on Facebook. | Follow Inspire2rise on YouTube.

Love to experience and learn about new gadgets and technology. New technology is not good or evil by itself. It's all about how people choose to use it!


Meta’s Open Source AI Language Model MusicGen Can Convert Text and Melody Into Complete Music Pieces

Leave a Comment

Discover more from Inspire2Rise

Subscribe now to keep reading and get access to the full archive.

Continue reading