The advent of generative AI has revolutionized the creative landscape, offering unprecedented possibilities for creating art. Among these new tools, the most intriguing is perhaps in the realm of music. But how proficient can AI be at making music without ever having the capacity to hear it?
What Is MusicFX?
MusicFX is one of Google’s latest generative AI tools designed to create music based on user prompts. Built on the foundation of MusicLM released in 2023, MusicFX is part of Google’s AI Test Kitchen, alongside other tools like TextFX, ImageFX, and VideoFX. Users can generate, save, and access their creations across these various platforms.
MusicFX is not unique in its field. Tools like Suno and Udio also produce impressively realistic music. Even Google has ventured into AI music before with Dream Track for YouTube Shorts, which uses artists’ vocals to generate music in their styles. However, MusicFX takes a different approach, avoiding vocals and emulation of existing bands or songs, focusing instead on creating original, instrumental compositions.
Generating Music with Prompts
Using MusicFX is straightforward. In the basic prompts mode, you input a simple text prompt, and the tool generates two versions of the music, which you can download and share. You can also customize the duration of the track and enable looping for continuous playback, making it ideal for background music.
One of MusicFX’s standout features is its intuitive prompt recognition. It identifies keywords and offers customization options, including a tempo slider. For example, with a prompt like “Upbeat techno song with guitars in the background. It builds up toward the end,” MusicFX produced a lively track with guitars that gradually intensified, demonstrating its capability to handle diverse musical requests.
MusicFX excels in genres that don’t rely heavily on vocals, such as electronic, jazz, hip-hop beats, Lo-Fi, ambient, and classical music. It also performs admirably across other genres, generating unique compositions based on user inputs.
DJ Mode: Controlled Chaos
DJ Mode is a more experimental feature in MusicFX. It allows users to blend different instruments, genres, and styles in real time using “chips.” This mode creates a continuous virtual DJ set, where users manage the elements and diversity of the output. While it offers less precise control than the basic prompts mode, it provides an engaging and fun way to create music.
For instance, starting with a slap bass line and adding a droning guitar riff and steel drum resulted in a harmonious and interesting mix. However, the lack of fine-tuning means the AI sometimes makes unexpected choices, which can be both exciting and challenging.
Jamming with MusicFX
MusicFX is not just a tool but a potential jam partner. Musicians can experiment by combining AI-generated tracks with their instrumentals. As demonstrated by experimental musician Marc Rebillet at Google I/O, MusicFX can serve as a foundation for creating original tunes with a bit of creativity and musical knowledge.
Limitations of MusicFX
Despite its capabilities, MusicFX has limitations. The absence of lyrics and the restriction against emulating specific artists are notable drawbacks, likely in place to avoid copyright issues. Additionally, the tool can sometimes produce unexpected results, requiring users to relinquish some control over the music’s final form.
Nevertheless, MusicFX is a polished and versatile tool, suitable for generating original music for various purposes. It offers a refreshing alternative to traditional music streaming services, providing a unique and adaptive listening experience based on user prompts.