No need for a piano! Adobe allows you to create music tracks from text prompts

No need for a piano! Adobe allows you to create music tracks from text prompts

Adobe has announced Project Music GenAI Control, a new generative artificial intelligence tool that helps create music from simple text prompts

This is the latest move by Adobe into this area since the Firefly text-to-image model was released last year and may find its way into Premiere Pro in the future

Dubbed "Photoshop for Music" by Adobe researchers, it goes beyond other text-to-music tools in that it adds fine-grained control to the process, allowing for a more fitting sound to the project

Adobe's Project Music GenAI Control was built by Adobe Research to be a co-creator of music, rather than a tool that itself creates tracks end-to-end like other generative AI music models

A number of text-to-music models of varying quality are already available, including Google's MusicFX, StabilityAI's Stable Audio, and Meta's open source AudioCraft There is also complete music creation with Suno, Cassette AI, and Splash Music

However, Adobe claims that its tools give the end user more control, allowing them to create styles, sounds, and even breaks to fit any project

Says Nicholas Bryan, senior research scientist at Adobe Research: "Whether you're a broadcaster, a podcaster, or just someone who needs audio with just the right mood, tone, and length, we can help you create music for your project

Like other tools of its kind, it is based on an underlying AI model New workflows are built on top of the model to facilitate editing of tracks that have been trained and generated in a variety of sounds and musical styles

The tool demo shows a text prompt requesting a specific music style, followed by additional prompts to change the intensity, add a style overlay, or introduce additional instruments

You can also generate a loop track or a specific loop to drop into a larger mix Simply describe what you want it to sound like and the tool will make it a reality

"The exciting thing about these new tools is that they don't just generate audio, they bring it to the level of Photoshop by giving creators the same deep control to shape, tweak, and edit the audio It's like pixel-level control for music," says Brian

Currently, this is an experimental feature being run by Adobe Research As such, the name may seem inconvenient

However, Project Music GenAI Control fits the style of other Adobe Labs projects, such as Project All of Me, an AI costume editor, and Project Beyond the Seen, which creates 360-degree panoramas from 2D images

It will not be a tool in its own right when it graduates to the lab bench It may be seen as "Photoshop for music," but in reality it will be part of the broader Adobe product line

Adobe may launch a standalone version as part of a podcast studio, like Firefly for images, but the main access would be to Premiere Pro for adding scores to movies and backtracking video clips It is likely that the company will release a stand-alone version as part of Podcast Studios

Categories