Adobe has announced Project Music GenAI Control, a new generative artificial intelligence tool that helps create music from simple text prompts
This is the latest move by Adobe into this area since the Firefly text-to-image model was released last year and may find its way into Premiere Pro in the future
Dubbed "Photoshop for Music" by Adobe researchers, it goes beyond other text-to-music tools in that it adds fine-grained control to the process, allowing for a more fitting sound to the project
Adobe's Project Music GenAI Control was built by Adobe Research to be a co-creator of music, rather than a tool that itself creates tracks end-to-end like other generative AI music models
A number of text-to-music models of varying quality are already available, including Google's MusicFX, StabilityAI's Stable Audio, and Meta's open source AudioCraft There is also complete music creation with Suno, Cassette AI, and Splash Music
However, Adobe claims that its tools give the end user more control, allowing them to create styles, sounds, and even breaks to fit any project
Says Nicholas Bryan, senior research scientist at Adobe Research: "Whether you're a broadcaster, a podcaster, or just someone who needs audio with just the right mood, tone, and length, we can help you create music for your project
Like other tools of its kind, it is based on an underlying AI model New workflows are built on top of the model to facilitate editing of tracks that have been trained and generated in a variety of sounds and musical styles
The tool demo shows a text prompt requesting a specific music style, followed by additional prompts to change the intensity, add a style overlay, or introduce additional instruments
You can also generate a loop track or a specific loop to drop into a larger mix Simply describe what you want it to sound like and the tool will make it a reality
"The exciting thing about these new tools is that they don't just generate audio, they bring it to the level of Photoshop by giving creators the same deep control to shape, tweak, and edit the audio It's like pixel-level control for music," says Brian
Currently, this is an experimental feature being run by Adobe Research As such, the name may seem inconvenient
However, Project Music GenAI Control fits the style of other Adobe Labs projects, such as Project All of Me, an AI costume editor, and Project Beyond the Seen, which creates 360-degree panoramas from 2D images
It will not be a tool in its own right when it graduates to the lab bench It may be seen as "Photoshop for music," but in reality it will be part of the broader Adobe product line
Adobe may launch a standalone version as part of a podcast studio, like Firefly for images, but the main access would be to Premiere Pro for adding scores to movies and backtracking video clips It is likely that the company will release a stand-alone version as part of Podcast Studios
Comments