Leading AI audio company ElevenLabs has released its latest product, generative sound effects, after months of beta testing It allows you to create any noise from a simple text prompt
I've been using it myself for the past couple of months and it creates incredibly accurate sounds and even when pushed backgra
The company has described it as "turning imagination into audio" and is able to capture everything from diving into the water, jigging coins and galloping horses It suggests that you can make a sound and make a sound in a few seconds
In the beta preview, users were given 4 samples based on text prompts, each with their own interpretation by the AI model In the final release has increased to six
The ElevenLabs Sound Effects Engine is like any generated AI model, a lot of training data and how to interpret and convert text into sound
This is a sound engine from ElevenLabs including its very realistic voice engine that can replicate and replicate anyone's voice in minutes A growing collection of brand-based models
Mati Staniszewski, CEO and co-founder of Elevenlabs, said in a statement:"Last year, we revolutionized the voice of AI by creating the first truly emotional, human-like text-to-speech platform With the launch of text-to-sound effects, we're taking another big step in giving creators more audio tools to produce high-quality content"
giving it video in the future because they are also working on new music models, elevenlabs will track interactions, sound effects and soundtracks for an immersive experience
The new sound effects model data will be created as part of a new partnership with Shutterstock" It was a great experience This allowed Elevenlabs to use the Shutterstock audio library for licensed tracks to tweak the model because the Shutterstock library has an exact label
To test the sound effects feature of ElevenLab, I came up with 7 videos with obvious and not-so-obvious sounds And each generated audio The video was created using Pika Labs from a simple 1 paragraph text prompt
I gave the same prompt to the Pika Labs and ElevenLabs sound effects It worked on all of the prompts to create a more complete sound away from the fire For that I had to simplify just to "roar fireplace" as I continued to create confusing and overly complex soundscapes
Prompt: "In a cozy roaring fireplace in a rustic log cabin, flames dance vividly, logs crackle, sparks fly through the chimney A warm glow illuminates the wooden interior, casting flickering shadows
Prompt: "A bustling city street filled with traffic jams, car squeal and passing buses Skyscrapers are woven into the background, neon signs flicker, and people rush along the sidewalk The scene captures the busy and noisy atmosphere of the city
Prompt: "A calm beach at sunset when gentle sea waves collide with the shore" The sky is painted in shades of orange and pink, with seagulls flying overhead The sound of the waves creates a pleasant atmosphere
Prompt: "Dark clouds, flashes of lightning, heavy rain, dramatic thunderstorms over open fields" Thunder rings, the wind blows violently, bending the tree to feel its raw power
Prompt: "A bustling outdoor market in a vibrant city with stalls selling fresh ingredients, spices and handmade goods Vendors speak to customers, people haggle prices, and the sound of chatter and laughter fills the air The market is colorful, vibrant and full of energy
Prompt: "A busy construction site with cranes, bulldozers and workers wearing hard hats As new buildings take shape, the sounds of hammers, excavations and machines fill the air Dust rises from the ground and the scene is a hive of activity
Prompt: "An authentic rock concert with a band playing on stage under colorful lights" The crowd is cheering, clapping and singing together The lead singer's voice rises above the powerful music, and the electric guitar and drums create a thrilling and energetic atmosphere"
Comments