Skip to content
This week I recommend: Riffle
The AI Musicpreneur
AI Tools News

Voice-Swap brings AI voice cloning to your DAW: Here’s how it works

5 min read Published By Christopher Wieduwilt
The image depicts a music production software interface (DAW) using the Voice Swap free VST plugin. On the left, there are tracks labeled with various instruments like bass and guitar. On the right, a window titled "Lead Vox" displays a list of names and avatars, each representing different voice models. Color-coded audio tracks are visible in the background.

🎧 Hear it as a podcast (Yes, this is AI):

Voice-Swap, the ethical voice cloning company co-founded by DJ Fresh, has launched a free revolutionary VST plugin that promises to transform how artists, producers, and songwriters work with vocals. This groundbreaking tool allows users to effortlessly transform vocal recordings within their Digital Audio Workstation (DAW), opening up new possibilities for creative expression and collaboration.

With just a few clicks, users can select an artist from a drop-down menu of licensed voices, drag and drop their audio, and within seconds, morph their recording into the voice of that artist. This seamless integration into existing workflows makes it easier than ever for music creators to experiment with different vocal styles and timbres.


Here’s what’s inside:


Custom model training: Your voice, your control

✓ Create personal AI voices
✓ Secure sharing options

One of the most exciting features of Voice-Swap‘s new offering is the custom model training feature. This innovative tool allows users to create their own voice models, which can be shared privately with collaborators, producers, labels, band members, and more. This enables them to access and use the user’s distinctive voice within the VST plugin.

To create a custom voice model, users simply need to:

The image shows a dark-themed interface of Voice-Swap with the title "Train a new model" in light purple text. Below it, instructions for uploading 20 to 40 minutes of singing at 44.1kHz 16bit are provided. There’s a text field labeled "My Voice" and a section prompting users to drag and drop or click to upload audio files.
Credit: Voice Swap
  1. Go to the Voice-Swap website
  2. Navigate to the “My Models” section
  3. Click “Create New Model” and name it
  4. Upload high-quality, dry acapella audio (20-40 minutes for best results)

Once trained, the new voice model will automatically be available in Voice-Swap’s existing web platform, its stem separation tool Stem-Swap, its free VST plugin, and via API for third-party integrations.

I recently tested four AI platforms that offer voice cloning capabilities. While Voice Swap has now launched a self-service tool, it wasn’t part of my original evaluation. I examined established options like Kits.AI and Controlla, among others. These platforms are making professional-grade voice synthesis increasingly accessible. You can find my detailed test results here.

✓ Fair compensation for artists
✓ Rigorous copyright checks

Voice-Swap’s commitment to ethical AI practices is evident in their approach to royalties and copyright protection. Royalties are automatically generated for the original artist whose voice has been used, ensuring ethical and fair compensation. This model sets a new standard for the industry, balancing innovation with respect for artists’ rights.

To ensure the highest standards of copyright protection, all custom voice model training data is meticulously cross-referenced against BMAT’s extensive database of over 180 million audio fingerprints. This crucial step prevents unauthorized voices from being created, safeguarding the rights of vocal artists and is the first solution of its kind in the industry.

Furthermore, Voice-Swap has recently been certified by Fairly Trained, a non-profit organization that evaluates and certifies AI technologies based on their respect for creators’ rights. Fairly Trained’s certification confirms that Voice-Swap’s AI models are trained using ethically sourced datasets, further solidifying the company’s commitment to fair and responsible AI development in the music industry. This certification aligns with the growing importance of ethical AI in music creation.

The future of vocal production

Music producer in a home studio looking concentrated while producing music.

✓ Streamlined collaboration
✓ Enhanced creative possibilities

Voice-Swap CEO and co-founder Dan Stein aka DJ Fresh stated, “Being able to load up your favorite vocalist straight into your DAW has always been the vision for Voice-Swap. Now you can also make your own high-quality models and load them straight into your session.”

This technology is poised to significantly speed up and streamline the vocal production process. It offers singers and songwriters around the world a brand-new way to collaborate, while maintaining full control over who can utilize their voice model.

Getting started with Voice-Swap

✓ Easy installation process
✓ Versatile usage options

To start using Voice-Swap’s new VST plugin:

  1. Download and install the plugin from their website
  2. Open the plugin in your DAW and explore its features
  3. Choose from licensed voices or use your custom model
  4. Drag and drop your audio to transform vocals instantly

The plugin supports both VST and AU formats, making it compatible with a wide range of DAWs.In conclusion, Voice-Swap’s new free VST plugin and custom model training feature represent a significant leap forward in vocal production technology.

By combining cutting-edge AI with ethical practices, Voice-Swap is not only pushing the boundaries of creativity but also setting new standards for fair compensation and copyright protection in the music industry. As this technology continues to evolve, it will undoubtedly open up exciting new possibilities for artists, producers, and music creators around the world.

About the author

Photo of Christopher Wieduwilt

Christopher Wieduwilt

AI Music Educator & Journalist

Covering AI music tools, industry shifts, and news for music creators and professionals. Twice-weekly newsletter at aimusicpreneur.com.

Share this article