AI Voice Cloning

ai-voice-cloning.md

AI Voice Cloning

Table of Contents

• Services
• Guides, Colabs, etc
• Tools
• See Also

Services

• https://elevenlabs.io/
  • https://elevenlabs.io/speech-synthesis

    • The First Generative Speech Synthesis Platform Generate lifelike speech in any language and voice with the most powerful Text to Speech and Voice Cloning software.

  • https://elevenlabs.io/voice-lab

    • Generative Voice AI Clone your voice or create entirely new synthetic voices using the most advanced Generative AI technology ever.

  • https://elevenlabs.io/voice-library

    • Discover AI Voices Crafted by the Community Get access to an ever-growing library of high quality AI voices and discover characters that perfectly fit your needs.

  • https://elevenlabs.io/professional-voice-cloning

    • Professional Voice Cloning Create the perfect digital replica of your voice using the most advanced voice cloning AI. We create AI models on your voice from the grounds up to offer the most realistic voice cloning experience ever.

  • https://elevenlabs.io/projects

    • Your Audiobook Workshop Generate, edit, and customize long-form spoken audio with precision, all within a streamlined workflow.

• https://create.musicfy.lol/
  • https://create.musicfy.lol/parody
• https://lalals.com/voices/
• https://www.uberduck.ai/
• https://voice.ai/
• https://www.myvocal.ai/
• https://app.kits.ai/
  • https://app.kits.ai/community-voices
  • https://app.kits.ai/convert/royalty-free
  • https://app.kits.ai/library/trained
• https://play.ht/voice-cloning/
• https://speechify.com/voice-cloning/

Guides, Colabs, etc

• RVC v2 AI Cover Guide (by kalomaze)
  • Colab: Easy GUI (for RVC v2, with crepe) (with improved downloader)
  • Colab: AICoverGen WebUI
• Training RVC v2 models Guide (by kalomaze)
  • RVC Crepe v2 + persistent storage / autosave
• RVC Models Archive Sheet

Tools

• https://github.com/myshell-ai/OpenVoice

  • Instant voice cloning by MyShell

  • https://research.myshell.ai/open-voice

    • OpenVoice: Versatile Instant Voice Cloning

  • https://arxiv.org/abs/2312.01479

    • OpenVoice: Versatile Instant Voice Cloning

    • We introduce OpenVoice, a versatile voice cloning approach that requires only a short audio clip from the reference speaker to replicate their voice and generate speech in multiple languages. OpenVoice represents a significant advancement in addressing the following open challenges in the field: 1) Flexible Voice Style Control. OpenVoice enables granular control over voice styles, including emotion, accent, rhythm, pauses, and intonation, in addition to replicating the tone color of the reference speaker. The voice styles are not directly copied from and constrained by the style of the reference speaker. Previous approaches lacked the ability to flexibly manipulate voice styles after cloning. 2) Zero-Shot Cross-Lingual Voice Cloning. OpenVoice achieves zero-shot cross-lingual voice cloning for languages not included in the massive-speaker training set. Unlike previous approaches, which typically require extensive massive-speaker multi-lingual (MSML) dataset for all languages, OpenVoice can clone voices into a new language without any massive-speaker training data for that language. OpenVoice is also computationally efficient, costing tens of times less than commercially available APIs that offer even inferior performance. To foster further research in the field, we have made the source code and trained model publicly accessible. We also provide qualitative results in our demo website. Prior to its public release, our internal version of OpenVoice was used tens of millions of times by users worldwide between May and October 2023, serving as the backend of MyShell.

  • https://github.com/camenduru/OpenVoice-colab

    • OpenVoice-colab

• https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI

  • Retrieval-based-Voice-Conversion-WebUI

• https://github.com/SociallyIneptWeeb/AICoverGen

  • A WebUI to create song covers with any RVC v2 trained AI voice from YouTube videos or audio files.

• https://github.com/w-okada/voice-changer

  • Realtime Voice Changer

• https://github.com/yxlllc/DDSP-SVC

  • Real-time end-to-end singing voice conversion system based on DDSP (Differentiable Digital Signal Processing)

• https://github.com/isletennos/MMVC_Trainer

  • Real-time voice changer using AI (Trainer)

• https://github.com/svc-develop-team/so-vits-svc

  • SoftVC VITS Singing Voice Conversion [Archived]

• https://github.com/voicepaw/so-vits-svc-fork

  • so-vits-svc fork with realtime support, improved interface and more features

• https://github.com/quickvc/QuickVC-VoiceConversion

  • QuickVC: Any-to-many Voice Conversion Using Inverse Short-time Fourier Transform for Faster Conversion

• https://github.com/auspicious3000/contentvec

  • ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakers

  • https://arxiv.org/abs/2204.09224
• https://github.com/uberduck-ai/uberduck-ml-dev

  • Uberduck Synthetic Speech

  • ML models for Uberduck

See Also

• Text generation web UI - A Gradio web UI for LLMs. AUTOMATIC1111/stable-diffusion-webui
• text-generation-webui/extensions/coqui_tts
• Music APIs and DBs (0xdevalias' gist)
• Singing Voice Synthesizers (eg. Vocaloid, etc) (0xdevalias' gist)
• Audio Pitch Correction (eg. autotune, melodyne, etc) (0xdevalias' gist)
• Generating Synth Patches with AI (0xdevalias' gist)
• Compare/Diff Audio Files (0xdevalias' gist)
• Working Around FLStudio Trial Limitations (0xdevalias' gist)