RVC
Retrieval-based voice conversion — train a voice model on minutes of audio
About
RVC (Retrieval-based Voice Conversion) is the open-source voice-conversion framework behind the AI-cover wave: train a model of any voice on as little as ~10 minutes of audio, then convert any speech or singing into that voice. The project's classic Gradio WebUI (RVC-Project/Retrieval-based-Voice-Conversion-WebUI, 38.7k stars, actively maintained) covers model training, inference, and real-time voice changing; the core repo scored here is being rewritten as a pip-installable rvc library/API (pip install git+..., rvc init scaffolds assets/ and .env). Base models are trained on open VCTK data. MIT licensed. Note the obvious misuse surface: voice cloning enables impersonation — check consent and local deepfake law before publishing converted voices.
What it can do
- Train a voice-conversion model on <=10 minutes of target audio
- Convert speech or singing to the target voice (AI covers)
- Real-time voice changing (obs-rvc companion repo)
- Retrieval-based VITS architecture for quality on small datasets
- Gradio WebUI for training/inference (WebUI repo)
- Pip-installable rvc library + CLI (`rvc init`) in the rewritten core
- Pretrained base models on Hugging Face
Setup
Library form (verified from README of RVC-Project/Retrieval-based-Voice-Conversion):
```bash
pip install git+https://github.com/RVC-Project/Retrieval-based-Voice-Conversion
mkdir my-voice && cd my-voice
rvc init # creates assets/ (models) and .env in an empty directory
```
Then follow the repo README/docs for the train and infer commands (the library is under active development — expect API churn).
Classic WebUI form (the 38.7k-star product most tutorials cover):
```bash
git clone https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI
# follow its README (Python 3.10, PyTorch, then launch the Gradio UI)
```
Pretrained base models are hosted on Hugging Face (lj1995/VoiceConversionWebUI).
Prerequisites
Python 3.10-ish + PyTorch (NVIDIA GPU strongly recommended for training; inference can run on weaker hardware). ~10 minutes of clean target-voice audio for training a new model. Substantial disk for checkpoints. Legal: consent of the voice owner where required.
Use cases
Works with
Trust score — 8/10
Scored 8/10 (verified tier, metrics-v1). Evidence: 38,705 GitHub stars (log-scaled vs catalog peers); last push 70d ago; 1 releases/12mo; 585 open issues. Manual review: repo stats from flagship WebUI repo (38k★); bare repo mid-rewrite into pip lib; misuse surface (impersonation/deepfakes). License: MIT.
★ 622 GitHub stars
How the trust score is built
Full methodology →- Adoption · stars/downloads, log-scaled vs peers
- 8.5/10
- Maintenance · recency, releases, issue load
- 6.6/10
- Openness · license + docs
- 10.0/10
- Manual review · sanity read + red-flag check
- 8.0/10
- · 38,705 GitHub stars (log-scaled vs catalog peers)
- · last push 70d ago; 1 releases/12mo; 585 open issues
- · manual review: repo stats from flagship WebUI repo (38k★); bare repo mid-rewrite into pip lib; misuse surface (impersonation/deepfakes)
Sources
Every fact above was checked against these sources. Where a claim comes from the provider and couldn't be independently verified, the text says so.