mrq/ai-voice-cloning
31
74
Fork 43
Code Issues 223 Pull Requests 5 Packages Projects Releases Wiki Activity
Collection of utilities aimed to voice clone through AI
297 Commits 1 Branch 0 Tags 12 MiB
Python 91.1%
Jupyter Notebook 4.9%
Shell 2.1%
Batchfile 1.1%
Dockerfile 0.8%
0ea93a7f40
Go to file
mrq 0ea93a7f40 more cleanup, use 24KHz for preparing for VALL-E (encodec will resample to 24Khz anyways, makes audio a little nicer), some other things
2023-03-23 01:52:26 +00:00
bin
config VALL-E config edits 2023-03-20 01:22:53 +00:00
models remove redundant phonemize for vall-e (oops), quantize all files and then phonemize all files for cope optimization, load alignment model once instead of for every transcription (speedup with whisperx) 2023-03-23 00:22:25 +00:00
modules Added option to unsqueeze sample batches after sampling 2023-03-21 21:34:26 +00:00
results
src more cleanup, use 24KHz for preparing for VALL-E (encodec will resample to 24Khz anyways, makes audio a little nicer), some other things 2023-03-23 01:52:26 +00:00
training
voices
.gitignore experimental multi-gpu training (Linux only, because I can't into batch files) 2023-03-03 04:37:18 +00:00
.gitmodules while I'm breaking things, migrating dependencies to modules folder for tidiness 2023-03-09 04:03:57 +00:00
LICENSE
notebook_colab.ipynb share if you 2023-03-08 15:59:16 +00:00
notebook_paperspace.ipynb fixed notebooks, provided paperspace notebook 2023-03-08 03:29:12 +00:00
README.md I forgot about the changelog and never kept up with it, so I'll just not use a changelog 2023-03-08 05:14:50 +00:00
requirements.txt setup bnb on windows as needed 2023-03-16 20:48:48 +00:00
setup-cuda-bnb.bat setup bnb on windows as needed 2023-03-16 20:48:48 +00:00
setup-cuda.bat DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier) 2023-03-21 15:46:53 +00:00
setup-cuda.sh DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier) 2023-03-21 15:46:53 +00:00
setup-directml.bat DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier) 2023-03-21 15:46:53 +00:00
setup-rocm-bnb.sh while I'm breaking things, migrating dependencies to modules folder for tidiness 2023-03-09 04:03:57 +00:00
setup-rocm.sh DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier) 2023-03-21 15:46:53 +00:00
start.bat added PYTHONUTF8 to start/train bats 2023-03-14 02:29:11 +00:00
start.sh :) 2023-03-14 05:02:14 +00:00
train.bat ;) 2023-03-14 15:48:09 +00:00
train.sh ;) 2023-03-14 15:48:09 +00:00
update-force.bat removed the hotfix pip installs that whisperx requires now that whisperx is gone 2023-03-11 16:55:19 +00:00
update-force.sh DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier) 2023-03-21 15:46:53 +00:00
update.bat added button to just load a training set's loss information, added installing broncotc/bitsandbytes-rocm when running setup-rocm.sh 2023-03-02 01:35:12 +00:00
update.sh added PYTHONUTF8 to start/train bats 2023-03-14 02:29:11 +00:00

README.md

AI Voice Cloning

This repo/rentry aims to serve as both a foolproof guide for setting up AI voice cloning tools for legitimate, local use on Windows/Linux, as well as a stepping stone for anons that genuinely want to play around with TorToiSe.

Similar to my own findings for Stable Diffusion image generation, this rentry may appear a little disheveled as I note my new findings with TorToiSe. Please keep this in mind if the guide seems to shift a bit or sound confusing.

>Ugh... why bother when I can just abuse 11.AI?

You're more than welcome to, but TorToiSe is shaping up to be a very promising tool, especially with finetuning now on the horizon.

This is not endorsed by neonbjb. I do not expect this to run into any ethical issues, as it seems (like me), this is mostly for making funny haha vidya characters say funny lines.

Documentation

Please consult the wiki for the documentation.

Bug Reporting

If you run into any problems, please refer to the issues you may encounter wiki page first.