Collection of utilities aimed to voice clone through AI
Go to file
Jarod 350d2d5a95 Freeze pydantic package to 1.10.11
inflect in DLAS requirements.txt installs pydantic 2.0.2, causing issues with the Gradio Webpage
2023-07-09 02:36:23 +00:00
bin
models remove redundant phonemize for vall-e (oops), quantize all files and then phonemize all files for cope optimization, load alignment model once instead of for every transcription (speedup with whisperx) 2023-03-23 00:22:25 +00:00
modules added checkboxes to use the original method for calculating latents (ignores the voice chunk field) 2023-05-21 01:47:48 +00:00
results
src uses gitmylo/bark-voice-cloning-HuBERT-quantizer for creating custom voices (it slightly works better over the base method, but still not very good desu) 2023-07-03 02:46:10 +00:00
training
voices
.dockerignore docker support 2023-04-07 21:52:18 +00:00
.gitignore
.gitmodules
Dockerfile docker: add ffmpeg for whisper and general cleanup 2023-04-07 23:14:05 +00:00
LICENSE
notebook_colab.ipynb
notebook_paperspace.ipynb
README.md
requirements.txt Freeze pydantic package to 1.10.11 2023-07-09 02:36:23 +00:00
setup-cuda-bnb.bat setup bnb on windows as needed 2023-03-16 20:48:48 +00:00
setup-cuda.bat DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier) 2023-03-21 15:46:53 +00:00
setup-cuda.sh DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier) 2023-03-21 15:46:53 +00:00
setup-directml.bat updated setup-directml.bat to not hard require torch version because it's updated to torch2 now 2023-04-29 00:50:16 +00:00
setup-docker.sh docker support 2023-04-07 21:52:18 +00:00
setup-rocm-bnb.sh
setup-rocm.sh DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier) 2023-03-21 15:46:53 +00:00
start-docker.sh docker support 2023-04-07 21:52:18 +00:00
start.bat added PYTHONUTF8 to start/train bats 2023-03-14 02:29:11 +00:00
start.sh :) 2023-03-14 05:02:14 +00:00
train-docker.sh docker: add training script 2023-04-07 23:15:13 +00:00
train.bat ;) 2023-03-14 15:48:09 +00:00
train.sh ;) 2023-03-14 15:48:09 +00:00
update-force.bat
update-force.sh DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier) 2023-03-21 15:46:53 +00:00
update.bat
update.sh added PYTHONUTF8 to start/train bats 2023-03-14 02:29:11 +00:00

AI Voice Cloning

This repo/rentry aims to serve as both a foolproof guide for setting up AI voice cloning tools for legitimate, local use on Windows/Linux, as well as a stepping stone for anons that genuinely want to play around with TorToiSe.

Similar to my own findings for Stable Diffusion image generation, this rentry may appear a little disheveled as I note my new findings with TorToiSe. Please keep this in mind if the guide seems to shift a bit or sound confusing.

>Ugh... why bother when I can just abuse 11.AI?

You're more than welcome to, but TorToiSe is shaping up to be a very promising tool, especially with finetuning now on the horizon.

This is not endorsed by neonbjb. I do not expect this to run into any ethical issues, as it seems (like me), this is mostly for making funny haha vidya characters say funny lines.

Documentation

Please consult the wiki for the documentation.

Bug Reporting

If you run into any problems, please refer to the issues you may encounter wiki page first.