Collection of utilities aimed to voice clone through AI

Go to file

mrq 14779a5020 Added option to skip transcribing if it exists in the output text file, because apparently whisperx will throw a "max files opened" error when using ROCm because it does not close some file descriptors if you're batch-transcribing or something, so poor little me, who's retranscribing his japanese dataset for the 305823042th time woke up to it partially done i am so mad I have to wait another few hours for it to continue when I was hoping to wake up to it done		2023-03-06 10:47:06 +00:00
bin
config
dlas@6eb7ebf847	oops v2	2023-03-05 14:19:41 +00:00
models	added option to set worker size in training config generator (because the default is overkill), for whisper transcriptions, load a specialized language model if it exists (for now, only english), output transcription to web UI when done transcribing	2023-03-05 05:17:19 +00:00
results
src	Added option to skip transcribing if it exists in the output text file, because apparently whisperx will throw a "max files opened" error when using ROCm because it does not close some file descriptors if you're batch-transcribing or something, so poor little me, who's retranscribing his japanese dataset for the 305823042th time woke up to it partially done i am so mad I have to wait another few hours for it to continue when I was hoping to wake up to it done	2023-03-06 10:47:06 +00:00
tortoise-tts@6fcd8c604f	print in e-notation for LR	2023-03-05 19:48:24 +00:00
training
voices
.gitignore	experimental multi-gpu training (Linux only, because I can't into batch files)	2023-03-03 04:37:18 +00:00
.gitmodules
LICENSE
notebook.ipynb
README.md
requirements.txt	added api_name for generation, added whisperx backend, relocated use whispercpp option to whisper backend list	2023-03-06 05:21:33 +00:00
setup-cuda.bat
setup-cuda.sh
setup-directml.bat
setup-rocm-bnb.sh
setup-rocm.sh
start.bat
start.sh
train.bat
train.sh	use torchrun instead for multigpu	2023-03-04 20:53:00 +00:00
update-force.bat
update-force.sh
update.bat
update.sh	added api_name for generation, added whisperx backend, relocated use whispercpp option to whisper backend list	2023-03-06 05:21:33 +00:00

README.md

AI Voice Cloning

This repo/rentry aims to serve as both a foolproof guide for setting up AI voice cloning tools for legitimate, local use on Windows/Linux, as well as a stepping stone for anons that genuinely want to play around with TorToiSe.

Similar to my own findings for Stable Diffusion image generation, this rentry may appear a little disheveled as I note my new findings with TorToiSe. Please keep this in mind if the guide seems to shift a bit or sound confusing.

>Ugh... why bother when I can just abuse 11.AI?

You're more than welcome to, but TorToiSe is shaping up to be a very promising tool, especially with finetuning now on the horizon.

This is not endorsed by neonbjb. I do not expect this to run into any ethical issues, as it seems (like me), this is mostly for making funny haha vidya characters say funny lines.

Documentation

Please consult the wiki for the documentation, including how to install, prepare voices for, and use the software.

Bug Reporting

If you run into any problems, please refer to the issues you may encounter wiki page first. Please don't hesitate to submit an issue.

Changelogs

Below will be a rather-loose changelogss, as I don't think I have a way to chronicle them outside of commit messages:

`2023.02.22`

greatly reduced VRAM consumption through the use of TimDettmers/bitsandbytes
cleaned up section of code that handled parsing output from training script
added button to reconnect to the training script's output (sometimes skips a line to update, but it's better than nothing)
actually update submodules from the update script (somehow forgot to pass --remote)

`Before 2023.02.22`

Refer to commit logs.