Collection of utilities aimed to voice clone through AI

Go to file

mrq ee1b048d07 when creating the train/validatio datasets, use segments if the main audio's duration is too long, and slice to make the segments if they don't exist		2023-03-13 04:26:00 +00:00
bin
config
models	cleanups and fixes, fix DLAS throwing errors from '''too short of sound files''' by just culling them during transcription	2023-03-11 01:19:49 +00:00
modules	update submodules	2023-03-12 18:14:36 +00:00
results
src	when creating the train/validatio datasets, use segments if the main audio's duration is too long, and slice to make the segments if they don't exist	2023-03-13 04:26:00 +00:00
training
voices
.gitignore	experimental multi-gpu training (Linux only, because I can't into batch files)	2023-03-03 04:37:18 +00:00
.gitmodules	while I'm breaking things, migrating dependencies to modules folder for tidiness	2023-03-09 04:03:57 +00:00
LICENSE
notebook_colab.ipynb	share if you	2023-03-08 15:59:16 +00:00
notebook_paperspace.ipynb	fixed notebooks, provided paperspace notebook	2023-03-08 03:29:12 +00:00
README.md	I forgot about the changelog and never kept up with it, so I'll just not use a changelog	2023-03-08 05:14:50 +00:00
requirements.txt	Farewell, parasite	2023-03-11 16:40:34 +00:00
setup-cuda.bat	removed the hotfix pip installs that whisperx requires now that whisperx is gone	2023-03-11 16:55:19 +00:00
setup-cuda.sh	removed the hotfix pip installs that whisperx requires now that whisperx is gone	2023-03-11 16:55:19 +00:00
setup-directml.bat	removed the hotfix pip installs that whisperx requires now that whisperx is gone	2023-03-11 16:55:19 +00:00
setup-rocm-bnb.sh	while I'm breaking things, migrating dependencies to modules folder for tidiness	2023-03-09 04:03:57 +00:00
setup-rocm.sh	rocm5.2 works for me desu so I bumped it back up	2023-03-11 17:02:56 +00:00
start.bat	added button to just load a training set's loss information, added installing broncotc/bitsandbytes-rocm when running setup-rocm.sh	2023-03-02 01:35:12 +00:00
start.sh	I swear I committed forwarding arguments from the start scripts	2023-02-19 15:01:16 +00:00
train.bat	added button to just load a training set's loss information, added installing broncotc/bitsandbytes-rocm when running setup-rocm.sh	2023-03-02 01:35:12 +00:00
train.sh	simplified spawning the training process by having it spawn the distributed training processes in the train.py script, so it should work on Windows too	2023-03-11 01:37:00 +00:00
update-force.bat	removed the hotfix pip installs that whisperx requires now that whisperx is gone	2023-03-11 16:55:19 +00:00
update-force.sh	removed the hotfix pip installs that whisperx requires now that whisperx is gone	2023-03-11 16:55:19 +00:00
update.bat	added button to just load a training set's loss information, added installing broncotc/bitsandbytes-rocm when running setup-rocm.sh	2023-03-02 01:35:12 +00:00
update.sh	added api_name for generation, added whisperx backend, relocated use whispercpp option to whisper backend list	2023-03-06 05:21:33 +00:00

README.md

AI Voice Cloning

This repo/rentry aims to serve as both a foolproof guide for setting up AI voice cloning tools for legitimate, local use on Windows/Linux, as well as a stepping stone for anons that genuinely want to play around with TorToiSe.

Similar to my own findings for Stable Diffusion image generation, this rentry may appear a little disheveled as I note my new findings with TorToiSe. Please keep this in mind if the guide seems to shift a bit or sound confusing.

>Ugh... why bother when I can just abuse 11.AI?

You're more than welcome to, but TorToiSe is shaping up to be a very promising tool, especially with finetuning now on the horizon.

This is not endorsed by neonbjb. I do not expect this to run into any ethical issues, as it seems (like me), this is mostly for making funny haha vidya characters say funny lines.

Documentation

Please consult the wiki for the documentation.

Bug Reporting

If you run into any problems, please refer to the issues you may encounter wiki page first.