Collection of utilities aimed to voice clone through AI, with oneAPI support.

Go to file

mrq 050bcefd73 resample to 22.5K when creating training inputs (to avoid redundant downsampling when loaded for training, even though most of my inputs are already at 22.5K), generalized resampler function to cache and reuse them, do not unload whisper when done transcribing since it gets unloaded anyways for any other non-transcription task		2023-03-13 01:20:55 +00:00
bin
config
models
modules	update submodules	2023-03-12 18:14:36 +00:00
results
src	resample to 22.5K when creating training inputs (to avoid redundant downsampling when loaded for training, even though most of my inputs are already at 22.5K), generalized resampler function to cache and reuse them, do not unload whisper when done transcribing since it gets unloaded anyways for any other non-transcription task	2023-03-13 01:20:55 +00:00
training
voices
.gitignore
.gitmodules
LICENSE
notebook_colab.ipynb
notebook_paperspace.ipynb
README.md
requirements.txt	Farewell, parasite	2023-03-11 16:40:34 +00:00
setup-cuda.bat	removed the hotfix pip installs that whisperx requires now that whisperx is gone	2023-03-11 16:55:19 +00:00
setup-cuda.sh	removed the hotfix pip installs that whisperx requires now that whisperx is gone	2023-03-11 16:55:19 +00:00
setup-directml.bat	removed the hotfix pip installs that whisperx requires now that whisperx is gone	2023-03-11 16:55:19 +00:00
setup-rocm-bnb.sh
setup-rocm.sh	rocm5.2 works for me desu so I bumped it back up	2023-03-11 17:02:56 +00:00
start.bat
start.sh
train.bat
train.sh
update-force.bat	removed the hotfix pip installs that whisperx requires now that whisperx is gone	2023-03-11 16:55:19 +00:00
update-force.sh	removed the hotfix pip installs that whisperx requires now that whisperx is gone	2023-03-11 16:55:19 +00:00
update.bat
update.sh

README.md

AI Voice Cloning

This repo/rentry aims to serve as both a foolproof guide for setting up AI voice cloning tools for legitimate, local use on Windows/Linux, as well as a stepping stone for anons that genuinely want to play around with TorToiSe.

Similar to my own findings for Stable Diffusion image generation, this rentry may appear a little disheveled as I note my new findings with TorToiSe. Please keep this in mind if the guide seems to shift a bit or sound confusing.

>Ugh... why bother when I can just abuse 11.AI?

You're more than welcome to, but TorToiSe is shaping up to be a very promising tool, especially with finetuning now on the horizon.

This is not endorsed by neonbjb. I do not expect this to run into any ethical issues, as it seems (like me), this is mostly for making funny haha vidya characters say funny lines.

Documentation

Please consult the wiki for the documentation.

Bug Reporting

If you run into any problems, please refer to the issues you may encounter wiki page first.