Collection of utilities aimed to voice clone through AI

Go to file

mrq 7110b878b7 Merge pull request 'Websocket fixes / additions' (#350 ) from ben_mkiv/ai-voice-cloning:master into master Reviewed-on: mrq/ai-voice-cloning#350		2023-08-30 18:39:32 +00:00
bin
models	updated vall-e training template to use path-based speakers because it would just have a batch/epoch size of 1 otherwise; revert hardcoded 'spit processed dataset to this path' from my training rig to spit it out in a sane spot	2023-08-24 21:45:50 +00:00
modules	forgot the important reason I even started working on AIVC again	2023-08-21 03:42:12 +00:00
results
src	Merge pull request 'Websocket fixes / additions' (#350 ) from ben_mkiv/ai-voice-cloning:master into master	2023-08-30 18:39:32 +00:00
training
voices
.dockerignore	docker support	2023-04-07 21:52:18 +00:00
.gitignore	experimental multi-gpu training (Linux only, because I can't into batch files)	2023-03-03 04:37:18 +00:00
.gitmodules	while I'm breaking things, migrating dependencies to modules folder for tidiness	2023-03-09 04:03:57 +00:00
Dockerfile	docker: add ffmpeg for whisper and general cleanup	2023-04-07 23:14:05 +00:00
LICENSE
notebook_colab.ipynb	share if you	2023-03-08 15:59:16 +00:00
notebook_paperspace.ipynb	fixed notebooks, provided paperspace notebook	2023-03-08 03:29:12 +00:00
README.md	fixed issue with sliced audio being the wrong sample rate	2023-08-22 14:22:39 +00:00
requirements.txt	made initialization faster if there's a lot of voice files (because glob fucking sucks), commiting changes buried on my training rig	2023-08-21 03:31:49 +00:00
setup-cuda-bnb.bat	setup bnb on windows as needed	2023-03-16 20:48:48 +00:00
setup-cuda.bat	DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier)	2023-03-21 15:46:53 +00:00
setup-cuda.sh	DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier)	2023-03-21 15:46:53 +00:00
setup-directml.bat	updated setup-directml.bat to not hard require torch version because it's updated to torch2 now	2023-04-29 00:50:16 +00:00
setup-docker.sh	docker support	2023-04-07 21:52:18 +00:00
setup-rocm-bnb.sh	while I'm breaking things, migrating dependencies to modules folder for tidiness	2023-03-09 04:03:57 +00:00
setup-rocm.sh	DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier)	2023-03-21 15:46:53 +00:00
start-docker.sh	docker support	2023-04-07 21:52:18 +00:00
start.bat	added PYTHONUTF8 to start/train bats	2023-03-14 02:29:11 +00:00
start.sh	:)	2023-03-14 05:02:14 +00:00
train-docker.sh	docker: add training script	2023-04-07 23:15:13 +00:00
train.bat	;)	2023-03-14 15:48:09 +00:00
train.sh	;)	2023-03-14 15:48:09 +00:00
update-force.bat	removed the hotfix pip installs that whisperx requires now that whisperx is gone	2023-03-11 16:55:19 +00:00
update-force.sh	DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier)	2023-03-21 15:46:53 +00:00
update.bat
update.sh	added PYTHONUTF8 to start/train bats	2023-03-14 02:29:11 +00:00

README.md

AI Voice Cloning

Note This project has been in dire need of being rewritten from the ground up for some time. Apologies for any crust from my rather spaghetti code.

This repo/rentry aims to serve as both a foolproof guide for setting up AI voice cloning tools for legitimate, local use on Windows/Linux, as well as a stepping stone for anons that genuinely want to play around with TorToiSe.

>Ugh... why bother when I can just abuse 11.AI?

You're more than welcome to, but TorToiSe is shaping up to be a very promising tool, especially with finetuning now on the horizon.

This is not endorsed by neonbjb. I do not expect this to run into any ethical issues, as it seems (like me), this is mostly for making funny haha vidya characters say funny lines.

Documentation

Please consult the wiki for the documentation.

Bug Reporting

If you run into any problems, please refer to the issues you may encounter wiki page first.