Collection of utilities aimed to voice clone through AI

Go to file

ben_mkiv 2626364c40 added simple websocket server which allows to start tts generation tasks, retrieving autoregressive models and voices list		2023-08-16 12:51:13 +02:00
bin	Initial refractor	2023-02-17 00:08:27 +00:00
models	remove redundant phonemize for vall-e (oops), quantize all files and then phonemize all files for cope optimization, load alignment model once instead of for every transcription (speedup with whisperx)	2023-03-23 00:22:25 +00:00
modules	added checkboxes to use the original method for calculating latents (ignores the voice chunk field)	2023-05-21 01:47:48 +00:00
results	Initial refractor	2023-02-17 00:08:27 +00:00
src	added simple websocket server which allows to start tts generation tasks, retrieving autoregressive models and voices list	2023-08-16 12:51:13 +02:00
training	a bit of UI cleanup, import multiple audio files at once, actually shows progress when importing voices, hides audio metadata / latents if no generated settings are detected, preparing datasets shows its progress, saving a training YAML shows a message when done, training now works within the web UI, training output shows to web UI, provided notebook is cleaned up and uses a venv, etc.	2023-02-18 02:07:22 +00:00
voices	Initial refractor	2023-02-17 00:08:27 +00:00
.dockerignore	docker support	2023-04-07 21:52:18 +00:00
.gitignore	experimental multi-gpu training (Linux only, because I can't into batch files)	2023-03-03 04:37:18 +00:00
.gitmodules	while I'm breaking things, migrating dependencies to modules folder for tidiness	2023-03-09 04:03:57 +00:00
Dockerfile	docker: add ffmpeg for whisper and general cleanup	2023-04-07 23:14:05 +00:00
LICENSE	Initial refractor	2023-02-17 00:08:27 +00:00
notebook_colab.ipynb	share if you	2023-03-08 15:59:16 +00:00
notebook_paperspace.ipynb	fixed notebooks, provided paperspace notebook	2023-03-08 03:29:12 +00:00
README.md	I forgot about the changelog and never kept up with it, so I'll just not use a changelog	2023-03-08 05:14:50 +00:00
requirements.txt	Freeze pydantic package to 1.10.11	2023-07-09 02:36:23 +00:00
setup-cuda-bnb.bat	setup bnb on windows as needed	2023-03-16 20:48:48 +00:00
setup-cuda.bat	DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier)	2023-03-21 15:46:53 +00:00
setup-cuda.sh	DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier)	2023-03-21 15:46:53 +00:00
setup-directml.bat	updated setup-directml.bat to not hard require torch version because it's updated to torch2 now	2023-04-29 00:50:16 +00:00
setup-docker.sh	docker support	2023-04-07 21:52:18 +00:00
setup-rocm-bnb.sh	while I'm breaking things, migrating dependencies to modules folder for tidiness	2023-03-09 04:03:57 +00:00
setup-rocm.sh	DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier)	2023-03-21 15:46:53 +00:00
start-docker.sh	docker support	2023-04-07 21:52:18 +00:00
start.bat	added PYTHONUTF8 to start/train bats	2023-03-14 02:29:11 +00:00
start.sh	:)	2023-03-14 05:02:14 +00:00
train-docker.sh	docker: add training script	2023-04-07 23:15:13 +00:00
train.bat	;)	2023-03-14 15:48:09 +00:00
train.sh	;)	2023-03-14 15:48:09 +00:00
update-force.bat	removed the hotfix pip installs that whisperx requires now that whisperx is gone	2023-03-11 16:55:19 +00:00
update-force.sh	DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier)	2023-03-21 15:46:53 +00:00
update.bat	added button to just load a training set's loss information, added installing broncotc/bitsandbytes-rocm when running setup-rocm.sh	2023-03-02 01:35:12 +00:00
update.sh	added PYTHONUTF8 to start/train bats	2023-03-14 02:29:11 +00:00

README.md

AI Voice Cloning

This repo/rentry aims to serve as both a foolproof guide for setting up AI voice cloning tools for legitimate, local use on Windows/Linux, as well as a stepping stone for anons that genuinely want to play around with TorToiSe.

Similar to my own findings for Stable Diffusion image generation, this rentry may appear a little disheveled as I note my new findings with TorToiSe. Please keep this in mind if the guide seems to shift a bit or sound confusing.

>Ugh... why bother when I can just abuse 11.AI?

You're more than welcome to, but TorToiSe is shaping up to be a very promising tool, especially with finetuning now on the horizon.

This is not endorsed by neonbjb. I do not expect this to run into any ethical issues, as it seems (like me), this is mostly for making funny haha vidya characters say funny lines.

Documentation

Please consult the wiki for the documentation.

Bug Reporting

If you run into any problems, please refer to the issues you may encounter wiki page first.