Commit Graph

283 Commits (master)

Author SHA1 Message Date
mrq 2830d1fa96 fixed setup scripts and Dockerfile to NOT use extra-index-url and instead use index-url (how this happened I don't know, since pytorch instructions use index-url), '''fixed''' phonemizing japanese for VALL-E with pykakasi 2023-10-12 00:27:46 +07:00
mrq 17acfee5d0 fixed culling for validation based on audio duration not working 2023-09-21 22:33:11 +07:00
mrq 5f80ee9b38 set use-deepspeed to false because it's not a dependency and installing it as a dependency under windows is a huge nightmare 2023-09-04 22:09:09 +07:00
ken11o2 29c270d1cc master (#369)
Add DeepSpeed feature for tortoise

Reviewed-on: #369
Co-authored-by: ken11o2 <ken11o2@noreply.localhost>
Co-committed-by: ken11o2 <ken11o2@noreply.localhost>
2023-09-04 22:04:00 +07:00
mrq 7fc8f4c45a slight fixes 2023-09-03 12:34:55 +07:00
mrq 7110b878b7 Merge pull request 'Websocket fixes / additions' (#350) from ben_mkiv/ai-voice-cloning:master into master
Reviewed-on: #350
2023-08-30 18:39:32 +07:00
ben_mkiv b72f2216bf added websocket server arguments to enabled it (now disabled by default) and to specify the address/port to listen on 2023-08-26 17:38:58 +07:00
mrq 690947ad36 Do not double phonemize if using VALL-E backend (I wonder how many hours I've wasted from this oversight) 2023-08-26 00:02:17 +07:00
mrq b4dc103931 I don't know how I did not commit the 'sample from the voices to construct the input prompt for vall-e' change but this helps 2023-08-25 04:26:48 +07:00
mrq a657623cbc updated vall-e training template to use path-based speakers because it would just have a batch/epoch size of 1 otherwise; revert hardcoded 'spit processed dataset to this path' from my training rig to spit it out in a sane spot 2023-08-24 21:45:50 +07:00
mrq 533b73e083 fixed the overwrite regression for bark and vall-e backends too 2023-08-24 19:46:42 +07:00
mrq 4aa240d48a Merge pull request 'fix filename generation which didn't work and overwrote existing files' (#341) from ben_mkiv/ai-voice-cloning:master into master
Reviewed-on: #341
2023-08-24 12:29:59 +07:00
ben_mkiv 00b173857d fix filename generation which didn't work and overwrote existing files 2023-08-24 09:57:01 +07:00
mrq dc46fdc7d0 fixed another issue from haphazardly copying my changes from my training machine 2023-08-23 22:09:22 +07:00
mrq 29290f574e should fix issue that arises when trying to prepare the dataset without slicing segments 2023-08-23 21:49:22 +07:00
mrq 2060b6f21c fixed issue with sliced audio being the wrong sample rate 2023-08-22 14:22:39 +07:00
mrq eeddd4cb6b forgot the important reason I even started working on AIVC again 2023-08-21 03:42:12 +07:00
mrq 72a38ff2fc made initialization faster if there's a lot of voice files (because glob fucking sucks), commiting changes buried on my training rig 2023-08-21 03:31:49 +07:00
mrq ac645e0a20 no longer need to install bark under ./modules/ 2023-07-11 16:20:28 +07:00
mrq e2a6dc1c0a under bark, properly use transcribed audio if the audio wasn't actually sliced (oops) 2023-07-11 14:53:32 +07:00
mrq 6c3f48efba uses gitmylo/bark-voice-cloning-HuBERT-quantizer for creating custom voices (it slightly works better over the base method, but still not very good desu) 2023-07-03 02:46:10 +07:00
mrq 547e1d1277 updated bark support, it'll also query for vocos, it actually works (I don't know what specifically was the issue) 2023-07-03 01:22:02 +07:00
mrq 76ed34ddd2 added CLI script (python ./src/cli.py --text=TEXT --voice=VOICE' etc) 2023-06-11 04:46:22 +07:00
mrq e227ab8e08 updated whisperX integration for use with the latest version (v3) (NOTE: you WILL need to also update whisperx if you pull this commit) 2023-06-09 02:41:29 +07:00
mrq 805d7d35e8 the power of a separate setup for testing 2023-05-22 17:36:28 +07:00
mrq 2f5486a8d5 oops 2023-05-21 23:24:13 +07:00
mrq 31da215c5f added checkboxes to use the original method for calculating latents (ignores the voice chunk field) 2023-05-21 01:47:48 +07:00
mrq cbe21745df I am very smart (need to validate) 2023-05-12 17:41:26 +07:00
mrq 74bd0f0cdc revert local change that made its way upstream (showing graphs by it instead of epoch) 2023-05-11 03:30:54 +07:00
mrq 149aaca554 fixed the whisperx has no attribute named load_model whatever because I guess whisperx has as stable of an API as I do 2023-05-06 10:45:17 +07:00
mrq e416b0fe6f oops 2023-05-05 12:36:48 +07:00
mrq 5003bc89d3 cleaned up brain worms with wrapping around gradio progress by instead just using tqdm directly (slight regressions with some messages not getting pushed) 2023-05-04 23:40:33 +07:00
mrq 09d849a78f quick hotfix if it actually is a problem in the repo itself 2023-05-04 23:01:47 +07:00
mrq 853c7fdccf forgot to uncomment the block to transcribe and slice when using transcribe all because I was piece-processing a huge batch of LibriTTS and somehow that leaked over to the repo 2023-05-03 21:31:37 +07:00
mrq eddb8aaa9a indentation fix 2023-04-28 15:56:57 +07:00
mrq 99387920e1 backported caching of phonemizer backend from mrq/vall-e 2023-04-28 15:31:45 +07:00
mrq b6440091fb Very, very, VERY, barebones integration with Bark (documentation soon) 2023-04-26 04:48:09 +07:00
mrq faa8da12d7 modified logic to determine valid voice folders, also allows subdirs within the folder (for example: ./voices/SH/james/ will be named SH/james) 2023-04-13 21:10:38 +07:00
mrq 02beb1dd8e should fix #203 2023-04-13 03:14:06 +07:00
mrq d8b996911c a bunch of shit i had uncommited over the past while pertaining to VALL-E 2023-04-12 20:02:46 +07:00
mrq 4744120be2 added VALL-E inference support (very rudimentary, gimped, but it will load a model trained on a config generated through the web UI) 2023-03-31 03:26:00 +07:00
mrq 9b01377667 only include auto in the list of models under setting, nothing else 2023-03-29 19:53:23 +07:00
mrq f66281f10c added mixing models (shamelessly inspired from voldy's web ui) 2023-03-29 19:29:13 +07:00
mrq c89c648b4a fixes #176 2023-03-26 11:05:50 +07:00
mrq 41d47c7c2a for real this time show those new vall-e metrics 2023-03-26 04:31:50 +07:00
mrq c4ca04cc92 added showing reported training accuracy and eval/validation metrics to graph 2023-03-26 04:08:45 +07:00
mrq 8c647c889d now there should be feature parity between trainers 2023-03-25 04:12:03 +07:00
mrq fd9b2e082c x_lim and y_lim for graph 2023-03-25 02:34:14 +07:00
mrq 9856db5900 actually make parsing VALL-E metrics work 2023-03-23 15:42:51 +07:00
mrq 69d84bb9e0 I forget 2023-03-23 04:53:31 +07:00