• https://git.ecker.tech/ aims to provide a place to share my efforts while maintaining true ownership of my code, as I do not trust GitHub.

    XMR: 4B9TQdkAkBFYrbj5ztvTx89e5LpucPeTSPzemCihdDi9EBnx7btn8RDNZTBz2zihWsjMnDkzn5As1LU6gLv3KQy8BLsZ8SG

  • Joined on 2022-10-10
ecker commented on issue ecker/ai-voice-cloning#113 2023-03-23 03:36:27 +00:00
Generated voices from training data always garbled.... but works fine using tortoise-tts-fast ... (?)

I figured I'll (ashamedly) mention it here, since this issues thread was the reason why I removed it in the first place: I added WhisperX back. It won't install by default to avoid any more…

ecker pushed to master at ecker/ai-voice-cloning 2023-03-23 02:37:50 +00:00
a6daf289bc when the sanitizer thingy works in testing but it doesn't outside of testing, and you have to retranscribe for the fourth time today
ecker pushed to master at ecker/ai-voice-cloning 2023-03-23 01:55:23 +00:00
86589fff91 why does this keep happening to me
ecker pushed to master at ecker/ai-voice-cloning 2023-03-23 01:52:37 +00:00
0ea93a7f40 more cleanup, use 24KHz for preparing for VALL-E (encodec will resample to 24Khz anyways, makes audio a little nicer), some other things
ecker commented on issue ecker/ai-voice-cloning#160 2023-03-23 00:26:43 +00:00
Can't train a single good model

...because you need to click (Re)compute Voice Latents when you want to regenerate them.

I don't have ways to regenerate latents automatically when there's a change in chunk size, hence the…

ecker pushed to master at ecker/ai-voice-cloning 2023-03-23 00:22:44 +00:00
d2a9ab9e41 remove redundant phonemize for vall-e (oops), quantize all files and then phonemize all files for cope optimization, load alignment model once instead of for every transcription (speedup with whisperx)
ecker pushed to master at ecker/ai-voice-cloning 2023-03-22 22:24:17 +00:00
19c0854e6a do not write current whisper.json if there's no changes
ecker pushed to master at ecker/ai-voice-cloning 2023-03-22 22:10:04 +00:00
932eaccdf5 added whisper transcription 'sanitizing' (collapse very short transcriptions to the previous segment) (I really have to stop having several copies spanning several machines for AIVC, I keep reverting shit)
ecker pushed to master at ecker/ai-voice-cloning 2023-03-22 20:39:12 +00:00
736cdc8926 disable diarization for whisperx as it's just a useless performance hit (I don't have anything that's multispeaker within the same audio file at the moment)
ecker pushed to master at ecker/ai-voice-cloning 2023-03-22 20:26:31 +00:00
ecker pushed to master at ecker/ai-voice-cloning 2023-03-22 20:25:47 +00:00
ecker pushed to master at ecker/ai-voice-cloning 2023-03-22 20:01:39 +00:00
13605f980c now whisperx should output json that aligns with what's expected
ecker pushed to master at ecker/ai-voice-cloning 2023-03-22 20:00:51 +00:00
12182d84b5 now whisperx should output json that aligns with what's expected
ecker pushed to master at ecker/ai-voice-cloning 2023-03-22 20:00:24 +00:00
54abfa989c now whisperx should output json that aligns with what's expected
ecker pushed to master at ecker/ai-voice-cloning 2023-03-22 19:53:52 +00:00
8877960062 fixes for whisperx batching
ecker pushed to master at ecker/ai-voice-cloning 2023-03-22 19:25:00 +00:00
4056a27bcb begrudgingly added back whisperx integration (VAD/Diarization testing, I really, really need accurate timestamps before dumping mondo amounts of time on training a dataset)
ecker closed issue ecker/ai-voice-cloning#167 2023-03-22 18:21:42 +00:00
"No such file or directory: 'train.sh'" after updating to f822c87344d2ce01bd077b48d9db42740c51ea04
ecker pushed to master at ecker/ai-voice-cloning 2023-03-22 18:21:42 +00:00
ecker pushed to master at ecker/ai-voice-cloning 2023-03-22 18:07:52 +00:00
da96161aaa oops
ecker pushed to master at ecker/ai-voice-cloning 2023-03-22 17:47:27 +00:00
f822c87344 cleanups, realigning vall-e training