• https://git.ecker.tech/ aims to provide a place to share my efforts while maintaining true ownership of my code, as I do not trust GitHub.

    XMR: 4B9TQdkAkBFYrbj5ztvTx89e5LpucPeTSPzemCihdDi9EBnx7btn8RDNZTBz2zihWsjMnDkzn5As1LU6gLv3KQy8BLsZ8SG

  • Joined on 2022-10-10
ecker commented on issue ecker/ai-voice-cloning#113 2023-03-12 05:49:40 +00:00
Generated voices from training data always garbled.... but works fine using tortoise-tts-fast ... (?)

If we start off with a single long dialogue wav, where would we ideally want it cut?

Segment by every sentence, if:

  • it's under 200 characters, as defined in the training YAML
  • when…
ecker pushed to master at ecker/ai-voice-cloning 2023-03-12 05:09:57 +00:00
8ed09f9b87 Merge pull request 'Catch OOM and run whisper on cpu automatically.' (#117) from zim33/ai-voice-cloning:vram into master
61500107ab Catch OOM and run whisper on cpu automatically.
Compare 2 commits »
ecker commented on pull request ecker/ai-voice-cloning#117 2023-03-12 05:09:57 +00:00
Catch OOM and run whisper on cpu automatically.

Ah, I don't know why I didn't think to check if there was a way to set it to CPU only for openai/whisper.

I suppose for Windows users with low GPU VRAM but high enough system VRAM, this will do…

ecker merged pull request ecker/ai-voice-cloning#117 2023-03-12 05:09:54 +00:00
Catch OOM and run whisper on cpu automatically.
ecker commented on issue ecker/ai-voice-cloning#113 2023-03-12 03:34:17 +00:00
Generated voices from training data always garbled.... but works fine using tortoise-tts-fast ... (?)

mm, I suppose that could be one way to automatically check if segments aren't trimmed too much. I could then dump the failures into another text file to narrow down what's needed for manual…

ecker commented on issue ecker/ai-voice-cloning#116 2023-03-12 03:28:53 +00:00
Training crashed: 'AsyncRequest' object has no attribute '_json_response_data'

And I spoke too soon, I got it when starting training on a fresh install and setup: image

I wonder if it's a recent gradio thing. My…

ecker commented on issue ecker/ai-voice-cloning#116 2023-03-12 03:24:01 +00:00
Training crashed: 'AsyncRequest' object has no attribute '_json_response_data'

It could be. I had to disable a max row limit since it was at a very conservative 5000 rows, so I guess we're both hitting it, especially with the very-much increased resolution.

Strange…

ecker commented on issue ecker/ai-voice-cloning#116 2023-03-12 02:37:22 +00:00
Training crashed: 'AsyncRequest' object has no attribute '_json_response_data'

That looks more like a gradio-related issue, which there's only so much I can do about it.

Which ironically, I just checked a training on paperspace and my graphs stopped updating, but the main…

ecker pushed to master at ecker/ai-voice-cloning 2023-03-12 00:04:44 +00:00
ecker pushed to master at ecker/ai-voice-cloning 2023-03-11 23:50:16 +00:00
47847f1b6e fixed ETA(?)
ecker commented on issue ecker/ai-voice-cloning#113 2023-03-11 21:50:00 +00:00
Generated voices from training data always garbled.... but works fine using tortoise-tts-fast ... (?)

I assume I can just load the file into an audio program, and find the exact timecode in seconds, and edit the whisper.json. Then re-slice.

Yeah, that'd be the path of least resistance when…

ecker pushed to master at ecker/ai-voice-cloning 2023-03-11 21:41:42 +00:00
ede9804b76 added option to trim silence using torchaudio's VAD
ecker pushed to master at ecker/ai-voice-cloning 2023-03-11 21:34:40 +00:00
dea2fa9caf added fields to offset start/end slices to apply in bulk when slicing
ecker pushed to master at ecker/ai-voice-cloning 2023-03-11 21:18:07 +00:00
89bb3d4419 rename transcribe button since it does more than transcribe
ecker pushed to master at ecker/ai-voice-cloning 2023-03-11 21:17:18 +00:00
382a3e4104 rely on the whisper.json for handling a lot more things
ecker commented on issue ecker/ai-voice-cloning#115 2023-03-11 19:29:19 +00:00
Commit 008a1f5f8f Seems to have broken multi-GPU training on Windows due to lack of nccl support

Not possible. The GPU count doesn't get passed on Windows from the UI => train.bat => ./src/train.py. The launcher is default to none, so it won't even bother using a job launcher.

The…

ecker commented on issue ecker/ai-voice-cloning#115 2023-03-11 19:12:14 +00:00
Commit 008a1f5f8f Seems to have broken multi-GPU training on Windows due to lack of nccl support

Seems to have broken multi-GPU training on Windows

To be technical, there never was. I'll never be able to validate it myself for Windows, as my GPUs are two 6800XTs and a 2060.

However, I…

ecker commented on issue ecker/ai-voice-cloning#113 2023-03-11 19:08:35 +00:00
Generated voices from training data always garbled.... but works fine using tortoise-tts-fast ... (?)

I thought it also happened on the original whisper?

It's the same on whisper for me

Based on going through most of my voice samples, normal whisper's timestamps do have minor accuracy…

ecker pushed to master at ecker/ai-voice-cloning 2023-03-11 18:14:36 +00:00
9b376c381f brain worm
ecker pushed to master at ecker/ai-voice-cloning 2023-03-11 17:27:07 +00:00
94551fb9ac split slicing dataset routine so it can be done after the fact