• https://git.ecker.tech/ aims to provide a place to share my efforts while maintaining true ownership of my code, as I do not trust GitHub.

    XMR: 4B9TQdkAkBFYrbj5ztvTx89e5LpucPeTSPzemCihdDi9EBnx7btn8RDNZTBz2zihWsjMnDkzn5As1LU6gLv3KQy8BLsZ8SG

  • Joined on 2022-10-10
ecker pushed to master at ecker/ai-voice-cloning 2023-06-11 04:46:35 +00:00
76ed34ddd2 added CLI script (python ./src/cli.py --text=TEXT --voice=VOICE' etc)
ecker commented on issue ecker/ai-voice-cloning#260 2023-06-10 21:22:14 +00:00
ImportError: DLL load failed while importing torch_directml_native: The specified process was not found

You might need to use either an older version of torch-directml or transformers. I don't have my previous venv of DirectML still around unfortunately, but you can start with doing (sourced from…

ecker commented on issue ecker/tortoise-tts#45 2023-06-10 21:17:31 +00:00
Redaction at end of input causes index error. Ex. Hello [World!]

Added in commit e2cd07d5602742ec4068195532afa2ec4d56bebe.

ecker pushed to main at ecker/tortoise-tts 2023-06-10 21:16:35 +00:00
e2cd07d560 Fix for redaction at end of text (#45)
ecker pushed to master at ecker/tortoise-tts 2023-06-10 21:16:33 +00:00
e2cd07d560 Fix for redaction at end of text (#45)
ecker pushed to master at ecker/ai-voice-cloning 2023-06-09 02:41:37 +00:00
e227ab8e08 updated whisperX integration for use with the latest version (v3) (NOTE: you WILL need to also update whisperx if you pull this commit)
ecker commented on issue ecker/ai-voice-cloning#152 2023-06-09 02:00:35 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

This shouldn't be an issue, since both datasets provide speakers' Librivox unique speaker ID.

Oh duh, why didn't I think of that. I can probably make do with merging speakers but not book IDs…

ecker commented on issue ecker/ai-voice-cloning#152 2023-06-06 18:20:17 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

There's a relatively new TTS called Balacoon, aimed at low end devices claiming 50x inference speed improvement on CPUs

Neat.

talks about some of the optimizations they made to do…

ecker pushed to master at ecker/vee-speedrun-ratings 2023-06-04 11:15:11 +00:00
d8c2d5f028 if only you knew how bad things really are
ecker commented on issue ecker/ai-voice-cloning#152 2023-05-31 18:21:36 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

Consider replacing LibriTTS with this if you haven't

ecker commented on issue ecker/ai-voice-cloning#242 2023-05-31 15:34:25 +00:00
Is it possible to generate using the command-line?

Shit, I forgot to do this. Gomen. I'm a bit tied up for the rest of the week, so...

You might get lucky with just copying an existing do_tts.py (such as from 152334H's fork, I think it…

ecker commented on issue ecker/ai-voice-cloning#252 2023-05-31 15:24:18 +00:00
Whats changed recently? finetuning in webUI is completely broken now

Since it's been months since I actually touched anything with the TorToiSe training code, you might need to grab 152334H's [frozen requirements.txt](https://github.com/152334H/DL-Art-School/blob/ma

ecker commented on issue ecker/ai-voice-cloning#152 2023-05-31 15:20:18 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

Could have sworn I sent a post here, but I suppose I didn't.

Training is slowly improving over the weekend with a maintained LR of 1.0e-4 on the full-size model; but I don't know if I should…

ecker commented on issue ecker/ai-voice-cloning#152 2023-05-27 23:39:23 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

OK so I have a 2000 hour audiobook dataset compiled. Didn't take that long to gather but uploading it took forever. It's untranscribed still as well.

Sweet. Training seemed to have slow down…

ecker commented on issue ecker/ai-voice-cloning#251 2023-05-26 20:36:53 +00:00
"Iterations" when generating

From what I remember, the "iterations" in the web UI determines how many steps to run the outputted codes from the AR through the diffusion sampler (desu the names I went with are a bit confusing).…

ecker commented on issue ecker/ai-voice-cloning#249 2023-05-26 20:31:02 +00:00
Out of memory errors and using whisperX

But I downloaded the current whisperx repo and there is no 'transcribe_with_vad' phrase anywhere in it. According to grep

Oh right, I forgot. I think it was v3 is when he broke everything…

ecker commented on issue ecker/ai-voice-cloning#152 2023-05-25 14:18:56 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

if you produce a TTS clip let say on Tortoise and then feed that into RVC the quality is drastically improved

It has crossed my mind to just have TorToiSe (or the other VALL-E homebrewed…

ecker commented on issue ecker/ai-voice-cloning#250 2023-05-25 14:11:45 +00:00
resume a training

Under the training configuration generator sub-tab:

Resume State Path: the last training state saved to resume from. The general path structure is what the placeholder value is. This will…

ecker commented on issue ecker/ai-voice-cloning#152 2023-05-24 01:13:25 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

https://github.com/facebookresearch/fairseq/blob/main/examples/mms

The ASR might be promising at the very least, but I'm not too sure if it'd be comparable to Whisper in terms of timestamped…

ecker commented on issue ecker/ai-voice-cloning#248 2023-05-22 22:10:02 +00:00
Overfitting with large datasets

I honestly can't quite recall the intricacies of TorToiSe finetuning (as most of that knowledge emptied out for VALL-E). But I sort of remember with my Japanese dataset (which I checked finally…