• https://git.ecker.tech/ aims to provide a place to share my efforts while maintaining true ownership of my code, as I do not trust GitHub.

    XMR: 4B9TQdkAkBFYrbj5ztvTx89e5LpucPeTSPzemCihdDi9EBnx7btn8RDNZTBz2zihWsjMnDkzn5As1LU6gLv3KQy8BLsZ8SG

  • Joined on 2022-10-10
ecker commented on issue ecker/ai-voice-cloning#152 2023-04-25 22:39:38 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

I whipped up a small script to play around with it and, while I had zero hitches actually getting it to run (which in post I guess I got lucky, apparently people have had it not work given the…

ecker commented on issue ecker/ai-voice-cloning#152 2023-04-25 21:35:09 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

Oh, actually, there is a repo for it: https://github.com/serp-ai/bark-with-voice-clone

I'll play around with it. If it proves favorable then I guess I won't need VALL-E.

ecker commented on issue ecker/vall-e#1 2023-04-25 20:52:16 +00:00
Curious about other strains

I guess I never sent my reply here, oops.

Would the trained models be useful for you to help test inference?

mmm, it shouldn't be necessary. I just need to spend half an hour at most to…

ecker commented on issue ecker/ai-voice-cloning#152 2023-04-25 20:50:01 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

Have you seen https://github.com/Fictiverse/bark?

Seen it. I mentioned some thoughts here, but I'll mention my current thoughts: *…

ecker commented on issue ecker/ai-voice-cloning#152 2023-04-24 17:35:12 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

Bit the bullet yesterday; transcribed the train-360 LibriTTS (sub)dataset, putting me at a total of 116 hours, 167520 lines (total, actual dataset could be more, but I dropped Westwood's Blade…

ecker commented on issue ecker/vall-e#1 2023-04-21 23:46:31 +00:00
Curious about other strains

hope you've had the chance to get some rest

Hah.

I trained a model using enhuiz's version

Yeesh. I probably should have made training with the repo more palatable to save your time.…

ecker commented on issue ecker/ai-voice-cloning#152 2023-04-21 22:15:01 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

Since I don't really got anywhere else to mention it, I think I squashed the error 500 bugs. I'm not sure why it happened recently, but fuck SystemD. I had to use coreadm in my global zone to…

ecker commented on issue ecker/ai-voice-cloning#213 2023-04-21 22:06:13 +00:00
Amazing Suno-ai generates laugh,sigh and other expressions

The demos are pretty nice:

  • it does that thing I remember TorToiSe doing where it'll have non-verbal utterances like slight lip smacks and breaths.
  • it boasts having a model already pretrained,…
ecker pushed to master at ecker/vall-e 2023-04-21 20:26:33 +00:00
a8b937f804 actually support a separate, unique validation dataset
ecker pushed to master at ecker/vall-e 2023-04-20 21:30:37 +00:00
4f8dd0bb7a I really need to spend a day to update the readme and make sure it actually reflects the repo
ecker pushed to master at ecker/vall-e 2023-04-20 21:24:10 +00:00
25c05677bc pushing uncommited changes, something something modifying validation/evaluation pipeline, updated example yaml, some other things i can't remember
1de785950a added note in README if your CUDA version is higher than your PyTorch CUDA version because updating is a detriment (I just want my Xorg working again)
Compare 2 commits »
ecker commented on issue ecker/ai-voice-cloning#152 2023-04-20 04:17:00 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

mmm, yeah I definitely won't try and tackle that. I'll let the real experts deal with maturing it, and hopefully someone with the actual compute to play around with it and homebrewing a model.

F…

ecker commented on issue ecker/ai-voice-cloning#209 2023-04-17 19:28:46 +00:00
Support for mixing more than 2 voices?

If I remember right, you can achieve voice "mixing" on an arbitrary number of voices by having all your source samples in the same folder. When the latents get computed, it'll all "average" out,…

ecker commented on issue ecker/ai-voice-cloning#152 2023-04-16 23:59:31 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

Twice I had what I was going to say eaten away. I already spent maybe 45 minutes to an hour, so I'm keeping it as brief as I can. Apologies if it comes off rather curt.


Is the size the…

ecker commented on issue ecker/ai-voice-cloning#152 2023-04-16 02:20:31 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

I'm biting the bullet and dumping in LibriTTS clean-100 (247 speakers, 30k unsegmented lines, don't have an idea about duration yet or final line count).

I'm getting really worried that I'm…

ecker commented on issue ecker/ai-voice-cloning#152 2023-04-15 04:43:58 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

Are you doing a reset?

An LR/optimizer reset just discards the metadata used for training while retaining the actual model. This way, the iteration count is reset to zero, and the LR schedule…

ecker pushed to master at ecker/vall-e 2023-04-14 18:21:49 +00:00
09f47524c9 hotfix for deepspeed 0.9 (words cannot describe my disgust and irritation for it), also some uncommitted cleanups
ecker commented on issue ecker/ai-voice-cloning#152 2023-04-13 21:54:35 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

I'll probe through them whenever I get the chance next. I incidentally worked on the dataset preparation process to be more cleaner and not a pain (stuff like fixing the phonemizer memory leak,…

ecker pushed to master at ecker/ai-voice-cloning 2023-04-13 21:10:50 +00:00
faa8da12d7 modified logic to determine valid voice folders, also allows subdirs within the folder (for example: ./voices/SH/james/ will be named SH/james)