• https://git.ecker.tech/ aims to provide a place to share my efforts while maintaining true ownership of my code, as I do not trust GitHub.

    XMR: 4B9TQdkAkBFYrbj5ztvTx89e5LpucPeTSPzemCihdDi9EBnx7btn8RDNZTBz2zihWsjMnDkzn5As1LU6gLv3KQy8BLsZ8SG

  • Joined on 2022-10-10
ecker commented on issue ecker/ai-voice-cloning#152 2023-05-22 19:54:55 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

Do you have a loss target in mind?

Not necessarily a target loss, but moreso a mix of playing it by ear from the output, and the reported AR accuracy being >90%. I can't remember what loss…

ecker commented on issue ecker/ai-voice-cloning#246 2023-05-22 17:37:10 +00:00
Is it possible to load a different Autoregressive Model through the Gradio API?

Fixed in commit 805d7d35e8436d0684ae9bf568a03c2f945fadd9.

ecker pushed to master at ecker/ai-voice-cloning 2023-05-22 17:36:40 +00:00
805d7d35e8 the power of a separate setup for testing
ecker commented on issue ecker/ai-voice-cloning#246 2023-05-21 23:25:51 +00:00
Is it possible to load a different Autoregressive Model through the Gradio API?

Added in commit baa6b76b85bdbd04296a134bd1116d60c622908e. Refer to the Use via API thing at the bottom of the web UI page. It should automatically handle reloading if TTS is already loaded.

ecker pushed to master at ecker/ai-voice-cloning 2023-05-21 23:24:20 +00:00
2f5486a8d5 oops
ecker pushed to master at ecker/ai-voice-cloning 2023-05-21 23:20:46 +00:00
baa6b76b85 added gradio API for changing AR model
ecker commented on issue ecker/ai-voice-cloning#152 2023-05-21 16:23:52 +00:00
VALL-E Integration (and In Response To TorToiSe: a Quick Retrospective)

Actual weekly progress report:

I feel very, very stupid for burning so much time being stubborn. Restarting the weights was actually the correct call, as the results are looking pretty good.…

ecker commented on issue ecker/ai-voice-cloning#243 2023-05-21 01:55:18 +00:00
Output sounds slow and lower pitch to tortoise-tts

Alrighty, it should be added in commit 31da215c5f0f77a249dd5131bf8c3a4f149299a3 (and mrq/tortoise-tts commit 5ff00bf3bfa97e2c8e9f166b920273f83ac9d8f0).

So, to reiterate:

  • Two types of…
ecker pushed to master at ecker/ai-voice-cloning 2023-05-21 01:47:54 +00:00
31da215c5f added checkboxes to use the original method for calculating latents (ignores the voice chunk field)
ecker pushed to master at ecker/tortoise-tts 2023-05-21 01:47:17 +00:00
5ff00bf3bf added flags to rever to default method of latent generation (separately for the AR and Diffusion latents, as some voices don't play nicely with the chunk-for-all method)
ecker pushed to main at ecker/tortoise-tts 2023-05-21 01:47:13 +00:00
5ff00bf3bf added flags to rever to default method of latent generation (separately for the AR and Diffusion latents, as some voices don't play nicely with the chunk-for-all method)
ecker pushed to master at ecker/ai-voice-cloning 2023-05-21 01:39:23 +00:00
9221c66d03 added checkboxes to use the original method for calculating latents (ignores the voice chunk field)
ecker pushed to master at ecker/tortoise-tts 2023-05-21 01:38:06 +00:00
056b6f2f91 added flags to rever to default method of latent generation (separately for the AR and Diffusion latents, as some voices don't play nicely with the chunk-for-all method)
ecker pushed to main at ecker/tortoise-tts 2023-05-21 01:38:03 +00:00
056b6f2f91 added flags to rever to default method of latent generation (separately for the AR and Diffusion latents, as some voices don't play nicely with the chunk-for-all method)
ecker commented on issue ecker/ai-voice-cloning#245 2023-05-21 00:56:08 +00:00
Transcript Generation

If you're looking to simply utilize the web UI's transcription routine for subtitles, I suggest just using whisper (or whisperX) directly

ecker commented on issue ecker/ai-voice-cloning#243 2023-05-21 00:47:11 +00:00
Output sounds slow and lower pitch to tortoise-tts

mmm. I suppose I'll add in a way to use the original, vanilla latents computation.

I did just remember, that maybe about a month or so after modifying the latents computation to use the entire…

ecker commented on issue ecker/ai-voice-cloning#244 2023-05-20 23:55:30 +00:00
Step by step data prep and training/finetuning guide?

I might have a "guide" (list) somewhere in an Issues reply (although I don't think I did this, it's not something I can just give a simple guide on and expect it to cover all grounds), but the…

ecker commented on issue ecker/ai-voice-cloning#243 2023-05-19 21:05:42 +00:00
Output sounds slow and lower pitch to tortoise-tts

Hmm...

  • check under Settings, I think it's Output Sample Rate, check if it's set to 44100 (I think I might have left it default to 44000, but it shouldn't be the cause). You can also set…
ecker commented on issue ecker/ai-voice-cloning#242 2023-05-19 20:54:44 +00:00
Is it possible to generate using the command-line?

Right, I keep forgetting to re-implement a CLI interface. When I get a moment I can whip up something.

ecker commented on issue ecker/ai-voice-cloning#241 2023-05-19 20:53:33 +00:00
ImportError: cannot import name 'get_voice_dir' from 'tortoise.utils.audio'

First, the train.py script doesn't use anything from TorToiSe directly, so I'm not sure what you're doing to get that from the given information.

Secondly, the intended fork to use it with…