• https://git.ecker.tech/ aims to provide a place to share my efforts while maintaining true ownership of my code, as I do not trust GitHub.

    XMR: 4B9TQdkAkBFYrbj5ztvTx89e5LpucPeTSPzemCihdDi9EBnx7btn8RDNZTBz2zihWsjMnDkzn5As1LU6gLv3KQy8BLsZ8SG

  • Joined on 2022-10-10
ecker commented on issue ecker/ai-voice-cloning#42 2023-02-26 14:53:16 +00:00
Add persistent_workers options in DataLoader to make training faster by removing pauses between epochs.

Testing it now on a paperspace instance. It hasn't outright died yet so I suppose it's safe to push out.

ecker commented on issue ecker/ai-voice-cloning#41 2023-02-26 14:52:02 +00:00
Assorted feedback and some questions

I'll most definitely read this later, but since I just woke up (and might fall back asleep), I'll just say:

this rentry may appear a little disheveled as I note my new findings with TorToiSe.…

ecker commented on issue ecker/ai-voice-cloning#39 2023-02-26 14:47:58 +00:00
Is it possible to enable saving model / training_state mid-epoch?

Outside of manually editing the YAML, you can specify a decimal (like 0.5) for printing and it works. I guess this is an incidental side-effect of switching from the sliders to just a number box:…

ecker commented on issue ecker/ai-voice-cloning#37 2023-02-26 02:34:11 +00:00
[Feature request] Add support for whisper.cpp

Just my luck with anything MSVC related:

Building wheels for collected packages: whispercpp
  Building wheel for whispercpp (pyproject.toml) ... error
  error: subprocess-exited-with-erro…
ecker closed issue ecker/ai-voice-cloning#35 2023-02-26 02:11:42 +00:00
OverflowError: Python int too large to convert to C int
ecker closed issue ecker/ai-voice-cloning#34 2023-02-26 02:11:34 +00:00
Could not find module (libtorchaudio.pyd)
ecker commented on issue ecker/ai-voice-cloning#37 2023-02-26 02:10:44 +00:00
[Feature request] Add support for whisper.cpp

I'll take a gander and see about adding it in whenever I get a chance (maybe soon). For sure, it'll exist as a toggle between the two. I definitely see it as promising despite it being CPU-only,…

ecker closed issue ecker/ai-voice-cloning#36 2023-02-26 02:00:47 +00:00
File Cant Be Found Right After Preparing Dataset
ecker commented on issue ecker/ai-voice-cloning#38 2023-02-26 02:00:38 +00:00
Giving up on training shortly after starting

Added an option to disable bitsandbytes optimizations in the Train > Generate Configuration tab in commit 92553973be58ac187586fef840e8360449e1d988, although I don't expect training to work if…

ecker pushed to master at ecker/ai-voice-cloning 2023-02-26 01:58:11 +00:00
92553973be Added option to disable bitsandbytesoptimizations for systems that do not support it (systems without a Turing-onward Nvidia card), saves use of float16 and bitsandbytes for training into the config json
ecker commented on issue ecker/ai-voice-cloning#38 2023-02-26 01:30:13 +00:00
Giving up on training shortly after starting

Ah right, yeah; I forgot I made a note that bitsandbytes only works for Turing cards and beyond, due to it having the hardware for integer8 calculations (presumably from """tensor cores""").

I…

ecker commented on issue ecker/ai-voice-cloning#36 2023-02-25 22:53:18 +00:00
File Cant Be Found Right After Preparing Dataset

From the last few lines, it looks like you need a copy of ffmpeg. Grab a copy from here: https://www.gyan.dev/ffmpeg/builds/, and drop it either in:

  • .\ai-voice-cloning\ (untested, but should…
ecker commented on issue ecker/ai-voice-cloning#35 2023-02-25 16:45:52 +00:00
OverflowError: Python int too large to convert to C int

Should be fixed in commit aafeb9f96a3fe39cc3ff74a02c509cd78c892d70. I threw it and a possible division-by-zero in try/except blocks.

There were some other logic errors, probably due to `[some…

ecker pushed to master at ecker/ai-voice-cloning 2023-02-25 16:44:33 +00:00
aafeb9f96a actually fixed the training output text parser
ecker commented on issue ecker/ai-voice-cloning#35 2023-02-25 16:13:47 +00:00
OverflowError: Python int too large to convert to C int

I'll slap it under a try/except block.

It's odd that it throws an error, since I have two different training sessions (one locally, one on a paperspace instance) and they haven't had issues.

ecker pushed to master at ecker/ai-voice-cloning 2023-02-25 15:31:24 +00:00
65329dba31 oops, epoch increments twice
ecker pushed to master at ecker/ai-voice-cloning 2023-02-25 15:30:12 +00:00
1c999e42dc oops, epoch increments twice
ecker pushed to master at ecker/ai-voice-cloning 2023-02-25 13:55:36 +00:00
8b4da29d5f csome adjustments to the training output parser, now updates per iteration for really large batches (like the one I'm doing for a dataset size of 19420)
ecker commented on issue ecker/ai-voice-cloning#25 2023-02-24 23:14:47 +00:00
Discussion About BitsAndBytes Integration

Turned out that I somehow assumed copy/xcopy just copied folders too, so all files should copy now for bitsandbytes.