CUDA out of memory - all of a sudden? #87

So today, whenever I try and generate a voice, it goes through a few minutes of the usual loading, and then throws this OOM error. Never used to happen, as I'm on a 3090. Previously I'd only be using about 16gb of memory for generations like this.

Edit - It seems to succeed if I use the 'univan' vocoder, but fails with either of the default bigvgan vocoders?

So today, whenever I try and generate a voice, it goes through a few minutes of the usual loading, and then throws this OOM error. Never used to happen, as I'm on a 3090. Previously I'd only be using about 16gb of memory for generations like this. Edit - It seems to succeed if I use the 'univan' vocoder, but fails with either of the default bigvgan vocoders?

Screenshot 2023-03-07 190929.png

160 KiB

Go under settings and set Sample Batch Size to 16. If you updated mrq/tortoise-tts recently, it added an additional automatic batch size tier, that I suppose isn't actually safe to use for lengthier sentences. I'll revert it in a moment.

Reverted in mrq/tortoise-tts commit 3dd5cad324.

In the future, if it does happen again, you'll need to lower the sample batch size under settings.

Reverted in mrq/tortoise-tts commit https://git.ecker.tech/mrq/tortoise-tts/commit/3dd5cad32429b8cf0e2864e07799a7626a067150. In the future, if it does happen again, you'll need to lower the sample batch size under settings.

Labels Milestones

CUDA out of memory - all of a sudden? #87