exllama_fan
  • Joined on 2023-07-10
exllama_fan commented on issue ecker/ai-voice-cloning#305 2023-07-12 14:58:09 +00:00
Need help in adopting your tortoise implementation

Alright! Good news here

Apparently, I misjudged the GPU usage of your UI. While generating autoregressive samples, the VRAM usage spikes, peaks and stays there as per the length of the prompt,…

exllama_fan commented on issue ecker/ai-voice-cloning#305 2023-07-11 06:24:04 +00:00
Need help in adopting your tortoise implementation

Also if I change all the bools to true in the file ./tortoise/utils/torch_intermediary.py I get an assertion error

`AssertionError Traceback (most recent call…

exllama_fan commented on issue ecker/ai-voice-cloning#305 2023-07-11 06:11:11 +00:00
Need help in adopting your tortoise implementation

So there's something new I just discovered This behavior is common to whether I clone your tortoise fork into a directory or I copy the files from the ai-voice-cloning/modules/tortoise-tts

Bas…

exllama_fan commented on issue ecker/ai-voice-cloning#305 2023-07-11 05:28:24 +00:00
Need help in adopting your tortoise implementation

So here's a thing

cloned your tortoise fork, created new conda environment with python=3.10 and installed latest torch torchaudio torchvision with cuda=11.7. Now when I try to run the…

exllama_fan commented on issue ecker/ai-voice-cloning#305 2023-07-11 03:49:03 +00:00
Need help in adopting your tortoise implementation

That's okay! Quite a journey it must have been. But my question stands still, different environments in my question referred to requirements for ai-voice-cloning and your tortoise fork. If bnb is…

exllama_fan commented on issue ecker/ai-voice-cloning#305 2023-07-11 00:59:17 +00:00
Need help in adopting your tortoise implementation

https://git.ecker.tech/mrq/tortoise-tts/commit/7b839a426311543ecb11fbc1f572749f8ceca1fa Found this one, 5 months old, about adding bitsandbytes implementation to the Tortoise inference …

exllama_fan commented on issue ecker/ai-voice-cloning#305 2023-07-11 00:44:50 +00:00
Need help in adopting your tortoise implementation

Thanks for validating my query! Had actually found your implementation of Tortoise as a separate repo after posing here. Thought posting would still be worth it

Just a few quick queries before…

exllama_fan opened issue ecker/ai-voice-cloning#305 2023-07-10 12:36:04 +00:00
Need help in adopting your tortoise implementation