-
https://git.ecker.tech/ aims to provide a place to share my efforts while maintaining true ownership of my code, as I do not trust GitHub.
XMR: 4B9TQdkAkBFYrbj5ztvTx89e5LpucPeTSPzemCihdDi9EBnx7btn8RDNZTBz2zihWsjMnDkzn5As1LU6gLv3KQy8BLsZ8SG
- Joined on
2022-10-10
941a27d2b3
removed the logic to toggle BNB capabilities, since I guess I can't do that from outside the module
Success!
I was able to successfully train a model on my 2060. I didn't have anyone come and break in and CBT me, nor are my outputs from a model finetuned with this optimization degraded at…
I've had a breakthrough with being able to train even on my 2060.
Refer to mrq/ai-voice-cloning#25.
I've had a breakthrough with being able to train even on my 2060.
Refer to mrq/ai-voice-cloning#25.
58600274ac
Disabling bitsandbytes optimization as default for now, in the off chance that it actually produces garbage (which shouldn't happen, there's no chance, if training at float16 from a model at float16 works fine, then this has to work)
6676c89c0e
I sucked off the hyptothetical wizard again, just using BNB's ADAM optimizer nets HUGE savings, but I don't know the output costs, will need to test
Sorry about the weight, I didn't forget; I kept timing out when the upload almost finished, three times.
Bit of a pickle of instructions (using litterbox, split into 2 7zips, because for some…
6676c89c0e
I sucked off the hyptothetical wizard again, just using BNB's ADAM optimizer nets HUGE savings, but I don't know the output costs, will need to test