|
|
7bcedca771
|
I guess I can't easily toggle it outside of here, but it works
|
2023-02-23 07:02:06 +00:00 |
|
|
|
58600274ac
|
Disabling bitsandbytes optimization as default for now, in the off chance that it actually produces garbage (which shouldn't happen, there's no chance, if training at float16 from a model at float16 works fine, then this has to work)
|
2023-02-23 03:22:59 +00:00 |
|
|
|
6676c89c0e
|
I sucked off the hyptothetical wizard again, just using BNB's ADAM optimizer nets HUGE savings, but I don't know the output costs, will need to test
|
2023-02-23 02:42:17 +00:00 |
|
