2 Commits

Author	SHA1	Message	Date
mrq	58600274ac	Disabling bitsandbytes optimization as default for now, in the off chance that it actually produces garbage (which shouldn't happen, there's no chance, if training at float16 from a model at float16 works fine, then this has to work)	2023-02-23 03:22:59 +00:00
mrq	6676c89c0e	I sucked off the hyptothetical wizard again, just using BNB's ADAM optimizer nets HUGE savings, but I don't know the output costs, will need to test	2023-02-23 02:42:17 +00:00