|
|
0f04206aa2
|
added ability to toggle some settings with envvars for later testing without needing to manually edit this file (and some other things like disabling it when a user requests it in the future)
|
2023-02-24 23:08:56 +00:00 |
|
|
|
1433b7c0ea
|
working Embedding override
|
2023-02-23 07:28:27 +00:00 |
|
|
|
fd66c4104b
|
ugh
|
2023-02-23 07:18:07 +00:00 |
|
|
|
7bcedca771
|
I guess I can't easily toggle it outside of here, but it works
|
2023-02-23 07:02:06 +00:00 |
|
|
|
58600274ac
|
Disabling bitsandbytes optimization as default for now, in the off chance that it actually produces garbage (which shouldn't happen, there's no chance, if training at float16 from a model at float16 works fine, then this has to work)
|
2023-02-23 03:22:59 +00:00 |
|
|
|
6676c89c0e
|
I sucked off the hyptothetical wizard again, just using BNB's ADAM optimizer nets HUGE savings, but I don't know the output costs, will need to test
|
2023-02-23 02:42:17 +00:00 |
|
