mrq 0841f366e8 I should really just grab modelling_llama wholesale (fix for the adapted attention class)		2025-01-28 21:55:05 -06:00
..
arch	I should really just grab modelling_llama wholesale (fix for the adapted attention class)	2025-01-28 21:55:05 -06:00
__init__.py		2024-12-26 21:42:17 -06:00
ar_nar.py	updated mixtral backend (need this for something else)	2025-01-20 21:50:56 -06:00
base.py	updated mixtral backend (need this for something else)	2025-01-20 21:50:56 -06:00
lora.py	naive model offloading support (handles automatically splitting parts of the model to requested device per memory constraints, either inferred or requested in the yaml, input tensors are automatically migrated to the right device, it SEEMS to work for training under the test trainer when split between GPU and CPU) (this was specifically only because that Flux imagegen model released so I can test it there)	2024-08-01 20:12:06 -05:00