mrq 02a8bcbe29 fixed errant index error (although it makes me wonder if my segmented masking is still flawed)		2025-03-21 23:41:34 -05:00
..
arch	fixed errant index error (although it makes me wonder if my segmented masking is still flawed)	2025-03-21 23:41:34 -05:00
__init__.py	segregated experimental changes into its own streamlined file to avoid breaking the existing model, and it can pivot to the cleaned up code if it actually works (nothing is working)	2025-02-26 21:26:13 -06:00
ar_nar_v2.py	cleaned up parallel nar, i think it's slightly faster but even the smallest model is still slower than ar+nar-len-llama-8...	2025-03-20 15:56:15 -05:00
ar_nar.py	a gorillionth time's the charm (aka: the encoder/decoder pill is a tough pill to swallow)	2025-02-28 17:56:50 -06:00
base_v2.py	add segmented sliding attention, also found a bug with prom-less segments in the attention mask generation.........	2025-03-21 19:05:49 -05:00
base.py	yuge speedup because of a dumb oversight	2025-03-20 17:39:41 -05:00
lora.py	naive model offloading support (handles automatically splitting parts of the model to requested device per memory constraints, either inferred or requested in the yaml, input tensors are automatically migrated to the right device, it SEEMS to work for training under the test trainer when split between GPU and CPU) (this was specifically only because that Flux imagegen model released so I can test it there)	2024-08-01 20:12:06 -05:00