mrq 6634d07576 added muon optimizer through kludge hacks because it necessitates a second optimizer in tandum that seems to only sometimes work with deepspeed		2025-02-23 11:22:13 -06:00
..
attention	updated mixtral backend (need this for something else)	2025-01-20 21:50:56 -06:00
__init__.py	ugh	2025-02-09 13:02:51 -06:00
bitnet.py	re-added loading multiple models because I'm now entertaining having split AR/NAR models again (and need a way to load both at once)	2024-06-06 09:48:43 -05:00
llama.py	agony	2025-02-12 00:18:24 -06:00
mamba.py	touch ups in docs	2024-12-02 19:10:42 -06:00
mixtral.py	oops	2025-01-21 11:59:24 -06:00
retnet.py	cleanup	2024-06-05 20:30:43 -05:00
transformer.py	added muon optimizer through kludge hacks because it necessitates a second optimizer in tandum that seems to only sometimes work with deepspeed	2025-02-23 11:22:13 -06:00