2 Commits

Author	SHA1	Message	Date
mrq	6634d07576	added muon optimizer through kludge hacks because it necessitates a second optimizer in tandum that seems to only sometimes work with deepspeed	2025-02-23 11:22:13 -06:00
mrq	ff6fe6f1bc	cleanup	2024-06-05 20:30:43 -05:00