mrq c690aa509d fixes and compat (MoE-fying an existing model and retraining from there just ruins it after a second of audio...)		2023-12-25 21:20:32 -06:00
..
__init__.py	fixes and compat (MoE-fying an existing model and retraining from there just ruins it after a second of audio...)	2023-12-25 21:20:32 -06:00
base.py	added torchscale XMOE integration (because Mixtral 8x7B seems very promising and I want to see if it works)	2023-12-20 18:45:58 -06:00
deepspeed.py	fixed training stats not loading from exported weights, a bit of a readme cleanup, updated example training yaml	2023-09-23 19:59:00 -05:00