mrq 9c198eb75a added torchscale XMOE integration (because Mixtral 8x7B seems very promising and I want to see if it works)		2023-12-20 18:45:58 -06:00
..
__init__.py	fixed issue with training from scratch (oops)	2023-10-21 09:55:38 -05:00
base.py	added torchscale XMOE integration (because Mixtral 8x7B seems very promising and I want to see if it works)	2023-12-20 18:45:58 -06:00
deepspeed.py	fixed training stats not loading from exported weights, a bit of a readme cleanup, updated example training yaml	2023-09-23 19:59:00 -05:00