mrq 9c198eb75a added torchscale XMOE integration (because Mixtral 8x7B seems very promising and I want to see if it works)		2023-12-20 18:45:58 -06:00
..
__init__.py
adaln.py
ar_nar.py	added torchscale XMOE integration (because Mixtral 8x7B seems very promising and I want to see if it works)	2023-12-20 18:45:58 -06:00
ar.py
base.py	added torchscale XMOE integration (because Mixtral 8x7B seems very promising and I want to see if it works)	2023-12-20 18:45:58 -06:00
nar.py
retnet.py
transformer.py