mrq 29c35528e5 the sooner I accept there's no FA for V100s the sooner I'll go to bed		2024-08-18 23:54:33 -05:00
..
mamba_vasqu
retnet_syncdoth
__init__.py	add adapted MixtralAttention for when I make a bad decision to actually train a MoE	2024-08-04 22:03:22 -05:00
bitnet.py
llama.py	the sooner I accept there's no FA for V100s the sooner I'll go to bed	2024-08-18 23:54:33 -05:00
mamba.py	ughghghhhh	2024-08-09 21:15:01 -05:00
mixtral.py	added flash_attn LlamaAttention (including flash_attn==1.0.9)	2024-08-18 20:51:14 -05:00
retnet.py
transformer.py