mrq 24d888c47c temporarily dropping support for xformers because it's breaking when using an attention mask (which i dont remember commenting it out when being passed), default to not use wandb because it's being a pain when doing tests and not actual sessionsS)		2024-11-22 11:29:12 -06:00
..
attention	ugh	2024-08-30 14:39:07 -05:00
__init__.py	cleanup	2024-11-21 23:08:43 -06:00
bitnet.py
llama.py	temporarily dropping support for xformers because it's breaking when using an attention mask (which i dont remember commenting it out when being passed), default to not use wandb because it's being a pain when doing tests and not actual sessionsS)	2024-11-22 11:29:12 -06:00
mamba.py	temporarily dropping support for xformers because it's breaking when using an attention mask (which i dont remember commenting it out when being passed), default to not use wandb because it's being a pain when doing tests and not actual sessionsS)	2024-11-22 11:29:12 -06:00
mixtral.py
retnet.py
transformer.py