mrq 9910c75d5a checkpointing for bitnet impl		2024-05-12 07:52:54 -05:00
..
__init__.py	sanitizing	2024-05-11 16:31:05 -05:00
adaln.py
ar_nar.py	leverage between xformers and torch.backends.cuda.sdp_kernel for attention	2024-05-11 17:14:05 -05:00
base.py	checkpointing for bitnet impl	2024-05-12 07:52:54 -05:00
retnet_hf.py
retnet_ts.py	backwards compat for old YAMLs with models, option to set flash attention 2 for Llama (and derivatives), included syncdoth/RetNets torchscale retnet for shits and grins, etc.	2024-04-16 10:02:31 -05:00
retnet.py
transformer.py