mrq 687c71e028 disable accuracy calc because it breaks with actual batched training even though it shouldn't		2024-06-04 22:13:44 -05:00
..
__init__.py	fixes	2024-06-04 00:07:00 -05:00
adaln.py	Tweaks	2023-08-02 22:06:39 +00:00
ar_nar.py	fixes	2024-06-04 00:07:00 -05:00
base.py	feverish cleanup	2024-06-03 21:28:49 -05:00
experimental.py	disable accuracy calc because it breaks with actual batched training even though it shouldn't	2024-06-04 22:13:44 -05:00
retnet_hf.py	fixes	2024-06-04 00:07:00 -05:00
retnet_ts.py	fixes	2024-06-04 00:07:00 -05:00
retnet.py	added FP8 support through NVIDIA/TransformerEngine, added RetNet_HF through syncdoth/RetNet (as an alternative to branch away from torchscale)	2024-04-08 20:14:51 -05:00
transformer.py	feverish cleanup	2024-06-03 21:28:49 -05:00