mrq 4d75ee066c actually do the Linear replacement with TE's Linear		2024-04-09 14:41:13 -05:00
..
__init__.py	added FP8 support through NVIDIA/TransformerEngine, added RetNet_HF through syncdoth/RetNet (as an alternative to branch away from torchscale)	2024-04-08 20:14:51 -05:00
adaln.py
ar_nar.py	actually do the Linear replacement with TE's Linear	2024-04-09 14:41:13 -05:00
ar.py	actually use langs from the dataloader	2023-10-11 21:21:50 -05:00
base.py	added FP8 support through NVIDIA/TransformerEngine, added RetNet_HF through syncdoth/RetNet (as an alternative to branch away from torchscale)	2024-04-08 20:14:51 -05:00
nar.py	actually use langs from the dataloader	2023-10-11 21:21:50 -05:00
retnet_hf.py	added FP8 support through NVIDIA/TransformerEngine, added RetNet_HF through syncdoth/RetNet (as an alternative to branch away from torchscale)	2024-04-08 20:14:51 -05:00
retnet.py	added FP8 support through NVIDIA/TransformerEngine, added RetNet_HF through syncdoth/RetNet (as an alternative to branch away from torchscale)	2024-04-08 20:14:51 -05:00
transformer.py	Added cfg.bitsandbytes.replace as a less intrusive alternative to cfg.bitsandbytes.inject to replace all Linear modules in a model	2024-03-01 19:20:10 -06:00