mrq 712808494f added support for optional prodigy optimizer (https://github.com/konstmish/prodigy) although it consumes a lot more VRAM per parameter		2023-09-06 20:33:16 -05:00
..
__init__.py	added option to use SGD optimizer through the YAML, added option to pass in additional optimizer parameters through the YAML, added experimental unified AR+NAR model (does not seem fruitful in testing)	2023-09-06 18:58:35 -05:00
adaln.py
ar_nar.py	added support for optional prodigy optimizer (https://github.com/konstmish/prodigy) although it consumes a lot more VRAM per parameter	2023-09-06 20:33:16 -05:00
ar.py	fixed the AR+NAR dual model, the resp_emb has to be split up (classifier might too)	2023-09-06 19:33:39 -05:00
base.py	fixed the AR+NAR dual model, the resp_emb has to be split up (classifier might too)	2023-09-06 19:33:39 -05:00
nar.py	fixed the AR+NAR dual model, the resp_emb has to be split up (classifier might too)	2023-09-06 19:33:39 -05:00
retnet.py
transformer.py