mrq 09804ecc16 APOLLO tweaks to make it work with deepspeed		2024-12-13 23:03:52 -06:00
..
__init__.py	APOLLO tweaks to make it work with deepspeed	2024-12-13 23:03:52 -06:00
base.py	APOLLO tweaks to make it work with deepspeed	2024-12-13 23:03:52 -06:00
deepspeed.py	added knowledge distillation in the trainer (sadly it is not agnostic because of the grave mistake of further processing the batch within the forward pass, so subsequent calls do not match......)	2024-12-05 23:05:52 -06:00