mrq 6b237ae5e3 tweaks for the local engine orchestrator (that I never caught since I always used the deepspeed backend)		2024-12-12 13:37:38 -06:00
..
__init__.py	APOLLO cringe (doesn't want to work with deepspeed)	2024-12-12 00:31:58 -06:00
base.py	tweaks for the local engine orchestrator (that I never caught since I always used the deepspeed backend)	2024-12-12 13:37:38 -06:00
deepspeed.py	added knowledge distillation in the trainer (sadly it is not agnostic because of the grave mistake of further processing the batch within the forward pass, so subsequent calls do not match......)	2024-12-05 23:05:52 -06:00