mrq 827cf632e7 report current loss scale and adjust grad norm by loss scale (for deepspeed)		2024-06-01 10:44:32 -05:00
..
__init__.py	forgot to pass warmup to schedule free	2024-05-09 22:18:49 -05:00
base.py	report current loss scale and adjust grad norm by loss scale (for deepspeed)	2024-06-01 10:44:32 -05:00
deepspeed.py	nan loss detection (should have added it earlier), loss scaling for local backend + fp16	2024-05-11 22:23:29 -05:00