mrq 4800e7179a remove nan checks because it causes problems in distributed training because I'm not syncing between GPUs (and nan losses gets ignored anyways with loss scaling)		2024-12-15 09:42:54 -06:00
..
__init__.py	finally figured out a clean way to handle "resuming" the tqdm bar	2024-12-14 18:44:43 -06:00
base.py	remove nan checks because it causes problems in distributed training because I'm not syncing between GPUs (and nan losses gets ignored anyways with loss scaling)	2024-12-15 09:42:54 -06:00
deepspeed.py	remove nan checks because it causes problems in distributed training because I'm not syncing between GPUs (and nan losses gets ignored anyways with loss scaling)	2024-12-15 09:42:54 -06:00