mrq e5916ea519 for my sanity it seems having extraneous tokens in the embedding/classifier has the loss/acc a little higher than it should		2025-02-11 14:47:35 -06:00
..
__init__.py	for my sanity it seems having extraneous tokens in the embedding/classifier has the loss/acc a little higher than it should	2025-02-11 14:47:35 -06:00
base.py	remove nan checks because it causes problems in distributed training because I'm not syncing between GPUs (and nan losses gets ignored anyways with loss scaling)	2024-12-15 09:42:54 -06:00
deepspeed.py	remove nan checks because it causes problems in distributed training because I'm not syncing between GPUs (and nan losses gets ignored anyways with loss scaling)	2024-12-15 09:42:54 -06:00