mrq 5c8694db8e nasty bandaid if there's no validation dataset specified during training (for example, during finetunes)		2023-08-30 18:23:05 -05:00
..
emb	overhauled dataloading code to be marginally faster, mostly cleaned up, and can leverage a metadata json to help things out	2023-08-26 19:53:23 -05:00
engines	added total samples processed and tokens processed (len of text tokens + len of target response tokens)	2023-08-28 11:02:45 -05:00
models	Undo naive=False test flag, this shouldn't have made its way in	2023-08-26 22:00:43 -05:00
utils	added total samples processed and tokens processed (len of text tokens + len of target response tokens)	2023-08-28 11:02:45 -05:00
__init__.py
__main__.py	inferencing cleanup	2023-08-20 21:36:02 -05:00
config.py	added ability to mark models as disabled for training, and hotloading them for eval/validation (useful if training only one model, or training a model per GPU)	2023-08-27 12:26:12 -05:00
data.py	nasty bandaid if there's no validation dataset specified during training (for example, during finetunes)	2023-08-30 18:23:05 -05:00
export.py
inference.py	I think I fixed a bug?	2023-08-24 23:33:36 -05:00
train.py	added total samples processed and tokens processed (len of text tokens + len of target response tokens)	2023-08-28 11:02:45 -05:00