mrq c2a436d368 somehow between training sessions grad_norm = None even though it worked before		2024-06-02 08:29:27 -05:00
..
emb
engines	somehow between training sessions grad_norm = None even though it worked before	2024-06-02 08:29:27 -05:00
ext
models	added model config option to set KV head count for MQA/GQA instead of MHA for llama-based models (i think its very negligible both ways on such a small model size)	2024-05-31 19:32:37 -05:00
utils	reverted automatically disabling split loss calc, since it seems that it's actually cacling loss on prom causes the oddities, maybe	2024-06-01 12:34:59 -05:00
__init__.py
__main__.py
config.py	reverted automatically disabling split loss calc, since it seems that it's actually cacling loss on prom causes the oddities, maybe	2024-06-01 12:34:59 -05:00
data.py	ugh	2024-06-01 10:46:42 -05:00
export.py
inference.py
plot.py
samplers.py
train.py	nevermind it breaks training	2024-05-25 18:03:43 -05:00
webui.py