mrq d760924719 added kludgy eval only so I don't have to start training, type eval, stop training, then delete the logs for that session		2024-05-25 17:39:51 -05:00
..
emb	DAC just doesn't work well enough......	2024-05-25 11:07:52 -05:00
engines	nan loss detection (should have added it earlier), loss scaling for local backend + fp16	2024-05-11 22:23:29 -05:00
ext	backwards compat for old YAMLs with models, option to set flash attention 2 for Llama (and derivatives), included syncdoth/RetNets torchscale retnet for shits and grins, etc.	2024-04-16 10:02:31 -05:00
models	DAC just doesn't work well enough......	2024-05-25 11:07:52 -05:00
utils	leverage between xformers and torch.backends.cuda.sdp_kernel for attention	2024-05-11 17:14:05 -05:00
__init__.py
__main__.py
config.py	DAC just doesn't work well enough......	2024-05-25 11:07:52 -05:00
data.py	DAC just doesn't work well enough......	2024-05-25 11:07:52 -05:00
export.py
inference.py	DAC just doesn't work well enough......	2024-05-25 11:07:52 -05:00
plot.py
samplers.py
train.py	added kludgy eval only so I don't have to start training, type eval, stop training, then delete the logs for that session	2024-05-25 17:39:51 -05:00
webui.py	backwards compat for old YAMLs with models, option to set flash attention 2 for Llama (and derivatives), included syncdoth/RetNets torchscale retnet for shits and grins, etc.	2024-04-16 10:02:31 -05:00