mrq 5af6f41c94 added loss calcs against prom (requires the right settings for not shit results, disabled by default)		2024-05-27 08:43:00 -05:00
..
emb	DAC just doesn't work well enough......	2024-05-25 11:07:52 -05:00
engines	nan loss detection (should have added it earlier), loss scaling for local backend + fp16	2024-05-11 22:23:29 -05:00
ext	backwards compat for old YAMLs with models, option to set flash attention 2 for Llama (and derivatives), included syncdoth/RetNets torchscale retnet for shits and grins, etc.	2024-04-16 10:02:31 -05:00
models	added loss calcs against prom (requires the right settings for not shit results, disabled by default)	2024-05-27 08:43:00 -05:00
utils	some cleanup	2024-05-25 17:46:52 -05:00
__init__.py
__main__.py	deprecate sole AR/NAR model by only keeping the AR+NAR (the beauty of no one using this is that I can break compat as much as I want), add tone token for when I classify my dataset with tone/emotion in the future, some other things	2024-04-15 19:54:32 -05:00
config.py	added loss calcs against prom (requires the right settings for not shit results, disabled by default)	2024-05-27 08:43:00 -05:00
data.py	DAC just doesn't work well enough......	2024-05-25 11:07:52 -05:00
export.py
inference.py	DAC just doesn't work well enough......	2024-05-25 11:07:52 -05:00
plot.py	deprecate sole AR/NAR model by only keeping the AR+NAR (the beauty of no one using this is that I can break compat as much as I want), add tone token for when I classify my dataset with tone/emotion in the future, some other things	2024-04-15 19:54:32 -05:00
samplers.py
train.py	nevermind it breaks training	2024-05-25 18:03:43 -05:00
webui.py	backwards compat for old YAMLs with models, option to set flash attention 2 for Llama (and derivatives), included syncdoth/RetNets torchscale retnet for shits and grins, etc.	2024-04-16 10:02:31 -05:00