mrq 3dca1125f5 implemented xformers in HF's Llama (because theres no flash attention for Volta cards)		2024-05-04 13:07:45 -05:00
..
emb	it slipped my mind that technically DAC can be used at any sample rate, since it models waveforms; make it a config YAML option to allow this behavior	2024-04-19 18:36:54 -05:00
engines	simple DDP wrapper (for my NVlink test)	2024-05-04 11:48:26 -05:00
ext	backwards compat for old YAMLs with models, option to set flash attention 2 for Llama (and derivatives), included syncdoth/RetNets torchscale retnet for shits and grins, etc.	2024-04-16 10:02:31 -05:00
models	implemented xformers in HF's Llama (because theres no flash attention for Volta cards)	2024-05-04 13:07:45 -05:00
utils	apparently I got an error for trying to serialize an errant tensor that made its way into the json, this could be remedied easily with recursively traversing the dict and coercing any objects to primitives, but I'm tired and I just want to start training and nap	2024-05-04 12:33:43 -05:00
__init__.py
__main__.py	deprecate sole AR/NAR model by only keeping the AR+NAR (the beauty of no one using this is that I can break compat as much as I want), add tone token for when I classify my dataset with tone/emotion in the future, some other things	2024-04-15 19:54:32 -05:00
config.py	added option to specify frames per second for the given audio representation (Encodec is 75Hz, DAC is 41Hz (at 24K sources))	2024-05-04 12:05:41 -05:00
data.py	added option to specify frames per second for the given audio representation (Encodec is 75Hz, DAC is 41Hz (at 24K sources))	2024-05-04 12:05:41 -05:00
export.py
inference.py	added option to specify frames per second for the given audio representation (Encodec is 75Hz, DAC is 41Hz (at 24K sources))	2024-05-04 12:05:41 -05:00
plot.py	deprecate sole AR/NAR model by only keeping the AR+NAR (the beauty of no one using this is that I can break compat as much as I want), add tone token for when I classify my dataset with tone/emotion in the future, some other things	2024-04-15 19:54:32 -05:00
samplers.py
train.py	simple DDP wrapper (for my NVlink test)	2024-05-04 11:48:26 -05:00
webui.py	backwards compat for old YAMLs with models, option to set flash attention 2 for Llama (and derivatives), included syncdoth/RetNets torchscale retnet for shits and grins, etc.	2024-04-16 10:02:31 -05:00