mrq 6b0891448c pain (some shit to try and get some flash attention for ROCm (gfx1100) through triton fused attention but no good)		2024-08-25 20:07:27 -05:00
..
emb	my DAC dataset again managed to only have some utterances with only 8 of 9 RVQ levels, this fixes an oversight from it	2024-08-09 21:18:01 -05:00
engines	fix issue with sft and shared tensors...	2024-08-04 19:56:21 -05:00
ext
models	pain (some shit to try and get some flash attention for ROCm (gfx1100) through triton fused attention but no good)	2024-08-25 20:07:27 -05:00
utils	fix issue with sft and shared tensors...	2024-08-04 19:56:21 -05:00
__init__.py
__main__.py
config.py	maybe not	2024-08-09 11:38:08 -05:00
data.py	added flash_attn LlamaAttention (including flash_attn==1.0.9)	2024-08-18 20:51:14 -05:00
demo.py	fix issue with sft and shared tensors...	2024-08-04 19:56:21 -05:00
export.py	added export option to convert Llama to MixtralMoE for another dumb experiment	2024-08-04 20:25:06 -05:00
inference.py
plot.py
samplers.py
train.py
webui.py	fix issue with sft and shared tensors...	2024-08-04 19:56:21 -05:00