mrq 134dac8c2b re-adapted process_libritts.py to a 'better' way (better because it processed without needing to shuffle a bunch of things and adapt to cope or something)		2024-08-05 20:34:58 -05:00
..
emb	re-adapted process_libritts.py to a 'better' way (better because it processed without needing to shuffle a bunch of things and adapt to cope or something)	2024-08-05 20:34:58 -05:00
engines	fix issue with sft and shared tensors...	2024-08-04 19:56:21 -05:00
ext
models	updated process_datasets.py, added argparsing so I can mostly stop manually editing things, and some other cleanup	2024-08-05 15:59:25 -05:00
utils	fix issue with sft and shared tensors...	2024-08-04 19:56:21 -05:00
__init__.py
__main__.py
config.py	implicitly load either normal pickled weights or safetensors on loading the model	2024-08-03 23:34:18 -05:00
data.py	added safetensors support (with metadata) and feed whatever torch.load/torch.save into it	2024-08-03 23:15:20 -05:00
demo.py	fix issue with sft and shared tensors...	2024-08-04 19:56:21 -05:00
export.py	added export option to convert Llama to MixtralMoE for another dumb experiment	2024-08-04 20:25:06 -05:00
inference.py
plot.py
samplers.py
train.py	add cap for NAR-len training, to avoid any weird cases in early training where it'll just mess up and generate long lengths	2024-08-03 21:00:32 -05:00
webui.py	fix issue with sft and shared tensors...	2024-08-04 19:56:21 -05:00