mrq 2cb465018b implicitly load either normal pickled weights or safetensors on loading the model		2024-08-03 23:34:18 -05:00
..
emb	added prom-less training / inferencing, some other things	2024-07-22 19:36:07 -05:00
engines	implicitly load either normal pickled weights or safetensors on loading the model	2024-08-03 23:34:18 -05:00
ext
models	changed torch.Tensor().to(device, dtype) to just torch.tensor(..., device, dtype) because it's been bothering my autism that I'm creating tensors then converting rather than creating with the right device/dtype, some 'optimization' to compile the model but it doesnt seem to do anything useful	2024-08-03 22:10:21 -05:00
utils	implicitly load either normal pickled weights or safetensors on loading the model	2024-08-03 23:34:18 -05:00
__init__.py
__main__.py	added option to set the causal size (how many tokens to sample per AR step), but requires the model to be trained for this (which explains why recurrent chunk sampling just doesn't work for the retnet tests, obvious in hindsight)	2024-07-30 20:53:51 -05:00
config.py	implicitly load either normal pickled weights or safetensors on loading the model	2024-08-03 23:34:18 -05:00
data.py	added safetensors support (with metadata) and feed whatever torch.load/torch.save into it	2024-08-03 23:15:20 -05:00
demo.py	actually pass language into dataset process script, fix coercing japanese into hiragana because espeak does not like kanji	2024-07-21 23:21:37 -05:00
export.py	added safetensors support (with metadata) and feed whatever torch.load/torch.save into it	2024-08-03 23:15:20 -05:00
inference.py	fix weird regression in handling checkpoints when backend is local, but deepspeed checkpoints are in (it was handled with LoRA loading but not real loading...)	2024-07-30 22:15:56 -05:00
plot.py	ugh	2024-06-09 11:39:43 -05:00
samplers.py	possible speedup for samplers that require a list of previous tokens (the DRY sampler made me realize that I should copy the tolist() thing from the rep pen sampler for everything else)	2024-07-29 20:23:26 -05:00
train.py	add cap for NAR-len training, to avoid any weird cases in early training where it'll just mess up and generate long lengths	2024-08-03 21:00:32 -05:00
webui.py	implicitly load either normal pickled weights or safetensors on loading the model	2024-08-03 23:34:18 -05:00