mrq d405f243d4 at wits end in trying to output the right attention scores		2024-10-12 23:53:13 -05:00
..
emb	added experimental entropix sampling support	2024-10-11 21:18:26 -05:00
engines
ext
models	at wits end in trying to output the right attention scores	2024-10-12 23:53:13 -05:00
utils	sped up inferencing by not doing .tolist() for rep pen / length pen (and a bug fix in the web UI from prev commit)	2024-10-04 22:18:20 -05:00
__init__.py
__main__.py	modified demo page to be more modular with demoing comparisons, actually provide a path to use modified naive attention, entropix sampling is not tied to an experimental yaml flag now	2024-10-12 11:27:55 -05:00
config.py	modified demo page to be more modular with demoing comparisons, actually provide a path to use modified naive attention, entropix sampling is not tied to an experimental yaml flag now	2024-10-12 11:27:55 -05:00
data.py	added experimental entropix sampling support	2024-10-11 21:18:26 -05:00
demo.py	output attention scores for SDPA/flash, since naive attention seems broken	2024-10-12 12:09:17 -05:00
export.py
inference.py	modified demo page to be more modular with demoing comparisons, actually provide a path to use modified naive attention, entropix sampling is not tied to an experimental yaml flag now	2024-10-12 11:27:55 -05:00
plot.py	lol	2024-10-12 09:57:34 -05:00
samplers.py	at wits end in trying to output the right attention scores	2024-10-12 23:53:13 -05:00
train.py	added --eval-random-text-prompts to use random text prompts for eval pass, added --random-prompts for demo page and --lora to use a sample with the lora disabled, probably finally fixed validation dataloader breaking on eval	2024-10-10 13:40:25 -05:00
webui.py	modified demo page to be more modular with demoing comparisons, actually provide a path to use modified naive attention, entropix sampling is not tied to an experimental yaml flag now	2024-10-12 11:27:55 -05:00